Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I have some feedback - [Flagged][Model] in output #23

Open
saturndec opened this issue Mar 14, 2024 · 3 comments
Open

I have some feedback - [Flagged][Model] in output #23

saturndec opened this issue Mar 14, 2024 · 3 comments
Labels
documentation Improvements or additions to documentation question Further information is requested upstream limitation Limitations caused by upstream dependancy

Comments

@saturndec
Copy link

Some situations may appear [Flagged][Model], what is the
微信截图_20240314204710
situation?
like this,Why is this happening? Please help me understand, thank you.

@Cerlancism Cerlancism added question Further information is requested upstream limitation Limitations caused by upstream dependancy documentation Improvements or additions to documentation labels Mar 14, 2024
@Cerlancism
Copy link
Owner

Cerlancism commented Mar 14, 2024

This is intentional. If the model does not follow the expected line number labeling format from the prompt, for example,
1. Input Language
Should output
1. Translated Output Language
Instead of just
Translated Output Language

Some of your output exhibits this behavior. This behavior could indicate that the model might be refusing to translate specific lines of text, possibly due to its internal AI safety moderation protocols. The "Use Moderator" switch is turned on by default to minimize such occurrences, but they cannot be entirely eliminated. You should particularly manually cross-check these lines to ensure the translation makes sense.

This sanity check can be switched off if using the CLI version for now by using the

--no-prefix-number

Which is not yet available on the Web UI. Turning off this feature could increase the issue of input and output lines becoming mismatched or misaligned.

@Cerlancism Cerlancism changed the title I have some feedback I have some feedback - [Flagged][Model] in output Mar 14, 2024
@saturndec
Copy link
Author

thanks🙏

@Cerlancism
Copy link
Owner

Cerlancism commented Aug 18, 2024

This issue could be improved with the newly supported structured mode

Experimental feature:

Try in CLI --experimental-structured-mode

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation question Further information is requested upstream limitation Limitations caused by upstream dependancy
Projects
None yet
Development

No branches or pull requests

2 participants