Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Max-Tokens" API setting isn't getting included in the chat request body #409

Open
cheeseonamonkey opened this issue Jul 17, 2023 · 1 comment

Comments

@cheeseonamonkey
Copy link

cheeseonamonkey commented Jul 17, 2023

Max-Tokens" API setting isn't getting included in the chat request body

Just notice that the "Max-Tokens" API setting isn't getting included in the chat request body, even though it appears to be a user configuration setting, and is likely being stored & present in the config slice:

image
   (dev console)

Reproduction:

Pop open the dev console and send some chats. Check the network tab.


  • Max Tokens parameter is a control for the maximum number of tokens that can be generated in a single call to the GPT model (api docs)
@RedwindA
Copy link

RedwindA commented Aug 8, 2023

Just modify max_tokens: undefined in src\api\api.ts to max_tokens: config.max_tokens,working for my instance #436

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants