Skip to content

Commit

Permalink
test per model endpoint
Browse files Browse the repository at this point in the history
  • Loading branch information
agt committed Nov 2, 2023
1 parent 9f32a49 commit 1557cf6
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/lib/providers/openai/models.svelte
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,7 @@ const chatModelBase = {
// Reference: https://openai.com/pricing#language-models
const localllama = {
...chatModelBase,
getEndpoint: (model) => "https://llm-dev.dsmlp.ucsd.edu/v1/chat/completions",
help: 'Below are the settings that vLLM (in OpenAI compatibility mode) allows to be changed for the API calls. See the <a target="_blank" href="https://platform.openai.com/docs/api-reference/chat/create">OpenAI API docs</a> for more details.',
prompt: 0.0000, // $0.0015 per 1000 tokens prompt
completion: 0.000, // $0.002 per 1000 tokens completion
Expand Down

0 comments on commit 1557cf6

Please sign in to comment.