You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Litellm is a widely used tool in the AI community that allows deploying a proxy and providing access via HTTP API. Additionally, the Litellm API is compatible with the OpenAI API protocol. It would be beneficial to simplify the process of creating a LitellmModel using the existing implementation available at: https://github.com/cloudwego/eino-ext/tree/main/libs/acl/openai.
Describe the solution you'd like
Litellm is a widely used tool in the AI community that allows deploying a proxy and providing access via HTTP API. Additionally, the Litellm API is compatible with the OpenAI API protocol. It would be beneficial to simplify the process of creating a LitellmModel using the existing implementation available at:
https://github.com/cloudwego/eino-ext/tree/main/libs/acl/openai.
Additional Context:
litellm proxy doc: https://docs.litellm.ai/docs/simple_proxy
litellm api: https://litellm-api.up.railway.app/#/
The text was updated successfully, but these errors were encountered: