Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add support for Google Gemini API #1005

Open
boapps opened this issue Sep 28, 2024 · 2 comments
Open

[FEATURE] Add support for Google Gemini API #1005

boapps opened this issue Sep 28, 2024 · 2 comments
Assignees

Comments

@boapps
Copy link

boapps commented Sep 28, 2024

Is your feature request related to a problem? Please describe.
Google AI models can be used with their genai library. I think it would be nice to have support for this as an alternative API.

Describe the solution you'd like
Add a new GoogleAILLM which allows using their API platform as an LLM.

Describe alternatives you've considered
I know it's possible to use Vertex AI, but if I understand it correctly that's mostly for enterprise uses. While this is more for hobby projects. Also has different pricing.

Additional context
I'll have an attempt at this, expect a PR soon.

@boapps boapps changed the title [FEATURE] [FEATURE] Add support for Google Gemini API Sep 28, 2024
@gabrielmbmb gabrielmbmb added this to the 1.5.0 milestone Sep 30, 2024
@davidberenstein1957
Copy link
Member

@boapps this would be a great contribution is you have time to work on this :)

@boapps
Copy link
Author

boapps commented Jan 11, 2025

Sorry, I didn't have time for this, but now the gemini api has an OpenAI compatible api as well, so implementation of a new LLM class should be easier. Or it's now also possible to just use the OpenAILLM class with gemini's base url.

@gabrielmbmb gabrielmbmb removed this from the 1.5.0 milestone Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants