Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate gemini and vertex modules to use Google's new genai Python SDK #750

Open
willbakst opened this issue Dec 19, 2024 · 2 comments
Open
Assignees
Labels
enhancement New feature or request mirascope

Comments

@willbakst
Copy link
Contributor

Description

Originally mentioned by @Kigstn in #741 (comment)

Looks like Google released a new SDK that provides a unified interface for working with AI Studio and Vertex AI.

We should refactor the gemini module to use this SDK. We can also then essentially completely re-use everything gemini in the vertex module to make the two easier to maintain.

@willbakst
Copy link
Contributor Author

Looking a little more closely at the SDK, it seems like we could just support Vertex AI through a custom client of the gemini module (thereby making it possible to entirely remove the vertex module, but for backwards compatibility, we should still have the vertex module and just implement it by setting the proper custom client on gemini.call).

@willbakst
Copy link
Contributor Author

Hmm, upon further thought, this would likely present a breaking change. The short term solution would be to implement a new google module that uses the new types for the new SDK (and leaves the old modules alone so that they are backwards compatible fully).

Then we can mark them as deprecated and update the documentation (and warnings) to point users to the new google module.

@willbakst willbakst assigned koxudaxi and unassigned koxudaxi Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request mirascope
Projects
None yet
Development

No branches or pull requests

2 participants