Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Tools in Vertex AI Gemini #1169

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

sberyozkin
Copy link
Contributor

@sberyozkin sberyozkin commented Dec 17, 2024

Hi @geoand, I've done a lot of copying from similar Ollama Tools support code and I have to admit I'm not sure I'm on the right track, Ollama code has some similarities but the the code there is much more involved compared to the Gemini one which does not offer non-streaming support yet.

Can you please have a quick look tomorrow and point to some obvious errors, before I attempt to test it :-) ?

@sberyozkin sberyozkin changed the title Support Tools for Vertex AI Gemini Support for Tools in Vertex AI Gemini Dec 17, 2024
@geoand
Copy link
Collaborator

geoand commented Dec 18, 2024

Thanks for looking into it @sberyozkin!

There are no obvious error I see, but only some proper testing will show the way :)

@sberyozkin
Copy link
Contributor Author

@geoand Sure, I'll experiment

@sberyozkin
Copy link
Contributor Author

I've prototyped the integration test, with a single Tool for now, and it fails, so the next task for early 2025 is to fix it :-) and then make it work for 2 tools

@geoand
Copy link
Collaborator

geoand commented Dec 24, 2024

🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Support for @Tools with Gemini?
2 participants