Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Unable to enum o1 models on Azure OpenAI #744

Open
1 task
alkampfergit opened this issue Jan 29, 2025 · 7 comments
Open
1 task

[BUG] Unable to enum o1 models on Azure OpenAI #744

alkampfergit opened this issue Jan 29, 2025 · 7 comments
Labels
type: bug Something isn't working

Comments

@alkampfergit
Copy link

alkampfergit commented Jan 29, 2025

Environment

big-agi.com (production website)

Description

When I try to refresh my deployment, if I deploy an o1-mini model I got this error

[ { "received": "failed", "code": "invalid_enum_value", "options": [ "succeeded" ], "path": [ "data", 3, "status" ], "message": "Invalid enum value. Expected 'succeeded', received 'failed'" } ]

I've deployed o1-mini on another datacenter, this time I do not get error, but the model does not show in the list of models.

Device and browser

WIndows, edge browser.

Screenshots and more

Image

Willingness to Contribute

  • 🙋‍♂️ Yes, I would like to contribute a fix.
@alkampfergit alkampfergit added the type: bug Something isn't working label Jan 29, 2025
@alkampfergit alkampfergit changed the title [BUG] Unable to enum models on Azure OpenAI [BUG] Unable to enum o1 models on Azure OpenAI Jan 29, 2025
@enricoros
Copy link
Owner

Hi @alkampfergit can you try now? I've just relaxed the parser and should proceed.

@alkampfergit
Copy link
Author

alkampfergit commented Jan 30, 2025 via email

@alkampfergit
Copy link
Author

alkampfergit commented Feb 6, 2025

I tried to update docker image but I didn't see any new image, still have the same problem

[ { "received": "failed", "code": "invalid_enum_value", "options": [ "succeeded" ], "path": [ "data", 3, "status" ], "message": "Invalid enum value. Expected 'succeeded', received 'failed'" } ]

@rafaelpierre
Copy link

same here, I don't get any error messages but my o1 endpoints from Azure don't show up

@enricoros
Copy link
Owner

Reopening because evidently there's an issue with Azure models. Note: the complexity with azure it's always been the dynamic listing, as the names of deployments are likely non standard and one cannot guess the context window sizes, model capabilities, etc. The code right now is looking up the official OpenAI model names, but in this particular instance there could be other underlying issues.

@enricoros enricoros reopened this Feb 6, 2025
@rafaelpierre
Copy link

rafaelpierre commented Feb 6, 2025 via email

@enricoros
Copy link
Owner

@rafaelpierre it does, but everything else is auto detected. I welcome any pull requests as I don't have azure deployments so it would take me longer to test. 1. For the missing o1, I'll take a look. 2. For the missing UI, I welcome anyone's PR. Note: one must configure also the context window, and capabilities (image input, function calling, etc.) and QUIRKS of the model. For instance, o1 can't stream, and the user will need to say that (again, no auto detect with azure models) otherwise the LLM call will just fail (and note that O1 and P1 preview and O3 have all different quirks)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type: bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants