-
Notifications
You must be signed in to change notification settings - Fork 354
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
openai: fix low timeouts #926
Conversation
🦋 Changeset detectedLatest commit: 1ea0125 The changes in this PR will be included in the next version bump. This PR includes changesets to release 1 package
Not sure what this means? Click here to learn what changesets are. Click here if you're a maintainer who wants to add another changeset to this PR |
@@ -75,11 +75,11 @@ def __init__( | |||
api_key=api_key, | |||
base_url=base_url, | |||
http_client=httpx.AsyncClient( | |||
timeout=httpx.Timeout(timeout=30, connect=10, read=5, pool=5), | |||
timeout=httpx.Timeout(connect=15.0, read=5.0, write=5.0, pool=5.0), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the change is from 10s -> 15s for connect? what does removing timeout mean? should we also increase the other timeouts?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
timeout is to default everything to 30.0
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
llm was OK, it's more for TTS/STT that the change is going from 5 to 15
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
got it, sounds good
fix ridiculously low timeouts
future work would be to expose those in every client we have
fix #807