-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Cherry-pick] Python fixes and CrashLoop Fix #156
[Cherry-pick] Python fixes and CrashLoop Fix #156
Conversation
* Bump paddlepaddle to 2.6.0 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Bump transformers to version 4.37.2 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Bump cryptography to version 42.0.2 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Bump fastapi to version 0.109.2 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Bump pillow to version 10.2.0 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Bump aiohttp to version 3.9.3 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Revert fastapi bump Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Bump ray serve to 2.9.2 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Pin alibi to >=0.9.4 Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> * Fix alibi version Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com> --------- Signed-off-by: Sivanantham Chinnaiyan <sivanantham.chinnaiyan@ideas2it.com>
ValueError: `detached=False` is no longer supported. In a future release, it will be removed altogether. Signed-off-by: Spolti <fspolti@redhat.com>
* Allow ray 2.6.1 Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * PR suggestion Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Run poetry update --lock Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Support RayServeSyncHandle in ray>=2.5.0 Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Run poetry update --lock Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Correct hashFiles cache for sklearn Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Run poetry update --lock Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Avoid faulty tritonclient release Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Run poetry update --lock Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Add and run make poetry-update-lockfiles Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Refrain from private imports and make poetry-update-lockfiles Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Revert paddle to max 3.10 Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> * Revert "Revert paddle to max 3.10" This reverts commit a5afe2b. Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com> --------- Signed-off-by: ddelange <14880945+ddelange@users.noreply.github.com>
Signed-off-by: Spolti <fspolti@redhat.com>
This enhances the setup of the InferenceService controller and the InferenceGraph controller. Instead of relying on the `defaultDeploymentMode` configuration to determine what CRDs to watch, the setup now checks whether KNative Services and Istio VirtualServices are available in the cluster and setup the watches (invoke `Owns`) accordingly. This enhancement has the following advantages: * A crashloop is prevented if the CRDs are missing in the cluster. The user would still be able to create InferenceServices by taking care of annotating the ISVC for RawDeployment mode. * If RawDeployment mode is configured as the default mode, the controllers would still watch for KNative and Istio resources if these components are available. This will let the controller watch for changes for the dependent resources if the user uses Serverless mode for some of the InferenceServices. * In the InferenceService controller, the watch for the VirtualServices is still conditioned to the value of the `disableVirtualHost` configuration.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: israel-hdez, spolti, terrytangyuan The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
5b4f7fa
into
red-hat-data-services:rhoai-2.8
What this PR does / why we need it:
Cherry pick of: