Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[P0] [SPIKE] - OOTB support for NVIDIA Triton Inference Server #184

Open
heyselbi opened this issue Sep 14, 2023 · 3 comments
Open

[P0] [SPIKE] - OOTB support for NVIDIA Triton Inference Server #184

heyselbi opened this issue Sep 14, 2023 · 3 comments
Assignees
@rpancham @z103cb
Labels
kind/feature Feature requests req From the Requirements document

Comments

@heyselbi
Copy link

heyselbi commented Sep 14, 2023 •
edited
Loading

From req doc:
OOTB support for NVidia Triton Inference Server

  • We are going with OpenVINO right now as Triton can not be built right now due to maintenance concerns.

Acceptance criteria:

  • Scope of work needed
@heyselbi heyselbi converted this from a draft issue Sep 14, 2023
@heyselbi heyselbi changed the title [P0] OOTB support for NVIDIA Triton Inference Server [P0] TBD - OOTB support for NVIDIA Triton Inference Server Sep 14, 2023
@heyselbi heyselbi added the req From the Requirements document label Sep 14, 2023
@heyselbi heyselbi moved this from New/Backlog to To-do/Groomed in ODH Model Serving Planning Sep 14, 2023
@heyselbi heyselbi changed the title [P0] TBD - OOTB support for NVIDIA Triton Inference Server [P0] [SPIKE] - OOTB support for NVIDIA Triton Inference Server Sep 14, 2023
@heyselbi heyselbi mentioned this issue Sep 27, 2023
Closed
@heyselbi heyselbi assigned heyselbi and unassigned Xaenalt and vaibhavjainwiz Oct 16, 2023
@bdattoma
Copy link

@heyselbi this is a SPIKE, hence can I assume that Triton is not targeted for 1.36?

@heyselbi
Copy link
Author

@bdattoma the scoping of the work needed for sure will be complete by 1.36 but the delivery of the feature itself most likely will be next year due to prioritization of other efforts.

@bdattoma
Copy link

got it, thank you!

@heyselbi heyselbi added kind/feature Feature requests and removed rhods-2.5 labels Oct 23, 2023
@heyselbi heyselbi assigned z103cb and unassigned heyselbi Nov 27, 2023
@Jooho Jooho moved this from To-do/Groomed to In Progress in ODH Model Serving Planning Dec 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rpancham rpancham

@z103cb z103cb

Labels
kind/feature Feature requests req From the Requirements document
Projects
Internal tracking
Status: No status
ODH Feature Tracking
Status: No status
ODH Model Serving Planning
Status: In Progress
Milestone
No milestone
Development

No branches or pull requests
6 participants
@Xaenalt @vaibhavjainwiz @heyselbi @bdattoma @rpancham @z103cb