Skip to content
This repository has been archived by the owner on Jul 15, 2024. It is now read-only.

[P1] Make CAIKit API compatible with KServe predict API or evolve KServe spec to consider HF like inference API #4

Open
heyselbi opened this issue Jun 26, 2023 · 2 comments
Open

[P1] Make CAIKit API compatible with KServe predict API or evolve KServe spec to consider HF like inference API #4

heyselbi opened this issue Jun 26, 2023 · 2 comments

Comments

@heyselbi
Copy link

heyselbi commented Jun 26, 2023 •
edited
Loading

Ref 1: https://github.com/kserve/kserve/tree/master/docs/predict-api/v2
Ref 2: https://huggingface.co/docs/api-inference/detailed_parameters
@heyselbi heyselbi converted this from a draft issue Jun 26, 2023
@heyselbi
Copy link
Author

@danielezonca could you provide more details here? and add relevant labels, complexity etc.

@Xaenalt
Copy link
Member

Xaenalt commented Jul 11, 2023

Complexity is extremely high for this

@heyselbi heyselbi moved this from New/Backlog to To-do/Groomed in ODH Model Serving Planning Sep 14, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
Internal tracking
Status: No status
ODH Feature Tracking
Status: No status
ODH Model Serving Planning
Status: To-do/Groomed
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Xaenalt @heyselbi