Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Add image search pretrained models #2598

Open
IanMenendez opened this issue Jun 28, 2024 · 4 comments
Open

[FEATURE] Add image search pretrained models #2598

IanMenendez opened this issue Jun 28, 2024 · 4 comments
Assignees
Labels
enhancement New feature or request

Comments

@IanMenendez
Copy link

Currently, there are no image search pretrained models in OS

Having image search pretrained models would make it plug-and-play removing unnecessary friction.

It would be good to have openai clip models

The workaround to this issue is one needs to trace the model themselves and then register it

@IanMenendez IanMenendez added enhancement New feature or request untriaged labels Jun 28, 2024
@IanMenendez
Copy link
Author

Would be also cool to have some pretrained multimodal search models
Something like visual bert

I've been trying to setup this multimodal model but the lack of documentation makes it really hard

@mingshl
Copy link
Collaborator

mingshl commented Jul 2, 2024

tagging to the RFC [RFC] Support more local model types

@IanMenendez
Copy link
Author

Right now ml commons does not support image embedding models so it is impossible to add image embedding models as pretrained models

To support this we need to add image embedding model type: #2622

We will also need to add an image embedding ingest processor to enable the ingest of images into image embedding models

@hijakk
Copy link

hijakk commented Jan 10, 2025

+1 for interest in native CLIP support in OpenSearch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: In Progress
Development

No branches or pull requests

3 participants