Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

provide more than buildtime chosen models? #1109

Open
maxandersen opened this issue Nov 26, 2024 · 1 comment
Open

provide more than buildtime chosen models? #1109

maxandersen opened this issue Nov 26, 2024 · 1 comment
Labels
area/model enhancement New feature or request

Comments

@maxandersen
Copy link
Member

Currently model name is build time only.

Makes perfect sense for enabling devmode fetching of the model and even possibly buildtime include the model (for jllama usecase) and definitely makes sense to keep.

But it excludes ability to i.e. use ollama or openai compatible endpoint and swap to a newly available model.

usecases where this is useful, is i.e. i'm writing a ai-agent using granite3-dense:8b but now a granite3-dense-much-better:8b becomes available; or just lets say I finetune a model for my usecase and make it available under a different name - today I'll have to rebuild my ai-agent based on quarkus-langchain4j to make use of that better model - even though nothing else changed.

I can use langchain4j directly and make this work but within quarkus langchain4j I didn't spot a way to do this without having to give up on all the other declarative goodness.

@geoand
Copy link
Collaborator

geoand commented Nov 26, 2024

Definitely something to think about here...

@geoand geoand added the enhancement New feature or request label Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/model enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants