Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle sticky model requests #403

Closed
ukclivecox opened this issue Jan 21, 2019 · 1 comment
Closed

Handle sticky model requests #403

ukclivecox opened this issue Jan 21, 2019 · 1 comment
Labels
Milestone

Comments

@ukclivecox
Copy link
Contributor

Allow model requests with certain headers (cookies) to always go to the same model image running.

  • Would need to look if istio can help here for this kind of fine grained routing
@ukclivecox ukclivecox added this to the 1.0.x milestone Jan 27, 2019
@ukclivecox
Copy link
Contributor Author

Ca be proposed in https://github.com/SeldonIO/mlgraph

agrski added a commit that referenced this issue Dec 2, 2022
* Use Distroless base image instead of Azul/Zulu

* Use entrypoint instead of command

This is because otherwise the arguments to 'java' are passed to the application itself.

* Reorder Dockerfile commands to put USER directive earlier to minimise layer cache invalidation
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant