Replies: 1 comment
-
It is supported in latest main branch but not released yet. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
If deployment is supported, why are the responses nonsensical? I'm using the Llama-3-8B-Instruct model, and it works fine when I test it with streamlit.
![image](https://private-user-images.githubusercontent.com/100062430/324669721-be78f986-282d-4477-9de8-ca09069e4109.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkzMDk5ODgsIm5iZiI6MTczOTMwOTY4OCwicGF0aCI6Ii8xMDAwNjI0MzAvMzI0NjY5NzIxLWJlNzhmOTg2LTI4MmQtNDQ3Ny05ZGU4LWNhMDkwNjllNDEwOS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjExJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIxMVQyMTM0NDhaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0wMTU1MmU5ZWI3ZTU0ZjVkZTRkNWM3MTI2NjkyNGQyODExYzM2ZDg2ZDg0YTZlOTFjMzNlZTZmM2I1YzI3N2JkJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.BHoY8ZyChoNIUVsqovhof7LtEgsUVL-G4G_-rDxQgvc)
Beta Was this translation helpful? Give feedback.
All reactions