-
|
Hi there, Is there a plan to add support to GGUF models (from llama.cpp)? They are very popular and it would be very convenient if we can use them with Outlines. Thank you! |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 3 replies
-
|
UP for Llama-CPP support! |
Beta Was this translation helpful? Give feedback.
-
|
This is being implemented in #486 |
Beta Was this translation helpful? Give feedback.
-
|
It is now available in the latest version. See the documentation. |
Beta Was this translation helpful? Give feedback.
-
|
This is a great upgrade!!! |
Beta Was this translation helpful? Give feedback.
-
|
Thank you! |
Beta Was this translation helpful? Give feedback.
-
|
Thank @dtiarks ! |
Beta Was this translation helpful? Give feedback.
It is now available in the latest version. See the documentation.