Replies: 1 comment 1 reply
-
Currently no, but we could expose those through an endpoint. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there any way to obtain the startup parameters for llama-server.exe, such as the value of np?
This way, downstream applications that use this interface can automatically optimize parameters without requiring users to manually modify them.
Beta Was this translation helpful? Give feedback.
All reactions