Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed name of the temperature parameter #207

Merged
merged 1 commit into from
Apr 21, 2023

Conversation

agronholm
Copy link
Contributor

The name of the parameter is temperature in the API, but this form passes it as temp, so all invocations of llama always use a temperature of 0.1 (the default value in the API) regardless of this setting.

@nsarrazin
Copy link
Member

Ha good catch, thanks a lot, there should be a better way of doing this, it shouldn't just fail silently with a default value...

Thank your for the contribution, looking good!

@nsarrazin nsarrazin merged commit d2f5063 into serge-chat:main Apr 21, 2023
@agronholm agronholm deleted the patch-1 branch April 21, 2023 10:52
@agronholm
Copy link
Contributor Author

What if you removed the default values from the API? Or is the API intended for use outside of the current front-end?

@nsarrazin
Copy link
Member

nsarrazin commented Apr 21, 2023

Yeah some people use the API outside of the front-end to build their own tools on top of Serge... I think some better type safety on the frontend would be a good addition, I'll need to have a look 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants