Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't rely on tools for structured outputs if there's no structure to the output #54

Closed
shreyashankar opened this issue Oct 3, 2024 · 0 comments · Fixed by #59
Closed

Comments

@shreyashankar
Copy link
Collaborator

If the output schema is just one key with string type value (E.g., answer: string), then we don't need to use tool calling to get a structured output from the LLM. We can just query the LLM normally and save the output string to the specified key (e.g., answer). This will increase success a lot for open-source LLMs.

@shreyashankar shreyashankar changed the title For OSS models: don't rely on tools for structured outputs Don't rely on tools for structured outputs if there's no structure to the output Oct 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant