You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If the output schema is just one key with string type value (E.g., answer: string), then we don't need to use tool calling to get a structured output from the LLM. We can just query the LLM normally and save the output string to the specified key (e.g., answer). This will increase success a lot for open-source LLMs.
The text was updated successfully, but these errors were encountered:
shreyashankar
changed the title
For OSS models: don't rely on tools for structured outputs
Don't rely on tools for structured outputs if there's no structure to the output
Oct 3, 2024
If the output schema is just one key with string type value (E.g.,
answer
:string
), then we don't need to use tool calling to get a structured output from the LLM. We can just query the LLM normally and save the output string to the specified key (e.g.,answer
). This will increase success a lot for open-source LLMs.The text was updated successfully, but these errors were encountered: