Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is uniqueItems supported? #60

Open
Govorunb opened this issue Feb 19, 2025 · 1 comment
Open

Is uniqueItems supported? #60

Govorunb opened this issue Feb 19, 2025 · 1 comment
Assignees

Comments

@Govorunb
Copy link
Collaborator

As far as I can tell, uniqueItems (currently used by Inscryption) isn't widely supported by the available structured output grammar engine thingies:

  • guidance has an image with a feature matrix for what I assume are the most common solutions (I'm not really in the business of picking structured output libraries)
  • llama.cpp gives some reasoning as to why they don't support it

The spec doesn't mention the keyword as forbidden. Does Neuro support this?

@CoolCat467
Copy link
Contributor

Neuro gets told your specification, along with the command name and the command's description. The returned response from Neuro can be literally anything, including invalid json:

The data parameter comes directly from Neuro, so there is a chance it might be malformed, contain invalid JSON, or not match the provided schema exactly.
You are responsible for validating the JSON and returning an unsuccessful action result if it is invalid.

Source: https://github.com/VedalAI/neuro-game-sdk/blob/main/API/SPECIFICATION.md#parameters-7

So really, your question could be re-phrased as "Does Neuro understand uniqueItems", and the answer to that is who really knows what a large language model "knows" at all, but for all intents and purposes don't count on it to be correct.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants