Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#5230 - Make LLM mention extraction more robust #5273

Merged
merged 2 commits into from
Feb 2, 2025

Conversation

reckart
Copy link
Member

@reckart reckart commented Feb 2, 2025

What's in the PR

  • Use structured output from the LLM when available
  • Use chat-based APIs when talking to LLM
  • Simplify the LLM presets and the interactive LLM sidebar
  • Remove option to configure the response format for the LLM (text vs. JSON) and instead let the extraction mode determine that
  • Introduce paragraph-level prompt context
  • Normalize newlines in prompt context
  • URL for ChatGPT recommenders should no longer include the "v1" - we add that internally
  • Switch default ChatGPT model to o1-mini

How to test manually

  • Try using the LLM recommenders and interactive recommender sidebar

Automatic testing

  • PR includes unit tests

Documentation

  • PR updates documentation

- Use structured output from the LLM when available
- Use chat-based APIs when talking to LLM
- Simplify the LLM presets and the interactive LLM sidebar
- Remove option to configure the response format for the LLM (text vs. JSON) and instead let the extraction mode determine that
- Introduce paragraph-level prompt context
- Normalize newlines in prompt context
- URL for ChatGPT recommenders should no longer include the "v1" - we add that internally
- Switch default ChatGPT model to o1-mini
@reckart reckart added this to the 36.0 milestone Feb 2, 2025
@reckart reckart self-assigned this Feb 2, 2025
…e-robust

* main:
  No issue: Allow access to maven central and other repos
  #5270 - Resizing a span also resizes other overlapping or stacked spans
@reckart reckart force-pushed the feature/5230-Make-LLM-mention-extraction-more-robust branch from 7bede9a to e51a863 Compare February 2, 2025 17:21
@reckart reckart merged commit 4dd1981 into main Feb 2, 2025
3 checks passed
@reckart reckart deleted the feature/5230-Make-LLM-mention-extraction-more-robust branch February 2, 2025 21:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: 🍹 Done
Development

Successfully merging this pull request may close these issues.

1 participant