Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(blocks): Add Open Router integration with a large selection of new models #8653

Merged
merged 15 commits into from
Nov 18, 2024

Conversation

Torantulino
Copy link
Member

@Torantulino Torantulino commented Nov 14, 2024

This PR Adds support for Open Router as an LLM provider. This platform allows us to easily support any LLM without further integration effort.

Changes:

  • Added support for Open Router integration credentials in the Supabase integration credentials store.
  • Updated the LLM provider field to include "open_router" as a valid provider option.
  • Added Open Router API key field to the backend settings.
  • Updated the profile page to display the Open Router integration credentials.
  • Updated the credentials input and provider components to include Open Router as a provider option.
  • Updated the autogpt-server-api types to include "open_router" as a provider name.
  • Updated the LLM provider schema to include "open_router" as a valid provider name.

New LLMs in this PR:

  1. GEMINI_FLASH_1_5_8B = "google/gemini-flash-1.5"
  2. GEMINI_FLASH_1_5_EXP = "google/gemini-flash-1.5-exp"
  3. GROK_BETA = "x-ai/grok-beta"
  4. MISTRAL_NEMO = "mistralai/mistral-nemo"
  5. COHERE_COMMAND_R_08_2024 = "cohere/command-r-08-2024"
  6. COHERE_COMMAND_R_PLUS_08_2024 = "cohere/command-r-plus-08-2024"
  7. EVA_QWEN_2_5_32B = "eva-unit-01/eva-qwen-2.5-32b"
  8. DEEPSEEK_CHAT = "deepseek/deepseek-chat"
  9. Perplexity: Llama 3.1 Sonar 70B Online

Thanks @OpenRouterTeam <3

- Added support for Open Router integration credentials in the Supabase integration credentials store.
- Updated the LLM provider field to include "open_router" as a valid provider option.
- Added Open Router API key field to the backend settings.
- Updated the profile page to display the Open Router integration credentials.
- Updated the credentials input and provider components to include Open Router as a provider option.
- Updated the autogpt-server-api types to include "open_router" as a provider name.
- Updated the LLM provider schema to include "open_router" as a valid provider name.

- Added GEMINI_FLASH_1_5_8B as the first Open Router LLM
@Torantulino Torantulino requested review from a team as code owners November 14, 2024 20:36
@Torantulino Torantulino requested review from Pwuts and Bentlybro and removed request for a team November 14, 2024 20:36
@CLAassistant
Copy link

CLAassistant commented Nov 14, 2024

CLA assistant check
All committers have signed the CLA.

Copy link
Contributor

This PR targets the master branch but does not come from dev or a hotfix/* branch.

Automatically setting the base branch to dev.

@github-actions github-actions bot changed the base branch from master to dev November 14, 2024 20:36
@github-actions github-actions bot added Forge platform/frontend AutoGPT Platform - Front end platform/backend AutoGPT Platform - Back end platform/blocks size/m labels Nov 14, 2024
Copy link

netlify bot commented Nov 14, 2024

Deploy Preview for auto-gpt-docs canceled.

Name Link
🔨 Latest commit 8c709aa
🔍 Latest deploy log https://app.netlify.com/sites/auto-gpt-docs/deploys/673b468784e26c00087c5bf9

@Torantulino Torantulino marked this pull request as draft November 14, 2024 22:03
@Torantulino Torantulino marked this pull request as ready for review November 14, 2024 22:43
@Torantulino Torantulino changed the title feat(blocks): Add Open Router integration credentials feat(blocks): Add Open Router integration with a selection of new models Nov 14, 2024
@Torantulino Torantulino changed the title feat(blocks): Add Open Router integration with a selection of new models feat(blocks): Add Open Router integration with a large selection of new models Nov 14, 2024
@Torantulino Torantulino enabled auto-merge (squash) November 14, 2024 23:07
@ntindle
Copy link
Member

ntindle commented Nov 15, 2024

Code on this looks good and like it touches all the relevant places. Needs testing still on my side before approval

@Torantulino Torantulino requested review from ntindle and removed request for Pwuts November 15, 2024 12:13
Copy link

codecov bot commented Nov 15, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 58.16%. Comparing base (bd2f172) to head (21f47c9).

Additional details and impacted files
@@             Coverage Diff             @@
##              dev    #8653       +/-   ##
===========================================
+ Coverage   34.07%   58.16%   +24.09%     
===========================================
  Files          22      106       +84     
  Lines        1893     5766     +3873     
  Branches      330      720      +390     
===========================================
+ Hits          645     3354     +2709     
- Misses       1234     2306     +1072     
- Partials       14      106       +92     
Flag Coverage Δ
Linux 57.87% <100.00%> (+23.80%) ⬆️
Windows 54.64% <100.00%> (+8.60%) ⬆️
agbenchmark ?
forge 58.04% <100.00%> (?)
macOS 57.04% <100.00%> (+22.96%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@github-actions github-actions bot added size/l and removed size/m labels Nov 15, 2024
@Torantulino
Copy link
Member Author

Torantulino commented Nov 15, 2024

Added perplexity here too :) Very useful for live info Q/A and getting sources.

For the sources specifically we'll need to add another block which outputs them - or Dynamic output pins when we have that feature.

@Torantulino Torantulino removed the Forge label Nov 15, 2024
Copy link
Contributor

@aarushik93 aarushik93 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One small question on extra headers, other than that let's go!

@Torantulino Torantulino merged commit 29cff1b into dev Nov 18, 2024
17 checks passed
@Torantulino Torantulino deleted the toran/open-2037-implement-open-router-llms branch November 18, 2024 14:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
platform/backend AutoGPT Platform - Back end platform/blocks platform/frontend AutoGPT Platform - Front end size/l
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants