Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Command-R - An low-latency LLM with long context, opitmized for RAG and tool use. #729

Open
1 task
irthomasthomas opened this issue Mar 16, 2024 · 1 comment
Labels
AI-Chatbots Topics related to advanced chatbot platforms integrating multiple AI models code-generation code generation models and tools like copilot and aider lisp Programming in Lisp llm Large Language Models Models LLM and ML model repos and links prompt Collection of llm prompts and notes python Python code, tools, info RAG Retrieval Augmented Generation for LLMs shell-script shell scripting in Bash, ZSH, POSIX etc Software2.0 Software development driven by AI and neural networks.

Comments

@irthomasthomas
Copy link
Owner

Command-R

Description:
Command-R is a Large Language Model optimized for conversational interaction and long context tasks. It targets the “scalable” category of models that balance high performance with strong accuracy, enabling companies to move beyond proof of concept, and into production. Command-R boasts high precision on retrieval augmented generation (RAG) and tool use tasks, low latency and high throughput, a long 128k context, and strong capabilities across 10 key languages.

Model Details

LATEST MODEL DESCRIPTION MAX INPUT TOKENS (INPUT CONTEXT WINDOW) MAX OUTPUT TOKENS (OUTPUT CONTEXT WINDOW) ENDPOINTS
command-r Command-R is an instruction-following conversational model that performs language tasks at a higher quality, more reliably, and with a longer context than previous models. It can be used for complex workflows like code generation, retrieval augmented generation (RAG), tool use, and agents. 128k 4096 Chat

Unique Command-R Model Capabilities

Command-R has been trained on a massive corpus of diverse texts in multiple languages, and can perform a wide array of diverse text-generation tasks. Moreover, Command-R has been trained to especially excel in some of the most critical functionalities for business use-cases.

Multilingual Capabilities

We want Command-R to serve as many people, organizations, and markets as possible, so the new Command-R is capable of interacting in many languages to a fairly high degree of accuracy.

The model is optimized to perform well in the following languages: English, French, Spanish, Italian, German, Brazilian Portuguese, Japanese, Korean, Simplified Chinese, and Arabic.

Additionally, pre-training data has been included for the following 13 languages: Russian, Polish, Turkish, Vietnamese, Dutch, Czech, Indonesian, Ukrainian, Romanian, Greek, Hindi, Hebrew, Persian.

The model has been trained to respond in the language of the user. Here's an example:

co.chat(
  message="Écris une description de produit pour une voiture électrique en 50 à 75 mots"
)

And here's what the response might look like:

TEXT

Découvrez la voiture électrique qui va révolutionner votre façon de conduire.
Avec son design élégant, cette voiture offre une expérience de conduite unique
avec une accélération puissante et une autonomie impressionnante. Sa
technologie avancée vous garantit une charge rapide et une fiabilité inégalée.
Avec sa conception innovante et durable, cette voiture est parfaite pour les
trajets urbains et les longues distances. Profitez d'une conduite silencieuse
et vivez l'expérience de la voiture électrique!

Command-R can not only be used to generate text in several languages but can also perform cross-lingual tasks such as translation or answering questions about content in other languages.

Retrieval Augmented Generation

Command-R has been trained with the ability to ground its generations. This means that it can generate responses based on a list of supplied document snippets, and it will include citations in its response indicating the source of the information.

For more information, check out our dedicated guide on retrieval augmented generation.

Tool Use

Command-R has been trained with conversational tool use capabilities. Its tool use functionality takes a conversation as input (with an optional user-system preamble), along with a list of available tools. The model will then generate a json-formatted list of actions to execute on a subset of those tools. For more information, check out our dedicated tool use guide.

URL: https://docs.cohere.com/docs/command-r

Suggested labels

@irthomasthomas irthomasthomas added AI-Chatbots Topics related to advanced chatbot platforms integrating multiple AI models code-generation code generation models and tools like copilot and aider lisp Programming in Lisp llm Large Language Models prompt Collection of llm prompts and notes python Python code, tools, info RAG Retrieval Augmented Generation for LLMs shell-script shell scripting in Bash, ZSH, POSIX etc labels Mar 16, 2024
@irthomasthomas
Copy link
Owner Author

Related content

#553

Similarity score: 0.89

#706

Similarity score: 0.89

#681

Similarity score: 0.88

#418

Similarity score: 0.88

#715

Similarity score: 0.87

#684

Similarity score: 0.87

@irthomasthomas irthomasthomas changed the title Command-R Command-R - An low-latency LLM with long context, opitmized for RAG and tool use. Mar 16, 2024
@irthomasthomas irthomasthomas added Software2.0 Software development driven by AI and neural networks. Models LLM and ML model repos and links labels Mar 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
AI-Chatbots Topics related to advanced chatbot platforms integrating multiple AI models code-generation code generation models and tools like copilot and aider lisp Programming in Lisp llm Large Language Models Models LLM and ML model repos and links prompt Collection of llm prompts and notes python Python code, tools, info RAG Retrieval Augmented Generation for LLMs shell-script shell scripting in Bash, ZSH, POSIX etc Software2.0 Software development driven by AI and neural networks.
Projects
None yet
Development

No branches or pull requests

1 participant