Command R v01

Overview

Command R v01 is a 35-billion-parameter generative language model developed by Cohere and Cohere Labs, designed to offer high efficiency and strong accuracy for production-scale applications. Released in March 2024, Command R v01 integrates capabilities in retrieval-augmented generation (RAG), tool use, extended context length, and multilingual functionality, making it suitable for enterprise-level deployments and complex reasoning tasks, as detailed in Cohere's blog post announcing its release.

Model Architecture and Training

Command R v01 is based on an optimized transformer architecture. The model's scale, at 35 billion parameters, supports language understanding and reasoning across a range of tasks, according to Cohere documentation. Following pretraining, the model undergoes supervised fine-tuning and preference training to align outputs with preferences for helpfulness, safety, and factuality.

To support diverse use cases, Command R v01 incorporates chat templates for general conversations, as well as specialized prompt templates for grounded generation and tool use scenarios, documented in the prompt guide. The training process leverages a wide spectrum of supervised and preference data, further improved with techniques for retrieval-augmented generation and tool use tasks.

Technical Capabilities

Retrieval-Augmented Generation

A feature of Command R v01 is its retrieval-augmented generation (RAG) capability. The model can accept document snippets as input and generate responses grounded in those texts, providing explicit citations (grounding spans) that trace information to its source. This facilitates grounded summarization and answer generation, which are relevant in minimizing hallucinations and supporting factual integrity in enterprise applications, as described in the grounded generation documentation.

Command R v01 supports various citation modes, balancing speed and accuracy in grounded answer generation. It predicts relevant documents, generates citations, and constructs answers with referenced sources, optimizing for either precision (accurate mode) or efficiency (fast mode).

Tool Use and Function Calling

The model includes tool use capabilities, also known as "function calling." In single-step tool use, Command R v01 can select external tools (such as APIs or databases), specify parameters, and integrate returned information into its final output. It is also capable of multi-step tool use, enabling workflows that involve planning and execution across several inference cycles, as noted in the tool use documentation.

Command R v01 aligns with Hugging Face's tool use API standards and includes mechanisms to either abstain from tool use or chain multiple actions in complex problem-solving sequences, as detailed in the Hugging Face advanced tool use documentation.

Multilingual Support and Context Window

Command R v01 supports multilingual generation across at least ten widely used languages—English, French, Spanish, Italian, German, Brazilian Portuguese, Japanese, Korean, Simplified Chinese, and Arabic—with pretraining inclusions for languages such as Russian, Turkish, Dutch, Vietnamese, Czech, Hindi, Greek, Hebrew, and Persian, according to the Cohere blog. Its context window extends to 128,000 tokens, enabling handling of long documents and complex, context-rich queries.

Code Interaction

While Command R v01 is optimized for conversational code tasks—such as producing code snippets, explanations, or rewrites—it is not primarily designed for pure code completion scenarios, as noted in the model documentation.

Performance and Evaluation

Command R v01 has been evaluated across multiple benchmarks and real-world applications, demonstrating performance in RAG, tool use, multilingual understanding, and long-context tasks.

On enterprise RAG applications, human preference assessments showed Command R performed in comparison to Mixtral in a variety of use cases, including document assistance, customer support, and enterprise FAQ search. For knowledge-intensive retrieval, Command R demonstrated accuracy on KILT Wikipedia index tasks when compared to Llama2-70B (chat), Mixtral, among other models, as noted in the KILT Wikipedia index paper.

For multi-step tool use and reasoning tasks, Command R achieved higher accuracy than its peers on benchmarks including HotpotQA and Bamboogle, demonstrating its proficiency in coordinating search, synthesis, and reasoning across several inference cycles, as detailed in research related to HotpotQA.

In multilingual evaluations, Command R v01 demonstrated accuracy and translation performance on the mMMLU and FLoRES benchmarks, often outperforming comparable models in multilingual understanding and translation tasks, as described in the FLoRES research and MMLU research.

Command R v01 also demonstrated proficiency in long-context evaluations, recovering inserted facts within prompts up to 128,000 tokens, as illustrated by "Needles in a Haystack" benchmark results, a methodology detailed here.

Applications and Use Cases

Command R v01 is designed for enterprise applications that require reliable, context-rich generation and access to proprietary or dynamic external knowledge bases. Key use cases include:

• Retrieval-augmented generation for summarization, analytics, and information packaging, incorporating transparent citations.
• Tool use for workflow automation, involving external APIs, databases, code interpreters, and search engines.
• Reasoning, question answering, and planning tasks in business and technical domains.
• Multilingual customer support, documentation, and translation tasks.

Its architecture enables integration with associated models such as Embed and Rerank for RAG workflows.

Limitations and Licensing

While Command R v01 is effective for a range of language and reasoning tasks, it is not specifically optimized for pure code completion and may require precise prompt templates to realize optimal performance in grounded generation and tool use scenarios, as outlined in the prompting guide.

The model is released under the CC-BY-NC (Creative Commons Attribution-NonCommercial) License. Use of Command R must adhere to Cohere Lab's Acceptable Use Policy, and a commercial license is required for enterprise or commercial deployments.

Further Resources

• Command R v01 landing page
• License terms for Command R v01
• Cohere privacy policy
• Documentation for prompt templates
• Grounded generation usage guide
• Tool use documentation
• Hugging Face tool use API documentation
• Needles in a Haystack evaluation methodology
• KILT Wikipedia index paper
• FLORES benchmark
• MMLU benchmark
• Contact Cohere Labs