Skip to main content
Browse Models

Cognitive Computations

Dolphin 3.0 Llama3.2 3B

Released

2024-12-30

Family

Llama 3

Type

Fine-Tuned Model

Downloads

External Download

You are about to open a link to an external source. Verify the URL before continuing.

Download

4-bit GGUF (Q4_K_M)

GGUF · Dolphin3.0-Llama3.2-3B-Q4_K_M.gguf

5-bit GGUF (Q5_K_M)

GGUF · Dolphin3.0-Llama3.2-3B-Q5_K_M.gguf

6-bit GGUF (Q6_K)

GGUF · Dolphin3.0-Llama3.2-3B-Q6_K.gguf

8-bit GGUF (Q8_0)

GGUF · Dolphin3.0-Llama3.2-3B-Q8_0.gguf

16-bit GGUF (F16)

GGUF · Dolphin3.0-Llama3.2-3B-f16.gguf

Model Report

Overview

Dolphin 3.0 Llama 3.2 3B is an instruct-tuned generative language model developed by Cognitive Computations, with key contributions from Eric Hartford, Ben Gitter, and BlouseJury. As part of the Dolphin 3.0 Collection, this model emphasizes user autonomy and adaptability, offering capabilities in natural language understanding, programming, mathematics, and agentic functions. Notably, it features an uncensored design, allowing full user control over system prompts, alignment, and tone. Dolphin 3.0 Llama 3.2 3B builds on the Llama 3.2 3B base model, with 3.2 billion parameters and a focus on composable alignment for diverse user needs.

Cyberpunk-themed dolphin holding a keyboard, representing the Dolphin 3.0 Llama 3.2 3B model

Figure 1. Banner illustration symbolizing the Dolphin 3.0 Llama 3.2 3B model, emphasizing its futuristic and technology-forward identity.

Technical Architecture and Capabilities

Dolphin 3.0 Llama 3.2 3B is constructed atop the Llama 3.2-3B architecture, leveraging 3.21 billion parameters and utilizing the BF16 tensor type for efficient computation. The model is trained to function as a general-purpose language model, with proficiency in coding, mathematical reasoning, function calling, agentic operations, and broad conversational tasks. Its instruct-tuned setup ensures adaptability to a wide spectrum of user-defined instructions and operational domains.

A defining feature is its uncensored approach, giving users unrestricted control over system prompts and the model's behavioral alignment. Unlike many mainstream AI systems, which tightly govern prompt structure and alignment—sometimes leading to inconsistent behavior or unannounced updates—Dolphin 3.0 Llama 3.2 3B is deliberately designed to delegate ethical and operational responsibility to the user. Developers maintain that this approach grants maximum flexibility for model alignment, particularly useful for specialized, creative, or privacy-focused applications. Further discussion of the underlying rationale can be found in Eric Hartford’s examination of uncensored models.

Training Procedure and Data

In developing Dolphin 3.0 Llama 3.2 3B, the team employed a combination of open-source datasets and specialized training methodologies. The training corpus includes resources from OpenCoder-LLM, Microsoft, NousResearch, AI-MO, Allen Institute for AI, HuggingFaceTB, and M-a-p. Augmentation with Deepseek-V3 accelerated dataset expansion, while RLHFlow provided reward models to refine data quality through advanced filtering.

A core aspect of training is the removal of "refusals" and explicit biases from instruction datasets, a process central to the production of uncensored models. Instruction datasets often carry imprints of refusal behaviors, particularly learned from models highly aligned to specific ethical or policy frameworks (such as ChatGPT, Claude, or Gemini). The Dolphin 3.0 approach systematically filters out such content to ensure objective and comprehensive outputs in response to diverse prompts. This methodology is detailed in the Uncensored Models article.

Alignment Philosophy and Ethical Considerations

Dolphin 3.0 Llama 3.2 3B is structured as an uncensored model. Rather than enforcing a singular ethical alignment, it leaves prompt structure and behavioral scope entirely in the hands of the user. This contrasts with models such as ChatGPT, Claude, and Gemini, where alignment and refusal mechanisms may constrain valid use cases, introduce unpredictable changes, or affect user privacy and control. By granting composable alignment, Dolphin enables domain-specific, culturally tailored, or privacy-sensitive deployments.

Sample code output showing the model's adherence to a system prompt for Golang-only responses

Figure 2. The system prompt restricts the model's coding advice to Golang only. When a user requests a Python solution, the model responds with a Golang implementation, as instructed.

Model output responding to a user prompt about car modification

Figure 3. A demonstration of the model's willingness to answer prompts that typically elicit refusals from more heavily aligned systems.

This explicit design ensures that the system's owner retains responsibility for the outputs, supporting use cases across creative writing, roleplay, agentic workflows, or specialized domains that require full transparency or oversight over generated content. More details on the philosophical underpinnings are available in the Uncensored Models blog post.

Usage Patterns and Applications

Dolphin 3.0 Llama 3.2 3B is optimized for a broad array of tasks. Its instruct-tuned architecture enables sophisticated dialogue, general technical assistance, programming support, and mathematical problem-solving. The model is often used in scenarios that demand custom alignment, such as implementing specific character roles, enforcing domain-specific rules, or preserving user privacy in sensitive domains.

The model operates using the ChatML formatting protocol, allowing users to define system prompts with granular specificity. For example, a user may configure the model to act exclusively as a coding assistant for a particular language, or as a conversational agent with a stance tailored to specific worldviews or professional norms. This flexibility is exemplified in the output samples, which demonstrate the model’s capacity for role adaptation and detailed technical generation.

Limitations and Considerations

As an uncensored language model, Dolphin 3.0 Llama 3.2 3B does not incorporate behavioral refusal, alignment constraints, or safety filters by default. While this design increases flexibility, it also places the onus for downstream application and ethical stewardship entirely on the user. The model is capable of producing responses on a wide range of topics—including those that would typically trigger refusal in more strictly aligned architectures. Users must ensure that deployments comply with relevant legal and ethical guidelines.

Model evaluation metrics for Dolphin 3.0 Llama 3.2 3B are marked as "to be determined," and continuous updates to the Dolphin 3.0 Collection may introduce incremental improvements and variants.

Development Background and Model Family

Dolphin 3.0 Llama 3.2 3B belongs to a lineage of uncensored models established by Eric Hartford and collaborators. Predecessors in the series include WizardLM-30B-Uncensored, WizardLM-13B-Uncensored, WizardLM-7B-Uncensored, and Wizard-Vicuna-13B-Uncensored. Regular updates and refinements are summarized in the Dolphin 3.0 Collection, with notable milestones such as the update on February 7. The development of the original Dolphin models was supported in part by a grant from Andreessen Horowitz, dedicated to advancing open-source AI research.

Licensing and Open-Source Principles

While the model’s licensing details are not explicitly stated, the overall development philosophy is rooted in open-source ideals, prioritizing transparency, user control, and the right to define operational alignment. This ethos aligns with broader trends in open generative AI, reflecting growing recognition of the importance of customizable and user-governed language technologies.

Helpful External Resources

About Llama 3: The Llama 3 family of AI models, developed by Meta, represents a significant advancement in open-source large language models, offering parameter sizes up to 405 billion and supporting context windows of up to 128k tokens. Llama 3.1, 3.2, and 3.3 optimize this performance through distillation learning and improved multimodal capabilities.

More in the Llama 3 Family

Meta /

Llama 3 8B

Large language model with 8 billion parameters featuring transformer architecture, trained on 15 trillion tokens for text generation and coding tasks.
Meta /

Llama 3 70B

State-of-the-art 70B foundation model from Meta, trained on over 15 trillion tokens.
Meta /

Llama 3.1 8B

Llama 3.1 is a new state-of-the-art large language model from Meta.
Sao10K /

Llama 3.1 8B Stheno v3.4

An 8-billion parameter language model fine-tuned for multi-turn dialogue, creative writing, and roleplaying using curated conversational datasets and synthetic data.
Deepseek AI /

DeepSeek R1 Distill Llama 8B

Distilled 8B-parameter model optimized for mathematical reasoning and code generation through knowledge transfer from larger reinforcement learning-trained teacher models.
Deep Cogito /

Cogito V1 Preview 8B

A Llama 3.1-based model trained with Iterated Distillation and Amplification, featuring dual reasoning modes and tool calling capabilities.
Meta /

Llama 3.1 70B

The Llama 3.1 series of open models rivals top closed models in performance. It was trained on over 15 trillion tokens using over 16K H100 GPUs. These models display state-of-the-art capabilities in general knowledge, steerability, math, tool use, and translation.
Deep Cogito /

Cogito V1 Preview 70B

A 70B parameter instruction-tuned model based on Llama 3.1 architecture featuring dual reasoning modes and multilingual tool-calling capabilities.
Meta /

Llama 3.2 3B

The next iteration in the Llama series of open models. This lightweight model was designed to run on edge devices, even mobile.
Deep Cogito /

Cogito V1 Preview 3B

A 3B-parameter multilingual instruction-tuned model based on Llama 3.2 that supports tool-calling and features dual operational modes for standard and extended reasoning.
Meta /

Llama 3.3 70B

Llama 3.3 is a text-only 70B instruction-tuned model that provides enhanced performance relative to Llama 3.1 70B and to Llama 3.2 90B when used for text-only applications. For some applications, Llama 3.3 70B approaches the performance of Llama 3.1 405B.
Sao10K /

L3.3 70B Euryale v2.3

A 70-billion parameter language model fine-tuned from Llama 3.3 for creative writing and role-playing applications using custom datasets.
Sao10K /

70B L3.3 Cirrus x1

A 70.6-billion parameter language model finetuned from Llama 3.3 using extended training and checkpoint merging techniques for improved output stability.
TheDrummer /

Anubis 70B v1

A 70.6-billion parameter text generation model fine-tuned from Llama 3.3, designed for creative writing and role-playing applications.
TheDrummer /

Anubis 70B v1.1

A 70.6 billion parameter Llama 3.3-based model fine-tuned for character consistency and dynamic dialogue in creative text generation applications.
LatitudeGames /

Wayfarer Large 70B Llama 3.3

A 70.6-billion parameter language model fine-tuned for adventure role-play scenarios, emphasizing conflict, tension, and narrative stakes in second-person storytelling.
Deepseek AI /

DeepSeek R1 Distill Llama 70B

A 70B parameter dense language model distilled from DeepSeek-R1 using Llama 3.3 architecture, optimized for mathematical and coding reasoning tasks.