September 27, 2023BlogTechnical Report
v0.1
Mistral 7B
Our very first open model, SOTA competing against models up to 2 to 3x larger.
Modalities
Context
8k
Retirement date3/30/2025
ReplacementMinistral 3 8B
Weights
| Weights | License | Parameters (B) | Active (B) | ≈ GPU RAM at bf16 - fp4 (GB) | Context Size (tokens) |
|---|---|---|---|---|---|
| 7 | 7 | 16 - 4 | 8k | ||
| 7 | 7 | 16 - 4 | 8k |
Other Models
