July 16, 2024Blog
v0.1
Codestral Mamba 7B
A coding dedicated model using a mamba 2 architecture for research purposes under an open license.
Modalities
Context
256k
Retirement date6/6/2025
ReplacementCodestral
Weights
| Weights | License | Parameters (B) | Active (B) | ≈ GPU RAM at bf16 - fp4 (GB) | Context Size (tokens) |
|---|---|---|---|---|---|
| 7 | 7 | 20 - 5 | 256k |
Other Models
