Dataset updated 2026-11-12

Devstral 2 123B

Devstral 2 123B loads in 74.9 GB at Q4_K_M, comfortably from 128 GB of memory, Macs included, starting at the MacBook Pro M5 Max 128GB. Below is the memory math we ran for it, the smallest card that fits, and the fastest machine we track.

Parameters
123B
Format
Q4_K_M
Min memory
96 GB
Best for
Agentic coding, Software engineering
Memory math

How much memory does Devstral 2 123B need?

Devstral 2 123B is a 123B dense model built for agentic coding, software engineering. The weights alone take 74.9 GB at Q4_K_M; add context and the OS, and it belongs in the 128 GB memory class. Every number below comes from the ModelFit engine: speeds are estimates, labeled est., because we do not benchmark hardware ourselves.

Weights (Q4_K_M)
74.9 GB
+ KV cache (16k)
~6.0 GB
Total at 16k
~80.9 GB
Comfortable from
128 GB

KV = fp16 estimate (q8_0 cache roughly halves it). "Comfortable" = weights + KV within the engine's tiered budget (~70-85% of memory).

Hardware snapshot

Which machines run Devstral 2 123B?

Smallest GPU
NVIDIA RTX PRO 6000 Blackwellest. 21 tok/s · 96 GB VRAMtypical error 10%
Fastest
NVIDIA RTX PRO 6000 Blackwellest. 21 tok/stypical error 10%
Runs on a Mac?
MacBook Pro M5 Max 128GBest. 7 tok/stypical error 10%

Verdicts come from the same engine that powers our fit checker: memory capacity first, bandwidth for speed. How we compute these numbers · What typical error means · Hugging Face model card

More Mistral models

12 pages

Config reports

No speed test run for this model yet. Run the speed test: npx @modelfit/cli@latest bench

Share your config

Every report is reviewed before it appears. No email or account needed.

0/280

Frequently asked questions

How much memory does Devstral 2 123B need?

74.9 GB for the Q4_K_M weights, plus ~6.0 GB of KV-cache at 16k context, about 80.9 GB total. Comfortable from 128 GB of VRAM or unified memory.

Does Devstral 2 123B run on a Mac?

Yes, from the MacBook Pro M5 Max 128GB (est. 7 tok/s, typical error 10%). Unified memory means the RAM budget is the only limit.

What is the smallest GPU for Devstral 2 123B?

The NVIDIA RTX PRO 6000 Blackwell (96 GB VRAM) is the smallest tracked card that runs Devstral 2 123B comfortably, est. 21 tok/s, typical error 10%.

Cite this page

ModelFit: Devstral 2 123B, specs, memory math and hardware verdicts.
https://modelfit.io/models/devstral-2-123b/ (dataset updated 2026-11-12, CC BY 4.0).