| Command A+CohereModelsModel pageBF16FP8W4A4vLLM | 25B active / 218B total | 406.1 GiBWeights only. Total with KV 407.4 GiB. Estimate. Hypothetical uniform weights. | 203.0 GiBWeights only. Total with KV 204.4 GiB. Estimate. Hypothetical uniform weights. | 101.5 GiBWeights only. Total with KV 102.9 GiB. Estimate. Hypothetical uniform weights. | 1.38 GiBEstimate. 16-bit KV. Full layers at 32,768 tokens, sliding layers at their window. | BF16, FP8, and W4A4 | 1× B200 at W4A4 or 2× H100 at W4A4 | Listed |
|---|
| DeepSeek V4 ProDeepSeekModel cardvLLM | 49B active / 1.6T total | 2980.2 GiBWeights only. Estimate. Hypothetical uniform weights. | 1490.1 GiBWeights only. Estimate. Hypothetical uniform weights. | 745.1 GiBWeights only. Estimate. Hypothetical uniform weights. | Not published | FP4 + FP8 mixed. Experts are FP4. Most other parameters are FP8. | Not published | Listed |
|---|
| DeepSeek V4.1 FlashDeepSeekModel cardConfig | 8B/16B active / 552B backbone + 196B Engram | 1393.3 GiBWeights only. Total with KV 1393.3 GiB. Estimate. Hypothetical uniform weights for 552B backbone + 196B Engram. 196B of the 748B are Engram parameters, sparsely accessed via token-based lookup, and are still counted as stored weights. | 696.6 GiBWeights only. Total with KV 696.7 GiB. Estimate. Hypothetical uniform weights for 552B backbone + 196B Engram. 196B of the 748B are Engram parameters, sparsely accessed via token-based lookup, and are still counted as stored weights. | 348.3 GiBWeights only. Total with KV 348.3 GiB. Estimate. Hypothetical uniform weights for 552B backbone + 196B Engram. 196B of the 748B are Engram parameters, sparsely accessed via token-based lookup, and are still counted as stored weights. | 0.03 GiBFP4 main KV cache from the model card: 890 bytes per token at 32,768 tokens. Exception to the 16-bit KV assumption. | fp8 weights. Expert dtype is fp4. | Not published | Not listed |
|---|
| Gemma 4 26BGoogleModel cardConfigvLLM | 3.8B active / 25.2B total. Hugging Face model card (26B-A4B). | 46.9 GiBWeights only. Total with KV 47.8 GiB. Estimate. Hypothetical uniform weights. | 23.5 GiBWeights only. Total with KV 24.3 GiB. Estimate. Hypothetical uniform weights. | 11.7 GiBWeights only. Total with KV 12.6 GiB. Estimate. Hypothetical uniform weights. | 0.82 GiBEstimate. 16-bit KV. Full layers at 32,768 tokens, sliding layers at their window. Full layers use the config's global head size and global KV heads. attention_k_eq_v is true, so those layers have no separate V projection, but K and V are both stored after separate norms and num_kv_shared_layers is 0, so full-layer KV is not halved. | bfloat16 | Not published | Architecture supported |
|---|
| Gemma 4 31BGoogleModel cardConfigvLLM | 30.7B. Hugging Face model card. | 57.2 GiBWeights only. Total with KV 60.5 GiB. Estimate. Hypothetical uniform weights. | 28.6 GiBWeights only. Total with KV 31.9 GiB. Estimate. Hypothetical uniform weights. | 14.3 GiBWeights only. Total with KV 17.6 GiB. Estimate. Hypothetical uniform weights. | 3.28 GiBEstimate. 16-bit KV. Full layers at 32,768 tokens, sliding layers at their window. Full layers use the config's global head size and global KV heads. attention_k_eq_v is true, so those layers have no separate V projection, but K and V are both stored after separate norms and num_kv_shared_layers is 0, so full-layer KV is not halved. | bfloat16 | Not published | Architecture supported |
|---|
| gpt-oss-120bOpenAIModel pageConfigvLLM | 5.1B active / 117B total | 217.9 GiBWeights only. Total with KV 219.1 GiB. Estimate. Hypothetical uniform weights. | 109.0 GiBWeights only. Total with KV 110.1 GiB. Estimate. Hypothetical uniform weights. | 54.5 GiBWeights only. Total with KV 55.6 GiB. Estimate. Hypothetical uniform weights. | 1.13 GiBEstimate. 16-bit KV. Full layers at 32,768 tokens, sliding layers at their window. | mxfp4. Attention, the router, embeddings, and the output layer are not quantized. | Not published | Listed |
|---|
| gpt-oss-20bOpenAIModel pageConfigvLLM | 3.6B active / 21B total | 39.1 GiBWeights only. Total with KV 39.9 GiB. Estimate. Hypothetical uniform weights. | 19.6 GiBWeights only. Total with KV 20.3 GiB. Estimate. Hypothetical uniform weights. | 9.78 GiBWeights only. Total with KV 10.5 GiB. Estimate. Hypothetical uniform weights. | 0.75 GiBEstimate. 16-bit KV. Full layers at 32,768 tokens, sliding layers at their window. | mxfp4. Attention, the router, embeddings, and the output layer are not quantized. | Not published | Listed |
|---|
| Llama 4 MaverickMetaModel cardvLLM | 17B active / 400B total | 745.1 GiBWeights only. Estimate. Hypothetical uniform weights. | 372.5 GiBWeights only. Estimate. Hypothetical uniform weights. | 186.3 GiBWeights only. Estimate. Hypothetical uniform weights. | Not published | BF16 and FP8 | FP8: one H100 DGX host | Listed |
|---|
| Llama 4 ScoutMetaModel cardvLLM | 17B active / 109B total | 203.0 GiBWeights only. Estimate. Hypothetical uniform weights. | 101.5 GiBWeights only. Estimate. Hypothetical uniform weights. | 50.8 GiBWeights only. Estimate. Hypothetical uniform weights. | Not published | BF16 | One H100 at INT4 | Listed |
|---|
| Mistral Large 4MistralModel card | 52B active / 1.05T total | 1955.8 GiBWeights only. Estimate. Hypothetical uniform weights. The weights are not posted yet. | 977.9 GiBWeights only. Estimate. Hypothetical uniform weights. The weights are not posted yet. | 488.9 GiBWeights only. Estimate. Hypothetical uniform weights. The weights are not posted yet. | Not published | Weights are not posted yet. | Not published | Not listed |
|---|
| Mistral Medium 3.5MistralModel cardConfigvLLM | 128B dense | 238.4 GiBWeights only. Total with KV 249.4 GiB. Estimate. Hypothetical uniform weights. | 119.2 GiBWeights only. Total with KV 130.2 GiB. Estimate. Hypothetical uniform weights. | 59.6 GiBWeights only. Total with KV 70.6 GiB. Estimate. Hypothetical uniform weights. | 11.0 GiBEstimate. 16-bit KV. | FP8 (5.9B modules left in BF16). | Not published | Architecture supported |
|---|
| Mistral Small 4MistralModel pageConfigvLLM | 6.5B active / 119B total | 221.7 GiBWeights only. Total with KV 222.4 GiB. Estimate. Hypothetical uniform weights. | 110.8 GiBWeights only. Total with KV 111.5 GiB. Estimate. Hypothetical uniform weights. | 55.4 GiBWeights only. Total with KV 56.1 GiB. Estimate. Hypothetical uniform weights. | 0.70 GiBEstimate. 16-bit KV. | fp8. The vision tower, projector, and output layer are not quantized. | Not published | Architecture supported |
|---|
| Phi-4-reasoning-vision-15BMicrosoftModel cardConfigvLLM | 15B | 27.9 GiBWeights only. Total with KV 31.1 GiB. Estimate. Hypothetical uniform weights. | 14.0 GiBWeights only. Total with KV 17.1 GiB. Estimate. Hypothetical uniform weights. | 6.98 GiBWeights only. Total with KV 10.1 GiB. Estimate. Hypothetical uniform weights. | 3.13 GiBEstimate. 16-bit KV. | bfloat16 | Not published | Listed |
|---|