Google
Google
Google/Gemma 4 26B A4B IT

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score
ud-iq3_xxs	Unsloth Unsloth	10.4 GB	N/A	N/A	N/A
4bit	Unsloth Unsloth	13.9 GB	76.2 tok/s	1,195.2 tok/s	Runs ok
4bit	MLX Community MLX Community	14.5 GB	N/A	N/A	N/A
q4_k_m	ggml ggml	15.6 GB	N/A	N/A	N/A
q4_k_m	ggml ggml	15.6 GB	N/A	N/A	N/A
ud-q4_k_m	Unsloth Unsloth	15.7 GB	N/A	N/A	N/A
ud-q4_k_m	Unsloth Unsloth	15.7 GB	N/A	N/A	N/A
ud-q4_k_m	Unsloth Unsloth	15.7 GB	67.9 tok/s	1,066.1 tok/s	Runs ok
ud-q4_k_xl	Unsloth Unsloth	16.0 GB	N/A	N/A	N/A

Results include trials with 4,096 input tokens and 1,024 output tokens only.

11 devices