Google

Google

Google/Gemma 4 E4B IT

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score	Actions
q4_k_m	Unsloth Unsloth	4.6 GB	N/A	N/A	N/A	Run
q4_k_m	Unsloth Unsloth	4.6 GB	34.5 tok/s	440.3 tok/s	Runs ok	Run
4bit	MLX Community MLX Community	4.9 GB	44.7 tok/s	480.7 tok/s	Runs ok	Run
q6_k	Unsloth Unsloth	6.6 GB	N/A	N/A	N/A	Run
q8_0	Unsloth Unsloth	7.6 GB	N/A	N/A	N/A	Run
8bit	MLX Community MLX Community	8.3 GB	28.7 tok/s	480.8 tok/s	Runs poorly	Run

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.