Qwen

Qwen

Qwen/Qwen3.6-27B

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score	Actions
4bit	Unknown	14.1 GB	N/A	N/A	N/A	Run
nvfp4	MLX Community MLX Community	15.0 GB	17.7 tok/s	477.8 tok/s	Runs ok	Run
q4_k_m	LM Studio LM Studio	15.4 GB	15.0 tok/s	264.8 tok/s	Runs ok	Run
q4_k_m	Unsloth Unsloth	15.7 GB	N/A	N/A	N/A	Run
8bit	MLX Community MLX Community	27.5 GB	N/A	N/A	N/A	Run
8bit	MLX Community MLX Community	29.3 GB	N/A	N/A	N/A	Run
8bit	Unsloth Unsloth	32.3 GB	N/A	N/A	N/A	Run

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.