Jackrong
Jackrong/Qwen3.5-27B (GLM-5.1 Distill) v1

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q2_kGGML's logo.
Jackrong
Jackrong		10.0 GB4.4 tok/s37.8 tok/sBarely runs

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

2 devices