Jackrong
Jackrong/Qwopus3.5-27B-v3

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q4_k_mGGML's logo.
Jackrong
Jackrong		15.4 GB17.3 tok/s191.3 tok/sRuns poorly
q6_kGGML's logo.
Jackrong
Jackrong		20.6 GB14.0 tok/s189.4 tok/sBarely runs

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

3 devices