H Company
H Company/Holo3-35B-A3B

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q4_k_sGGML's logo.
mradermacher
mradermacher		18.5 GB65.7 tok/s929.2 tok/sRuns well

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

1 device