Liquid AI
Liquid AI/LFM2-1.2B

OverviewRuns

Quantizations

QuantQuantized bySizeDecodePrefillScoreActions
q4_0GGML's logo.
Liquid AI
Liquid AI		663.5 MB178.9 tok/s2,146.1 tok/sRuns great
q4_k_mGGML's logo.
Liquid AI
Liquid AI		697.0 MB149.5 tok/s1,941.9 tok/sRuns great

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.

Decode / Prefill Speeds

2 devices