Liquid AI

Liquid AI

Liquid AI/LFM2.5-350M

Quantizations

Quant	Quantized by	Size	Decode	Prefill	Score	Actions
q4_0	Liquid AI Liquid AI	209.2 MB	389.1 tok/s	7,868.0 tok/s	Runs great	Run
q4_k_m	Liquid AI Liquid AI	254.7 MB	N/A	N/A	N/A	Run
q8_0	Liquid AI Liquid AI	429.6 MB	274.3 tok/s	10,369.4 tok/s	Runs great	Run
f16	Liquid AI Liquid AI	678.5 MB	239.0 tok/s	8,178.6 tok/s	Runs great	Run

Device Comparison

Results include trials with 4,096 input tokens and 1,024 output tokens only.