Tag

edge-inference.

3 writings found

Latest Archives

LFM2.5-24B: Small Models That Actually Reason and Act

Liquid Foundation Models 2.5 brings agent-grade reasoning to 24B parameters with 3x faster inference and stronger tool use than much larger competitors.

Speculative Decoding Brings VLMs to the Edge

Liquid AI's DSpark drafter achieves 3.13x speedups on-device by applying speculative decoding to vision-language models, with day-one support for llama.cpp and MLX.

Speculative Decoding Meets Vision: LFM2.5-VL Gets the Speed Treatment

Liquid AI's DSpark draft model accelerates vision-language inference by 2.3x on-device and 20x on GPU, but Amdahl's law reveals the real bottleneck.
View all rollups →