edge-ai.
4 writings found
Latest Archives
Speculative Decoding Brings VLMs to the Edge
Liquid AI's DSpark draft model achieves 3x faster vision-language inference on-device and 2.66x on H100s while adding just 8.9% parameters.
Speculative Decoding Hits Vision Models: What Developers Need to Know
Liquid AI's DSpark draft model accelerates vision-language inference 2-3x on edge devices and 20x on H100s. Here's what it means for your stack.
LFM2.5-2.6B: Small Models Win on Agents
The 2.6B parameter LFM2.5 outperforms models 4x its size on instruction following and tool use. What this means for on-device AI.
Moonshine Voice brings AI speech to 80-cent microcontrollers
An open-source AI toolkit that enables real-time voice agents on embedded systems with minimal RAM requirements. What this means for edge computing.
Prev
Page 1 of 1 Next