needle cactus-compute

14MB foundation model for tiny devices; phones, wearables, smart home, and robots.

主要言語
Python
Stars
5,968
Forks
399

README

![Needle](assets/banner.png) # Needle 2 Needle 2 is an open 45M-parameter model for tool calling, device use and structured extraction. The whole model is a single 14MB binary that runs a full session in about 28MB of RAM. It is built on our Simple Attention Network findings, compressed to CQ2-bit …

查看完整页面