cactus-compute/needle

14MB foundation model for tiny devices; phones, wearables, smart home, and robots.

Python8.6K stars557 forks+551 today

Topics

#cactus#gemini#gemma#llm#on-device-ai

What it does

Needle 2 is a compact, efficient AI model designed for small devices like smartphones and wearables. It offers tool calling capabilities with minimal memory usage and provides structured outputs.

Star history

Not enough history yet — 1 day(s) recorded. The daily snapshot builds this up.

Tracking

Last trending: 2026-08-15

Creator kit

Hook

Discover Needle 2, the AI model that fits in your pocket! 📱✨ #CactusCompute

Content angles

Create a comparison blog post between Needle 2 and other small device models.
Develop a tutorial on how to fine-tune Needle 2 for specific use cases.
Publish an article explaining the technical details of Simple Attention Networks used in Needle 2.

Who should care

AI researchers, developers working with small devices, and anyone interested in efficient machine learning models.