magnitudedev/magnitude

Open source inference server that runs the best local models for your hardware, plugged into the agent you already use. Works with Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline.

TypeScript6.6K stars453 forks+130 today

View on GitHubShare on X

What it does

Magnitude is an open-source inference server that optimizes local AI model performance for your hardware, supporting multiple agents and ensuring privacy by running models offline.

Star history

2026-09-04 → 2026-10-14+4.9K stars

Tracking

Last trending: 2026-09-03

Creator kit

Hook

🚀 Dive into the future of private & efficient AI with Magnitude - no more cloud dependency! #AI #LocalModels

Content angles

Create a tutorial series on setting up and optimizing local models using Magnitude.
Compare Magnitude's performance against cloud-based solutions in various scenarios.
Develop a comprehensive guide to understanding the technical aspects of running AI locally.

Who should care

AI enthusiasts, developers looking for privacy-focused solutions, researchers interested in offline machine learning