magnitudedev/magnitude
Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, or just a CPU.
Starred 20 days ago
Created:06/12/2026
Updated:today at 6:46 AM
Last push:today at 10:25 AM
AI Analysis
Intermediate
Analyzed Oct 8, 2026
Quality Score
80/100
Activity
unknown
Category
tool
Tokens
4,806
80
/ 100
Excellent Quality
Based on AI analysis
Magnitude is an open-source inference engine that optimizes itself for specific hardware to run open models faster than general-purpose engines like llama.cpp. It functions as a desktop application that connects to various AI agents while ensuring privacy by keeping data local.
Date: Oct 8, 2026
Version: v1
Tokens: 4,806
Cost: $2.0000
Stats
Stars
Starred by users
Forks
Repository forks
Watchers
Watching this repo
Issues & Pull Requests
Quick Browse
Repository
VisibilityPublic
CreatedJun 12, 2026
Size~
Releases
0 releases totalView all