Who it is forA home lab owner who wants an always-available local model endpoint for the household or team.
The problemDesktop apps stop when you log out, and keeping a model server running needs service setup.
The outcomeMagnitude running as a service that starts at boot, survives logout and updates itself.
What you need first
- macOS, Windows or Linux (x64 or ARM64)
- Apple Silicon, NVIDIA, AMD or Intel GPU, or a CPU only
- Enough memory for the model you choose
Steps
- Install Magnitude on the server
- Run
magnitude server setup - Download the models you want to serve
- Point clients on your network at the server
Prompt for your agent
Set up magnitudedev/magnitude as a boot service with magnitude server setup on <server>, download <models>, and confirm it keeps running after I log out.
Caveat. This card is written from the magnitudedev/magnitude README, not from a test run by Deduped. Before you start, make sure you have macOS, Windows or Linux. Check the repo for newer instructions before you rely on these steps.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for magnitudedev/magnitude and "Serve models from a home server that starts at boot"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer