Remote script. The Linux and macOS install pipes a script into sh; the manual download is an alternative.
Who it is forA developer who wants to try open models privately.
The problemSetting up local inference is usually fiddly.
The outcomeA local model answering in your terminal.
What you need first
- macOS, Windows, Linux or Docker
- Enough RAM or VRAM for the model you pick
Steps
- Install with
curl -fsSL https://ollama.com/install.sh | sh(orirm https://ollama.com/install.ps1 | iexon Windows) - Run
ollama run gemma4 - Chat in the terminal
- Try other models from the library
Prompt for your agent
Install ollama/ollama, run `ollama run gemma4`, and ask <question>. Confirm the answer was generated locally.
Caveat. Model download size and speed depend on the model and your hardware.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for ollama/ollama and "Run an open model on your machine in one command"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer