Who it is forA team running OpenLLM that wants the newest model entries.
The problemNew open models appear often and the local catalog goes stale.
The outcomeAn updated catalog and the details of the model you plan to deploy.
What you need first
- Python with pip
- A GPU sized for the model you pick
- A Hugging Face token for gated models
Steps
- Install with
pip install openllm - Run
openllm repo updateto refresh the model repository - Run
openllm model get llama3.2:1bto see a model's details - Serve the model you chose with
openllm serve llama3.2:1b
Prompt for your agent
Using bentoml/OpenLLM, run `openllm repo update`, then `openllm model get llama3.2:1b`, and summarise what hardware the model needs before serving it.
Caveat. Gated models such as Llama need a Hugging Face token before they download.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for bentoml/OpenLLM and "Keep the model catalog current and inspect a model"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer