Who it is forSomeone new to fine-tuning who wants a full train, eval and infer loop working before touching their own data.
The problemFine-tuning tutorials usually stop at training, leaving evaluation and inference as separate projects.
The outcomeA trained 135M model, an evaluation run and an interactive chat, all from YAML recipes.
What you need first
- Python with uv or pip, or Docker
- A GPU for real training runs (install the gpu extra)
- Optional: cloud accounts for remote jobs with oumi launch
Steps
- Install with
uv pip install oumi, oruv pip install 'oumi[gpu]'for GPU support - Train with
oumi train -c configs/recipes/smollm/sft/135m/quickstart_train.yaml - Evaluate with
oumi evaluate -c configs/recipes/smollm/evaluation/135m/quickstart_eval.yaml - Chat with it using
oumi infer -c configs/recipes/smollm/inference/135m_infer.yaml --interactive - Copy a recipe and point it at your own dataset when the quickstart works
Prompt for your agent
Install oumi-ai/oumi and run the SmolLM 135M quickstart: oumi train, oumi evaluate and oumi infer --interactive with the recipe configs. Report the eval results and one sample answer, then show me which fields to change to use <my dataset>.
Caveat. Oumi is in beta; the core is stable but some advanced features may change.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for oumi-ai/oumi and "Train, evaluate and chat with a model from recipes"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer