Who it is forA team lead or buyer choosing between two candidate machines, such as a 5090 GPU and a Mac Studio, for the same local model.
The problemComparing two machines from separate spec pages makes it hard to see which one streams faster for the same workload.
The outcomeA side-by-side streamed race between two setups, plus a shareable link to send to colleagues.
What you need first
- A web browser to use llmspeed.dev
- For contributing a benchmark: a machine with llama.cpp and a .gguf model file
- For local development: npm
Steps
- Open https://llmspeed.dev in a browser.
- Switch on race mode and choose the first hardware setup.
- Choose the second hardware setup and the same model for both.
- Watch both answers stream and compare the time to first token.
- Copy the shareable link for the race and send it to the person who needs to decide.
Prompt for your agent
Using the llmspeed repo (github.com/nicorobinreal/llmspeed) at https://llmspeed.dev, set up a race between <hardware A> and <hardware B> on <model name>. Expected output: a side-by-side streamed race and a shareable link. Verify that both sides use the same model before you share the link.
Caveat. The race shows estimates, and Llmspeed currently simulates single devices only, so multi-GPU setups cannot be compared.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for nicorobinreal/llmspeed and "Compare two machines side by side in race mode"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer