DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to compare Gufo speed with a llama.cpp baseline with Gufo

Run Gufo's benchmark guide against optional llama.cpp reference builds on your own Strix Halo box.

Short answer: Read docs/BENCHMARKS.md in the Gufo repo for the complete benchmark settings; then run nix develop to get profiling and evaluation tools; run nix shell .#llama-cpp-reference to load the optional llama.cpp baseline. All steps.

Who it is forA performance-minded developer who wants to check published Gufo throughput numbers on their own hardware.

The problemPublished tokens-per-second figures are hard to trust without running the same workload on the same machine.

The outcomeYour own measured prompt and generation rates next to a llama.cpp reference for the same model class.

What you need first

  • Linux x86-64 machine with AMD Strix Halo (gfx1151) and enough unified memory for the chosen model
  • Podman with rootless GPU device access to /dev/kfd and /dev/dri
  • Hugging Face CLI (hf) to download model weights
  • Several tens of GB of free disk space for model files

Steps

  1. Read docs/BENCHMARKS.md in the Gufo repo for the complete benchmark settings.
  2. Run nix develop to get profiling and evaluation tools.
  3. Run nix shell .#llama-cpp-reference to load the optional llama.cpp baseline. (inferred, check the README)
  4. Run the benchmark workload described in each model guide, such as the Qwen3.8 27B BENCHMARKS.md file.
  5. Record pp and tg numbers and compare them with the README table.

Prompt for your agent

In the gufo repo, follow docs/BENCHMARKS.md to run the Qwen3.8 27B benchmark on <model path> against the llama.cpp reference. Report prompt processing and token generation rates in tok/s and compare them with the README figures. Verify the same model file and settings were used for both runs.

Caveat. The README says peak numbers use specific short-prompt and repetitive-output workloads, so your results will differ unless you match the documented settings exactly.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for gufo-org/gufo and "Compare Gufo speed with a llama.cpp baseline"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer