Who it is forA developer who uses Codex for coding work and wants to keep code and prompts on local hardware.
The problemCoding agents normally call a hosted model API, which sends source code outside the machine.
The outcomeCodex or an OpenAI SDK script sends requests to the local Qwen model, with text, function tools, and streaming working through Gufo.
What you need first
- Linux x86-64 machine with AMD Strix Halo (gfx1151) and enough unified memory for the chosen model
- Podman with rootless GPU device access to /dev/kfd and /dev/dri
- Hugging Face CLI (hf) to download model weights
- Several tens of GB of free disk space for model files
Steps
- Start the Gufo server as described in the Quickstart so it listens on port 8080.
- Set the API base URL for Codex or your OpenAI SDK client to
http://localhost:8080/v1. - Use the model name
Qwen3.8-27B-UD-Q8_K_XLin the client configuration. - Send a short test prompt from the client and confirm a streamed reply arrives.
- Read the README harness notes on Codex developer messages and prefill behavior before long sessions.
Prompt for your agent
In the gufo repo, configure Codex to use the OpenAI-compatible base URL http://localhost:8080/v1 with model <model name>. Send one prompt asking for a one-line Python hello world and report the reply. Verify that the response is streamed and that Gufo logs show a completed request.
Caveat. The README says Qwen with Claude Code is not supported, so this path only covers Codex and OpenAI-style clients.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for gufo-org/gufo and "Point Codex at a local Qwen model through Gufo"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer