DEDUPED Hot AI repos, turned into use cases Get 5 a day

How to run a local Codex agent on a Strix Halo box with Halogen Flash Server

Serve Qwen3.8-Flash-Next locally and point Codex at it through the Responses API.

Who it is forA developer with a Strix Halo machine who wants a coding agent that runs on their own hardware instead of a hosted API.

The problemCoding agents usually send code and prompts to a hosted service, and the developer wants a local model that a standard agent client can drive.

The outcomeCodex sends its requests to the halogen server on the local machine and gets answers from Qwen3.8-Flash-Next.

What you need first

  • An AMD Strix Halo machine (the README measures on a Ryzen AI Max+ 395 with 128 GB)
  • Podman installed, with access to /dev/kfd and /dev/dri
  • Access to the BIOS to set the UMA frame buffer carve-out to its minimum
  • Disk space for the model weights, which the container downloads on first run
  • Network access to ghcr.io and the model download source

Steps

  1. Set the BIOS carve-out (UMA frame buffer) to its minimum, not Auto, as described in docs/host-setup.md.
  2. Run mkdir -p ~/halogen-models
  3. Run podman run --rm -p 8731:8731 --device /dev/kfd --device /dev/dri --group-add keep-groups --ipc=host --ulimit memlock=-1:-1 -e HALOGEN_DOWNLOAD=peonist-ai/halogen-qwen3.8-flash-next -v ~/halogen-models:/models ghcr.io/peonist-ai/halogen-flash-server:0.18.12 (inferred, check the README)
  4. Follow docs/codex.md to point Codex at the Responses API on the server.
  5. Check the endpoint conventions and status codes in docs/api.md before sending a test request.

Prompt for your agent

Using the repo peonist-ai/halogen-flash-server, configure Codex on <target machine> to use the local halogen server on port 8731, following docs/codex.md. Expected output: Codex completes a short test task against the local model and returns an answer. Verify that the server responds on port 8731 before running the test.

Caveat. The image only runs on AMD Strix Halo (gfx1151) hardware, and the README says it has no fallback path for other GPUs.

Share: X LinkedIn Hacker News Email Copy link

Disclaimer

Deduped lists open-source repositories that belong to other people. We do not own, maintain, audit, or vouch for any of them, and a repo appearing here is not an endorsement or a safety check. The use cases, steps, and prompts are written by AI and may be incomplete, outdated, or just wrong. Where a use case is marked "Seen in the wild", we link to public posts where someone described something similar, but we have not verified those posts and the use case itself is still our AI's own write-up. Use all of this at your own risk. Only run code, commands, or agents on systems and accounts you are authorized to use, and read the code and every command before you run it, especially anything that touches credentials, files, or the network. Nothing here is professional, security, legal, or financial advice. All trademarks and project names belong to their respective owners, and their use here does not imply affiliation. Content is provided as is, without warranties of any kind. Found a mistake, a safety problem, or something you want removed? Email [email protected] and we will look at it promptly. Full disclaimer page