DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to point Codex at a local model on your Mac with Whallm

Run Whallm's server on your Mac and send Codex requests to it instead of a hosted API.

Short answer: Download Whallm-macOS-arm64.zip from GitHub Releases, unzip it and open Whallm.app; then open Model, pick a model and select Download Model. Wait for the download to finish, resuming it if it stops; open Server and select Start Server. The default address is http://127.0.0.1:11434. All steps.

Who it is forA developer on an Apple Silicon Mac who wants Codex to use a model that runs on their own machine, for example to keep code prompts local.

The problemCodex is set up to call a hosted model, and the developer wants inference to stay on the Mac while still using the Codex client.

The outcomeCodex sends its requests to Whallm at http://127.0.0.1:11434/v1 and receives answers from a model loaded on the Mac.

What you need first

  • Apple Silicon Mac running macOS 15 or later
  • 64 GiB memory recommended, with more disk space than the chosen model's files (Qwen models about 118 to 119 GiB, DeepSeek V4.1 above 458 GiB)
  • Fast internal, Thunderbolt or USB4 SSD
  • Network access to download the Whallm release and model weights

Steps

  1. Download Whallm-macOS-arm64.zip from GitHub Releases, unzip it and open Whallm.app.
  2. Open Model, pick a model and select Download Model. Wait for the download to finish, resuming it if it stops.
  3. Open Server and select Start Server. The default address is http://127.0.0.1:11434.
  4. Add the provider block from the README to ~/.codex/config.toml, setting model to an API model ID such as deepseek-v4-flash-0731 or an Alias you set in Model to Advanced Settings.
  5. Restart Codex and send a short test prompt.

Prompt for your agent

Work in the Whallm repo at yanun0323/Whallm. Confirm the Whallm server is running at http://127.0.0.1:11434 and that GET /v1/models lists the model ID <model-id>. Then check that ~/.codex/config.toml sets model_provider to deepseek-v4-ssd with base_url http://127.0.0.1:11434/v1 and wire_api set to responses, and report whether the file matches the README example.

Caveat. The first model download is very large, and the server keeps one model loaded and handles one request at a time, so Codex may wait on long prompts.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for yanun0323/Whallm and "Point Codex at a local model on your Mac"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer