DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to call the local model from a script through its API with Whallm

Send requests from your own code to Whallm's OpenAI-compatible endpoint running on your Mac.

Short answer: Start Whallm and select Start Server in the Server page. The default address is http://127.0.0.1:11434; then Request GET /v1/models from http://127.0.0.1:11434 to list the API model IDs; use the model ID from that list in your script, not the display name, and set base_url to http://127.0.0.1:11434/v1. All steps.

Who it is forA developer or automation builder who wants a script or agent to call a local model instead of a hosted API.

The problemA script needs a model endpoint that is free of per-request hosting and keeps data on the local machine.

The outcomeA script that lists available model IDs and sends a chat request to the local server, returning the model's answer.

What you need first

  • Apple Silicon Mac running macOS 15 or later
  • 64 GiB memory recommended, with more disk space than the chosen model's files (Qwen models about 118 to 119 GiB, DeepSeek V4.1 above 458 GiB)
  • Fast internal, Thunderbolt or USB4 SSD
  • Network access to download the Whallm release and model weights

Steps

  1. Start Whallm and select Start Server in the Server page. The default address is http://127.0.0.1:11434.
  2. Request GET /v1/models from http://127.0.0.1:11434 to list the API model IDs.
  3. Use the model ID from that list in your script, not the display name, and set base_url to http://127.0.0.1:11434/v1.
  4. If you set an API key in Whallm, send the same key from your script; the README example uses no key.

Prompt for your agent

In the yanun0323/Whallm repo, read the README sections on the API and Connect Codex, then write a short script that calls GET /v1/models at http://127.0.0.1:11434 and prints each API model ID. Run it against a running Whallm server, and verify that the printed IDs match the model ID table in docs/usage.md.

Caveat. The server handles one request at a time with one loaded model, so concurrent requests from a script will queue, and the README says tool calls are executed by the client, not by Whallm.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for yanun0323/Whallm and "Call the local model from a script through its API"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer