DEDUPED Hot AI repos, turned into use cases Get the Monday 5

How to chat with a large model privately on your Mac with Whallm

Use Whallm's built-in Chat window to ask a large local model questions without a hosted service.

Short answer: Download Whallm-macOS-arm64.zip from GitHub Releases, unzip it and open Whallm.app; then open Model, pick Qwen3.8 or another model that fits your memory and disk space, and select Download Model; open Server and select Start Server. All steps.

Who it is forA non-developer Mac owner who wants to chat with a large language model and keep their prompts on their own computer.

The problemHosted chat tools send prompts to a company's servers, and the user wants a local option that does not require writing code.

The outcomeThe user gets answers in the Chat window from a model that runs on the Mac, including image input for Qwen models.

What you need first

  • Apple Silicon Mac running macOS 15 or later
  • 64 GiB memory recommended, with more disk space than the chosen model's files (Qwen models about 118 to 119 GiB, DeepSeek V4.1 above 458 GiB)
  • Fast internal, Thunderbolt or USB4 SSD
  • Network access to download the Whallm release and model weights

Steps

  1. Download Whallm-macOS-arm64.zip from GitHub Releases, unzip it and open Whallm.app.
  2. Open Model, pick Qwen3.8 or another model that fits your memory and disk space, and select Download Model.
  3. Open Server and select Start Server.
  4. Open Chat, pick your model and type your first question. The model loads the first time you use it.

Prompt for your agent

In the Whallm repo at yanun0323/Whallm, check the README's Supported models table and the Requirements section against this Mac's chip, macOS version, memory and free disk space for <model-name>. Report whether the model fits and which steps from the Quick start remain.

Caveat. Whallm recommends 64 GiB of memory, and the README says actual use depends on the model and settings, so a smaller Mac may be slow or unable to run the larger models.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for yanun0323/Whallm and "Chat with a large model privately on your Mac"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer