Who it is forA developer who already uses a coding agent such as Codex CLI or Claude Code and wants it to use an open model hosted by a Pooled room instead of a paid API.
The problemCoding agents expect an OpenAI or Anthropic compatible endpoint, and the room's model is only reachable through the browser tabs in the room.
The outcomeA local endpoint on 127.0.0.1 forwards the agent's requests to the room, so the agent's prompts and answers run on the room's GPUs.
What you need first
- A browser with WebGPU support, such as Chrome, on a computer or phone with a GPU
- A room link from someone who started a room, or the Start a room button on the site
- Free disk space and a stable connection for the model download, about 17 GB for the 27B model and about 22.5 GB for the 35B MoE model
- Node 22 or newer for the command line bridge (npx @pooled/cli)
Steps
- Open the room in the browser and click the black Serve API button in the header to get the command for that room.
- Run
npx @pooled/cli serve "<room-invite-link-or-code>"on your own computer with Node 22 or newer. (inferred, check the README) - Set OPENAI_BASE_URL or ANTHROPIC_BASE_URL to the address the command prints, and set any API key value.
- Point the coding agent at that base URL and send a short test request with curl or the agent itself.
Prompt for your agent
In the Nehanth/pooled repository, run `npx @pooled/cli serve "<room-invite-link-or-code>"` and then send a chat request with curl to http://127.0.0.1:8080/v1/chat/completions using model 'pooled'. Expected output: a JSON chat completion from the room's model. Verify that the room's chat shows the request.
Caveat. Prompts go to the room's host and, unless the host limits who sees answers, to everyone in the room, so do not send private code or data through a room you do not control.
Get 5 new use cases every morning. Free, one short email, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Disclaimer
Deduped lists open-source repositories that belong to other people. We do not own, maintain, audit, or vouch for any of them, and a repo appearing here is not an endorsement or a safety check. The use cases, steps, and prompts are written by AI and may be incomplete, outdated, or just wrong. Where a use case is marked "Seen in the wild", we link to public posts where someone described something similar, but we have not verified those posts and the use case itself is still our AI's own write-up. Use all of this at your own risk. Only run code, commands, or agents on systems and accounts you are authorized to use, and read the code and every command before you run it, especially anything that touches credentials, files, or the network. Nothing here is professional, security, legal, or financial advice. All trademarks and project names belong to their respective owners, and their use here does not imply affiliation. Content is provided as is, without warranties of any kind. Found a mistake, a safety problem, or something you want removed? Email [email protected] and we will look at it promptly. Full disclaimer page