What do you want to do?
4 use cases
-
Stop local AI engines from crashing each other on one GPU
Queue llama.cpp, ComfyUI and other engines on one card so none load into an out-of-memory crash.
- Berth
- Software and DevOps
- Intermediate
View prompt
In the Berth repo at <path to berth>, install the berth binary and run `berth service install --harbor`, then start <engine command> with `berth run --as <name> -- <engine command>`. Expected output: `berth status` lists the engine as the card holder. Verify that a second engine started through `berth run` shows as waiting with a reason, not as a crash.
-
Let games take the GPU while you play and resume AI after
Berth drains AI engines when a supported game launches and returns the card when you quit.
- Berth
- Software and DevOps
- Intermediate
View prompt
On the machine with the Berth repo, run `berth service install --harbor` and then `berth status`. Expected output: the card and any leases are listed. Verify by launching a supported game and confirming `berth status` shows the game as the holder while AI engines are drained.
-
Give coding agents a queue for the GPU instead of killing processes
Install the Berth skill so Claude Code or Codex asks for the card rather than killing GPU jobs.
- Berth
- Claude Code
- Codex
- Software and DevOps
- Intermediate
View prompt
On the machine with the Berth repo, run `berth skill install` and then `berth status`. Expected output: the skill is installed for the agent and the card's holder is listed. Verify that a GPU task started by the agent runs through `berth run` and does not kill other GPU processes.
How to use Berth
- Check you have what it needs: An NVIDIA GPU on Linux, or Windows 10/11 (experimental); Go installed for `go install`, or a release binary from the Install section; At least one local engine, such as llama-server, ComfyUI or llama-swap.
- Open T-Crypt/berth on GitHub and read the README and license.
go install github.com/T-Crypt/berth/cmd/berth@latest, or download a release binary (see Install).berth service install --harborto run the daemon and the harbor as user services.berth run --as llama --priority foreground -- llama-server -m model.gguf --port 8080to start an engine under a lease.- Start a second engine the same way with
berth runand a lower priority such as--priority batch. (inferred, check the README)
These steps come from our top use case, Stop local AI engines from crashing each other on one GPU, which also has a copy-paste agent prompt.
Get 5 new use cases every morning. Free, one short email, unsubscribe anytime.
Get them freeAbout this repo
- Who it is forPeople running several local AI models, image tools or games on one NVIDIA card on Linux or Windows, and the coding agents that work on that machine.
- Why it is hot
- LanguageGo
- Sourcegithub.com/T-Crypt/berth · Back to Hot repos
Requirements
- An NVIDIA GPU on Linux, or Windows 10/11 (experimental)
- Go installed for `go install`, or a release binary from the Install section
- At least one local engine, such as llama-server, ComfyUI or llama-swap
Maintain Berth? Add the Featured on Deduped badge
Paste this into your README:
[](https://dedupedai.com/use-cases/t-crypt-berth/?ref=badge)
Questions about Berth
What is Berth?
Berth is a single Go binary that lets local AI engines, games and GPU apps take turns on one NVIDIA GPU instead of loading at once and crashing with out-of-memory errors. It is an open-source project on GitHub: https://github.com/T-Crypt/berth.
Who is Berth for?
People running several local AI models, image tools or games on one NVIDIA card on Linux or Windows, and the coding agents that work on that machine.
What can I do with Berth?
4 use cases so far, for example: Stop local AI engines from crashing each other on one GPU; Let games take the GPU while you play and resume AI after; Share the GPU between llama-swap and ComfyUI without ping-pong. Each has steps and a copy-paste agent prompt.
What do I need to run Berth?
An NVIDIA GPU on Linux, or Windows 10/11 (experimental); Go installed for `go install`, or a release binary from the Install section; At least one local engine, such as llama-server, ComfyUI or llama-swap.
What are alternatives to Berth?
Other hot AI repos in Software and DevOps: Harness2, iFixAi, Orca, Diagram Design, AI Memory.
Is Berth safe to run?
Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.