DEDUPED Hot AI repos, turned into use cases Get 5 a day

What you can do with Berth

Berth is a single Go binary that lets local AI engines, games and GPU apps take turns on one NVIDIA GPU instead of loading at once and crashing with out-of-memory errors.

Trended earlier

Third-party repos we don't own or vouch for. AI-generated use cases can be wrong: review everything and run at your own risk.

4 use cases

  • Stop local AI engines from crashing each other on one GPU

    Queue llama.cpp, ComfyUI and other engines on one card so none load into an out-of-memory crash.

    View prompt
    In the Berth repo at <path to berth>, install the berth binary and run `berth service install --harbor`, then start <engine command> with `berth run --as <name> -- <engine command>`. Expected output: `berth status` lists the engine as the card holder. Verify that a second engine started through `berth run` shows as waiting with a reason, not as a crash.
  • Let games take the GPU while you play and resume AI after

    Berth drains AI engines when a supported game launches and returns the card when you quit.

    View prompt
    On the machine with the Berth repo, run `berth service install --harbor` and then `berth status`. Expected output: the card and any leases are listed. Verify by launching a supported game and confirming `berth status` shows the game as the holder while AI engines are drained.
  • Share the GPU between llama-swap and ComfyUI without ping-pong

    Put llama-swap's models and ComfyUI under one lease so a model swap waits for the image job.

    View prompt
    In the Berth repo at <path to berth>, run `berth wire llama-swap` against the llama-swap config at <config path>. Expected output: each model entry is wrapped in `berth run`. Verify with `berth status` that a ComfyUI job and a llama-swap model are queued in turn rather than loading together.
  • Give coding agents a queue for the GPU instead of killing processes

    Install the Berth skill so Claude Code or Codex asks for the card rather than killing GPU jobs.

    View prompt
    On the machine with the Berth repo, run `berth skill install` and then `berth status`. Expected output: the skill is installed for the agent and the card's holder is listed. Verify that a GPU task started by the agent runs through `berth run` and does not kill other GPU processes.

How to use Berth

  1. Check you have what it needs: An NVIDIA GPU on Linux, or Windows 10/11 (experimental); Go installed for `go install`, or a release binary from the Install section; At least one local engine, such as llama-server, ComfyUI or llama-swap.
  2. Open T-Crypt/berth on GitHub and read the README and license.
  3. go install github.com/T-Crypt/berth/cmd/berth@latest, or download a release binary (see Install).
  4. berth service install --harbor to run the daemon and the harbor as user services.
  5. berth run --as llama --priority foreground -- llama-server -m model.gguf --port 8080 to start an engine under a lease.
  6. Start a second engine the same way with berth run and a lower priority such as --priority batch. (inferred, check the README)

These steps come from our top use case, Stop local AI engines from crashing each other on one GPU, which also has a copy-paste agent prompt.

Berth alternatives · Best AI repos for Software and DevOps

About this repo

  • Who it is forPeople running several local AI models, image tools or games on one NVIDIA card on Linux or Windows, and the coding agents that work on that machine.
  • Why it is hot
  • LanguageGo
  • Sourcegithub.com/T-Crypt/berth · Back to Hot repos

Requirements

  • An NVIDIA GPU on Linux, or Windows 10/11 (experimental)
  • Go installed for `go install`, or a release binary from the Install section
  • At least one local engine, such as llama-server, ComfyUI or llama-swap
Maintain Berth? Add the Featured on Deduped badge

Paste this into your README:

[![Featured on Deduped](https://dedupedai.com/badge/t-crypt-berth.svg)](https://dedupedai.com/use-cases/t-crypt-berth/?ref=badge)

More badge styles and HTML

Questions about Berth

What is Berth?

Berth is a single Go binary that lets local AI engines, games and GPU apps take turns on one NVIDIA GPU instead of loading at once and crashing with out-of-memory errors. It is an open-source project on GitHub: https://github.com/T-Crypt/berth.

Who is Berth for?

People running several local AI models, image tools or games on one NVIDIA card on Linux or Windows, and the coding agents that work on that machine.

What can I do with Berth?

4 use cases so far, for example: Stop local AI engines from crashing each other on one GPU; Let games take the GPU while you play and resume AI after; Share the GPU between llama-swap and ComfyUI without ping-pong. Each has steps and a copy-paste agent prompt.

What do I need to run Berth?

An NVIDIA GPU on Linux, or Windows 10/11 (experimental); Go installed for `go install`, or a release binary from the Install section; At least one local engine, such as llama-server, ComfyUI or llama-swap.

What are alternatives to Berth?

Other hot AI repos in Software and DevOps: Harness2, iFixAi, Orca, Diagram Design, AI Memory.

Is Berth safe to run?

Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.