What do you want to do?
3 use cases
-
Run a local model on your GPU and open a coding agent on it
Install the plugin, set up once, start a model tested for your card, and open a coding agent on it.
- Omarchy Local AI
- Claude Code
- Codex
- Software and DevOps
- Intermediate
View prompt
Using the repo 0xSero/omarchy-local-ai on Omarchy, run setup, start the model <model-name> from the models tab, and open <agent> in the folder <folder-path>. Expected output: the agent opens in a terminal and answers from the local gateway. Verify that the model shows as running on the home tab before you open the agent.
-
Call a running local model from your own scripts
Send OpenAI-compatible requests to a running model's gateway from your own code.
- Omarchy Local AI
- Software and DevOps
- Advanced
View prompt
Using the repo 0xSero/omarchy-local-ai, start a validated model and send one OpenAI-compatible chat request from <script-path> to its gateway using the key in gateway.key. Expected output: a text reply from the local model. Verify that a request without the key is refused.
How to use Omarchy Local AI
- Check you have what it needs: Omarchy with the Quattro shell and its bar; Docker, jq, curl, flock, sha256sum and sha1sum installed; A supported GPU, or an x86-64 CPU with AVX2 and enough RAM for the recipe.
- Open 0xSero/omarchy-local-ai on GitHub and read the README and license.
- Run
omarchy plugin add https://github.com/0xSero/omarchy-local-ai --enable. - Open Local AI in the bar, click **Set up Local AI**, and enter your password when Omarchy asks.
- On the models tab, pick a model the panel lists for your card (or type its name) and click **Start**.
- Click the folder row to choose a project folder, pick an agent such as Claude Code or Codex, and click **Open**.
These steps come from our top use case, Run a local model on your GPU and open a coding agent on it, which also has a copy-paste agent prompt.
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeOmarchy Local AI alternatives · Best AI repos for Software and DevOps
About this repo
- Who it is forOmarchy Linux users with a supported NVIDIA, Intel Arc Pro, AMD or AVX2 CPU machine who want a coding model that runs locally.
- Why it is hot
- LanguageShell
- Sourcegithub.com/0xSero/omarchy-local-ai · Back to Hot repos
Requirements
- Omarchy with the Quattro shell and its bar
- Docker, jq, curl, flock, sha256sum and sha1sum installed
- A supported GPU, or an x86-64 CPU with AVX2 and enough RAM for the recipe
- Enough free RAM and disk for the model you pick, as the panel lists them
- Your Omarchy password for setup, since setup runs Omarchy's Sudoless Docker command, which is root-equivalent
Add this badge to your README
Maintain Omarchy Local AI? Show readers where to find these use cases.
Markdown
[](https://dedupedai.com/use-cases/0xsero-omarchy-local-ai/?utm_source=github&utm_medium=badge&utm_campaign=0xSero-omarchy-local-ai)
HTML
<a href="https://dedupedai.com/use-cases/0xsero-omarchy-local-ai/?utm_source=github&utm_medium=badge&utm_campaign=0xSero-omarchy-local-ai"><img src="https://dedupedai.com/badge/0xSero/omarchy-local-ai.svg" alt="Use cases on Deduped" height="20"></a>
A static image, no tracking script. About the badge
Questions about Omarchy Local AI
What is Omarchy Local AI?
Local AI is an Omarchy plugin that runs a validated local model on your own GPU or CPU in Docker and opens coding agents on it. It is an open-source project on GitHub: https://github.com/0xSero/omarchy-local-ai.
Who is Omarchy Local AI for?
Omarchy Linux users with a supported NVIDIA, Intel Arc Pro, AMD or AVX2 CPU machine who want a coding model that runs locally.
What can I do with Omarchy Local AI?
3 use cases so far, for example: Run a local model on your GPU and open a coding agent on it; Share a running local model with your tailnet; Call a running local model from your own scripts. Each has steps and a copy-paste agent prompt.
What do I need to run Omarchy Local AI?
Omarchy with the Quattro shell and its bar; Docker, jq, curl, flock, sha256sum and sha1sum installed; A supported GPU, or an x86-64 CPU with AVX2 and enough RAM for the recipe; Enough free RAM and disk for the model you pick, as the panel lists them.
What are alternatives to Omarchy Local AI?
Other hot AI repos in Software and DevOps: Hermes Plan Mode, Agent 2, Agnes Harness, Skills, Awesome Jev.
Is Omarchy Local AI safe to run?
Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.