DEDUPED Hot AI repos. Real use cases. What people build. Get the Monday 5

How to use Uzu: what you can do with it

What is Uzu? uzu is a high-performance inference engine for running AI models directly inside your app, with zero latency, full data privacy and no inference costs. It has a simple high-level API in Rust, Python, Swift and TypeScript, downloads models such as Qwen 3.5 0.8B automatically, uses unified memory on Apple devices and supports streaming chat replies.

How do I use it? Run uv add uzu==0.6.13; then create the engine with EngineConfig.create() and Engine.create as in the README Python example; load the model alibaba:qwen3.5:0.8b:mirai:mirai-m:4 and iterate the download to show progress. Full steps below.

Trended earlier

View repo on GitHub

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer

3 use cases

Quick start with Uzu

  1. Check you have what it needs: Rust, Python (uv), Swift or TypeScript (pnpm); An Apple device to benefit from unified memory; Disk space for the downloaded model.
  2. Open trymirai/uzu on GitHub and read the README and license.
  3. Run uv add uzu==0.6.13
  4. Create the engine with EngineConfig.create() and Engine.create as in the README Python example
  5. Load the model alibaba:qwen3.5:0.8b:mirai:mirai-m:4 and iterate the download to show progress
  6. Open a chat session and send a system and a user ChatMessage

These steps come from our top use case, Run a local LLM inside a Python script with Uzu, which also has a copy-paste agent prompt.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for trymirai/uzu

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Best AI repos for Software and DevOps

About this repo

  • Who it is forApp developers who want on-device LLM chat in a Mac, iOS, Python or Node app without paying per token.
  • Why it is hot3k stars, talked about in 3 AI sources we track
  • LanguageRust
  • Sourcegithub.com/trymirai/uzu ยท Back to Hot repos

Requirements

  • Rust, Python (uv), Swift or TypeScript (pnpm)
  • An Apple device to benefit from unified memory
  • Disk space for the downloaded model

Add this badge to your README

Maintain Uzu? Show readers where to find these use cases. Use cases on Deduped

Markdown

[![Use cases on Deduped](https://dedupedai.com/badge/trymirai/uzu.svg)](https://dedupedai.com/use-cases/trymirai-uzu/?utm_source=github&utm_medium=badge&utm_campaign=trymirai-uzu)

HTML

<a href="https://dedupedai.com/use-cases/trymirai-uzu/?utm_source=github&amp;utm_medium=badge&amp;utm_campaign=trymirai-uzu"><img src="https://dedupedai.com/badge/trymirai/uzu.svg" alt="Use cases on Deduped" height="20"></a>

A static image, no tracking script. About the badge

Questions about Uzu

What is Uzu?

uzu is a high-performance inference engine for running AI models directly inside your app, with zero latency, full data privacy and no inference costs. It has a simple high-level API in Rust, Python, Swift and TypeScript, downloads models such as Qwen 3.5 0.8B automatically, uses unified memory on Apple devices and supports streaming chat replies. It is an open-source project on GitHub: https://github.com/trymirai/uzu.

How do I use Uzu?

Run uv add uzu==0.6.13; then create the engine with EngineConfig.create() and Engine.create as in the README Python example; load the model alibaba:qwen3.5:0.8b:mirai:mirai-m:4 and iterate the download to show progress. The use cases on this page give the full steps and a copy-paste agent prompt for each job.

Who is Uzu for?

App developers who want on-device LLM chat in a Mac, iOS, Python or Node app without paying per token.

What can I do with Uzu?

3 use cases so far, for example: Run a local LLM inside a Python script with Uzu; Add on-device AI chat to a Swift app with Uzu; Stream local LLM replies in a Node or Rust app. Each has steps and a copy-paste agent prompt.

What do I need to run Uzu?

Rust, Python (uv), Swift or TypeScript (pnpm); An Apple device to benefit from unified memory; Disk space for the downloaded model.

What are alternatives to Uzu?

Other hot AI repos in Software and DevOps: Skills, Claude Mem, Freellmapi, Andrej Karpathy Skills, Agent Desktop.

Is Uzu safe to run?

Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.