What do you want to do?
3 use cases
-
Run an LLM on your own machine from Python
Install the runanywhere package and generate text locally; the model downloads on first use.
View prompt
Using RunanywhereAI/runanywhere-sdks, install `pip install runanywhere`, run the README quick start to generate a reply to <my prompt> on device, and report the time it took.
-
Expose on device models as an OpenAI compatible API
Install the server extra and run runanywhere serve so any OpenAI client can use local models.
- REPO
RunanywhereAI/runanywhere-sdks - Claude Code
- Codex
- Cursor
- Gemini CLI
- Software and DevOps
- Intermediate
View prompt
Using RunanywhereAI/runanywhere-sdks, run `pip install "runanywhere[server]"` and `runanywhere serve`, then call it with the OpenAI Python client using model qwen2.5-0.5b and show the reply.
- REPO
-
Add on device AI to a React Native app
Install the RunAnywhere React Native core and llama.cpp packages and call generate in your app.
View prompt
Using RunanywhereAI/runanywhere-sdks, add `npm install @runanywhere/core@0.20.27 @runanywhere/llamacpp@0.20.27` to <my React Native app> and build a screen that summarises text on device.
Quick start with Runanywhere SDKS
- Check you have what it needs: Python with pip, or npm for React Native and Web; A supported device; models download on first use.
- Open RunanywhereAI/runanywhere-sdks on GitHub and read the README and license.
- Install with
pip install runanywhere - Call ra.initialize() and ra.llm.generate as in the README quick start
- Let the first run download the model
- Use streaming generation for longer replies
These steps come from our top use case, Run an LLM on your own machine from Python, which also has a copy-paste agent prompt.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for RunanywhereAI/runanywhere-sdks
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeAbout this repo
- Who it is forApp developers who want private, offline AI features on phones, laptops or in the browser.
- Why it is hot10k stars, talked about in 2 AI sources we track
- LanguageC++
- Sourcegithub.com/RunanywhereAI/runanywhere-sdks ยท Back to Hot repos
Requirements
- Python with pip, or npm for React Native and Web
- A supported device; models download on first use
Add this badge to your README
Maintain Runanywhere SDKS? Show readers where to find these use cases.
Markdown
[](https://dedupedai.com/use-cases/runanywhereai-runanywhere-sdks/?utm_source=github&utm_medium=badge&utm_campaign=RunanywhereAI-runanywhere-sdks)
HTML
<a href="https://dedupedai.com/use-cases/runanywhereai-runanywhere-sdks/?utm_source=github&utm_medium=badge&utm_campaign=RunanywhereAI-runanywhere-sdks"><img src="https://dedupedai.com/badge/RunanywhereAI/runanywhere-sdks.svg" alt="Use cases on Deduped" height="20"></a>
A static image, no tracking script. About the badge
Questions about Runanywhere SDKS
What is Runanywhere SDKS?
RunAnywhere is a set of SDKs for running AI fully on device: LLM chat, structured output, tool calling, vision, speech to text, text to speech, voice agents, embeddings and RAG behind one API, with Python, Swift, Kotlin, Flutter, React Native and Web packages and the wally terminal tool. It is an open-source project on GitHub: https://github.com/RunanywhereAI/runanywhere-sdks.
How do I use Runanywhere SDKS?
Install with pip install runanywhere; then call ra.initialize() and ra.llm.generate as in the README quick start; let the first run download the model. The use cases on this page give the full steps and a copy-paste agent prompt for each job.
Who is Runanywhere SDKS for?
App developers who want private, offline AI features on phones, laptops or in the browser.
What can I do with Runanywhere SDKS?
3 use cases so far, for example: Run an LLM on your own machine from Python; Expose on device models as an OpenAI compatible API; Add on device AI to a React Native app. Each has steps and a copy-paste agent prompt.
What do I need to run Runanywhere SDKS?
Python with pip, or npm for React Native and Web; A supported device; models download on first use.
What are alternatives to Runanywhere SDKS?
Other hot AI repos in Software and DevOps: Skills, Claude Mem, Freellmapi, Andrej Karpathy Skills, Agent Desktop.
Is Runanywhere SDKS safe to run?
Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.