Credentials. OSW stores the API keys for every channel you add, so only enter keys for accounts you are allowed to use through this proxy.
Who it is forA developer whose daily coding assistant stops whenever one provider has an outage, rate limit, or exhausted quota.
The problemEach AI tool is configured against a single provider. When that provider returns errors or times out, you must manually switch keys, URLs, and model names in every tool.
The outcomeYour tools point at one local address, and OSW moves each request to the next channel in your queue when a channel fails.
What you need first
- A Mac, Windows PC, or Linux machine that can run the OSW installer
- API keys for at least two LLM channels you own
- An AI client that lets you set a custom base URL
Steps
- Download the installer for your platform from the latest release on the OSW GitHub page and install it.
- Open Model Management, choose New provider, and enter the name, API key, timeout, and default endpoint for each provider you use.
- Add the real model IDs under each provider and tick the protocols each model supports.
- Open Logical Models, drag the models into the order you want them tried, and switch off any you want to skip.
- In your AI client, set the base URL to http://127.0.0.1:9300/v1 for OpenAI compatible tools, or http://127.0.0.1:9300 for Anthropic clients.
- Run
curl http://127.0.0.1:9300/v1/modelsto confirm the service is alive.
Prompt for your agent
Using the OSW repo at yinxulai/osw, configure a local proxy with the channels for <provider-list>, then point <client-name> at http://127.0.0.1:9300/v1. Expected output: a list of model names from `curl http://127.0.0.1:9300/v1/models`. Verify that the models endpoint returns a response before reporting success.
Caveat. Failover only moves a request to the next channel in your queue, and a response that has already started streaming is aborted rather than finished by another channel.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for yinxulai/osw and "Keep AI coding tools running when one provider fails"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer