DEDUPED Hot AI repos, turned into use cases Get the Monday 5

What you can do with Respan Gateway

Respan Gateway is a single Rust binary that sits between your code and AI vendor APIs, letting any supported SDK call many models and tools through one endpoint.

Trended earlier

respanai/respan-gateway on GitHub

Third-party repos we don't own or vouch for. AI-generated use cases can be wrong: review everything and run at your own risk.

What do you want to do?

5 use cases

  • Call any model from the SDK you already use

    Point an existing OpenAI, Anthropic or Gemini SDK at the gateway to reach other vendors' models.

    View prompt
    In the respan-gateway repo, start the gateway with the OPENAI_API_KEY from the environment, then send one chat request through http://localhost:8080 using the Anthropic SDK with model <target-model>. Return the reply text, and verify that the request appears in the live log at localhost:8080/ui/.

  • Route one model name across providers with fallback

    Define a named route that falls back to a second vendor and races a slow call.

    View prompt
    In the respan-gateway repo, edit gateway.toml to add a route that lists two providers in `to` with a hedge delay, then run the check command and send one request using the route name <route-name>. Return which provider served the reply, and verify the check command reports no errors.

  • Give any chat model web search and MCP tools

    Attach a tool vendor or MCP server so a plain chat call can use it.

    View prompt
    In the respan-gateway repo, add a search tool vendor and the tool_loop plugin to gateway.toml, validate it, then send a chat request to the gateway that needs web search and report the answer. Verify that the live log at localhost:8080/ui/ shows the tool call.

  • Trace every model call and read cost and latency

    Send all gateway traffic to Respan and check cost, latency and tokens per call.

    View prompt
    In the respan-gateway repo, configure the respan plugin in gateway.toml using RESPAN_API_KEY from the environment, validate the config, and send <number> test requests through the gateway. Return the cost, latency and token count for one call, and verify that a matching trace appears in Respan.

  • Write a custom guardrail or PII masking plugin

    Use the public plugin API to add masking or policy checks to every call.

    View prompt
    In the respan-gateway repo, read docs/plugins.md and examples/README.md, then write a Rust plugin that implements the four hooks for <rule>. Return the plugin file and the test request result, and verify that the masked value does not appear in the live log.

How to use Respan Gateway

  1. Check you have what it needs: Python with pip, or a Rust toolchain with cargo, or Docker; An API key for at least one model vendor, such as OPENAI_API_KEY; An existing app or SDK that accepts a custom base URL.
  2. Open respanai/respan-gateway on GitHub and read the README and license.
  3. Install the gateway with pip install respan-gateway.
  4. Set a vendor key in your shell with export OPENAI_API_KEY=sk-....
  5. Start the gateway by running respan-gateway.
  6. In your app, create the client with base_url set to http://localhost:8080 and call a model such as gpt-6-luna, as in the README example.

These steps come from our top use case, Call any model from the SDK you already use, which also has a copy-paste agent prompt.

Respan Gateway alternatives · Best AI repos for Software and DevOps

About this repo

Requirements

  • Python with pip, or a Rust toolchain with cargo, or Docker
  • An API key for at least one model vendor, such as OPENAI_API_KEY
  • An existing app or SDK that accepts a custom base URL
  • Optional: a Respan API key for tracing and a tool vendor key for MCP tools

Add this badge to your README

Maintain Respan Gateway? Show readers where to find these use cases. Use cases on Deduped

Markdown 

[![Use cases on Deduped](https://dedupedai.com/badge/respanai/respan-gateway.svg)](https://dedupedai.com/use-cases/respanai-respan-gateway/?utm_source=github&utm_medium=badge&utm_campaign=respanai-respan-gateway)

HTML 

<a href="https://dedupedai.com/use-cases/respanai-respan-gateway/?utm_source=github&amp;utm_medium=badge&amp;utm_campaign=respanai-respan-gateway"><img src="https://dedupedai.com/badge/respanai/respan-gateway.svg" alt="Use cases on Deduped" height="20"></a>

A static image, no tracking script. About the badge

Questions about Respan Gateway

What is Respan Gateway?

Respan Gateway is a single Rust binary that sits between your code and AI vendor APIs, letting any supported SDK call many models and tools through one endpoint. It is an open-source project on GitHub: https://github.com/respanai/respan-gateway.

Who is Respan Gateway for?

Developers and platform engineers who already use an AI SDK and want one endpoint for several model vendors, routing, tools and traces.

What can I do with Respan Gateway?

5 use cases so far, for example: Call any model from the SDK you already use; Route one model name across providers with fallback; Give any chat model web search and MCP tools. Each has steps and a copy-paste agent prompt.

What do I need to run Respan Gateway?

Python with pip, or a Rust toolchain with cargo, or Docker; An API key for at least one model vendor, such as OPENAI_API_KEY; An existing app or SDK that accepts a custom base URL; Optional: a Respan API key for tracing and a tool vendor key for MCP tools.

What are alternatives to Respan Gateway?

Other hot AI repos in Software and DevOps: Omarchy Local AI, Hermes Plan Mode, Agent 2, Agnes Harness, Skills.

Is Respan Gateway safe to run?

Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.