DEDUPED Hot AI repos. Real use cases. What people build. Get the Monday 5

How to use Jan as a local OpenAI-compatible API with Jan

Turn on Jan's local server and point your scripts or apps at localhost:1337.

Short answer: Install Jan and download a local model; then enable the OpenAI-Compatible API so the local server runs at localhost:1337; point your app's OpenAI base URL at the local server. All steps.

Who it is forA developer who wants to test an app against a local model without paying per token.

The problemBuilding against a cloud API means costs and sending data out during development.

The outcomeA local endpoint at localhost:1337 that apps written for the OpenAI API can call.

What you need first

  • Windows 10+, macOS 13.6+ or most Linux distributions
  • RAM for the model size: 8GB for 3B models, 16GB for 7B, 32GB for 13B on macOS
  • To build from source: Node.js 20+, Yarn 4.5.3+, Make and Rust

Steps

  1. Install Jan and download a local model
  2. Enable the OpenAI-Compatible API so the local server runs at localhost:1337
  3. Point your app's OpenAI base URL at the local server
  4. Check the API Reference linked in the README for endpoints

Prompt for your agent

Using janhq/jan's OpenAI-compatible server at localhost:1337, change my <script or app> to call the local model <model> instead of the OpenAI API, run it, and compare the answer to the cloud version.

Caveat. Local models are usually weaker than frontier cloud models, so expect differences in quality.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for janhq/jan and "Use Jan as a local OpenAI-compatible API"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer