DEDUPED Hot AI repos. Real use cases. What people build. Get the Monday 5

How to run a private ChatGPT-style app on your machine with Textgen

Install the portable web UI and chat with a GGUF model fully offline.

Short answer: Run git clone https://github.com/oobabooga/textgen and cd into Textgen; then create a venv with python -m venv venv and activate it; run pip install -r requirements/portable/requirements.txt --upgrade. All steps.

Who it is forAnyone who wants AI chat without sending data to a cloud service.

The problemCloud chat apps see everything you type.

The outcomeA local chat UI in your browser with your own model.

What you need first

  • Windows, Linux or macOS
  • Python 3.9+ for the manual install, or a portable build
  • A GGUF model file from Hugging Face and enough RAM or VRAM for it

Steps

  1. Run git clone https://github.com/oobabooga/textgen and cd into Textgen
  2. Create a venv with python -m venv venv and activate it
  3. Run pip install -r requirements/portable/requirements.txt --upgrade
  4. Put a GGUF file in user_data/models and launch with python server.py --portable --api --auto-launch

Prompt for your agent

Install oobabooga/textgen with the manual portable venv steps from its README, download a small GGUF model into user_data/models, and launch it with `python server.py --portable --api --auto-launch`.

Caveat. The easiest path is the portable desktop build from the releases page: download, unzip, double-click Textgen.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for oobabooga/textgen and "Run a private ChatGPT-style app on your machine"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer