How to use Textgen: what you can do with it

3 use cases

• Run a private ChatGPT-style app on your machine

  Install the portable web UI and chat with a GGUF model fully offline.

  • REPO oobabooga/textgen
  • Claude Code
  • Codex
  • Cursor
  • Gemini CLI
  • Personal productivity
  • Beginner
  View prompt

  Install oobabooga/textgen with the manual portable venv steps from its README, download a small GGUF model into user_data/models, and launch it with `python server.py --portable --api --auto-launch`.

  Share Email me this

• Use your local model as an OpenAI-compatible API

  Start TextGen with --api and point existing OpenAI or Anthropic client code at it.

  • REPO oobabooga/textgen
  • Claude Code
  • Codex
  • Cursor
  • Gemini CLI
  • Personal productivity
  • Intermediate
  View prompt

  Start oobabooga/textgen with `python server.py --portable --api --auto-launch`, then change <my app> to use the local OpenAI-compatible API and run its tests.

  Share Email me this

• Fine-tune a LoRA on your own chats or text

  Use the full install and the Training tab to train a LoRA, with resume support.

  • REPO oobabooga/textgen
  • Claude Code
  • Codex
  • Cursor
  • Gemini CLI
  • Personal productivity
  • Advanced
  View prompt

  Help me set up oobabooga/textgen with the one-click installer (start_linux.sh), load a Transformers model, and walk me through training a LoRA on <my text dataset> in the Training tab.

  Share Email me this

Quick start with Textgen

1. Check you have what it needs: Windows, Linux or macOS; Python 3.9+ for the manual install, or a portable build; A GGUF model file from Hugging Face and enough RAM or VRAM for it.
2. Open oobabooga/textgen on GitHub and read the README and license.
3. Run git clone https://github.com/oobabooga/textgen and cd into Textgen
4. Create a venv with python -m venv venv and activate it
5. Run pip install -r requirements/portable/requirements.txt --upgrade
6. Put a GGUF file in user_data/models and launch with python server.py --portable --api --auto-launch

These steps come from our top use case, Run a private ChatGPT-style app on your machine, which also has a copy-paste agent prompt.

Using the Deduped MCP, get the setup steps for oobabooga/textgen

claude mcp add --transport http deduped https://dedupedai.com/mcp

Best AI repos for Personal productivity

About this repo

• Who it is forPeople who want a private ChatGPT-style app on their own machine, and developers who want a local OpenAI-compatible API.
• Why it is hot48k stars, talked about in 2 AI sources we track
• LanguagePython
• Sourcegithub.com/oobabooga/textgen · Back to Hot repos

Requirements

• Windows, Linux or macOS
• Python 3.9+ for the manual install, or a portable build
• A GGUF model file from Hugging Face and enough RAM or VRAM for it

Related repos

• Trended earlier REPO open-webui/open-webui Open WebUI Open WebUI is a self-hosted AI platform with a chat interface for Ollama and OpenAI-compatible APIs that can run entirely offline. It adds local RAG over your documents with hybrid search, web search from many providers, custom models and agents with tools and knowledge, voice and video calls, role-based access control for teams, and SQLite or PostgreSQL storage. It installs with pip, Docker or Kubernetes.
• Trended earlier REPO KODAMA-TECHNOLOGY/Chat_UI Chat UI Chat_UI is a zero-dependency LLM chat client made of two files, under 100 KB, that runs in a web browser.
• Trended earlier REPO janhq/jan Jan Jan is an open-source ChatGPT replacement that downloads and runs LLMs such as Llama, Gemma, Qwen and GPT-oss locally from Hugging Face, with full control and privacy. It can also connect to cloud models from OpenAI, Anthropic, Mistral, Groq and others, lets you create custom assistants, exposes an OpenAI-compatible API at localhost:1337 and supports the Model Context Protocol for agentic features.