DEDUPED Hot AI repos, turned into use cases Get 5 a day

How to chat with an 80B model on a 32 GB laptop with Janas

Install Janas-LLM on Linux and chat with a model larger than the laptop's RAM, offline after download.

Who it is forA developer or researcher with a 32 GB Linux laptop who wants a capable local chat model without a cloud account.

The problemMost local model runners need the whole model in memory, so a model bigger than the laptop's RAM cannot run at all.

The outcomeA working chat session with a locally run model, where the weights stay on disk and expert weights are streamed from the SSD as needed.

What you need first

  • Linux x86-64 (Ubuntu 22.04, Debian 12 and later) or Windows 10 (1903 or later) or 11, x86-64
  • A terminal on the machine
  • Enough free disk space for the model you pick; the README lists Qwen3-Next-80B at 48.4 GB
  • A machine with 32 GB of RAM is the one the README measured on; other machines are untested

Steps

  1. Download the Linux build: curl -LO https://github.com/prabanta-dev/janas/releases/latest/download/janas-linux-x86_64.tar.gz
  2. Unpack it and enter the folder: tar xf janas-linux-x86_64.tar.gz && cd janas
  3. Start the chat: ./janas-chat
  4. Pick a model from the list shown; it is downloaded and checked before use
  5. Type a question and read the reply; press Ctrl-C to stop a reply and Ctrl-D to leave the chat

Prompt for your agent

In the janas repo at <install-folder>, run ./janas-chat, choose the Qwen3-Next-80B-A3B model, and ask it one short question. Report the reply text and the tokens-per-second figure if shown. Verify that the process finished without the desktop becoming unresponsive.

Caveat. The README says the engine is deliberately hard on the machine and is not verified; on a machine with less headroom the desktop can be pushed into swap and become slow or unresponsive.

Share: X LinkedIn Hacker News Email Copy link

Disclaimer

Deduped lists open-source repositories that belong to other people. We do not own, maintain, audit, or vouch for any of them, and a repo appearing here is not an endorsement or a safety check. The use cases, steps, and prompts are written by AI and may be incomplete, outdated, or just wrong. Where a use case is marked "Seen in the wild", we link to public posts where someone described something similar, but we have not verified those posts and the use case itself is still our AI's own write-up. Use all of this at your own risk. Only run code, commands, or agents on systems and accounts you are authorized to use, and read the code and every command before you run it, especially anything that touches credentials, files, or the network. Nothing here is professional, security, legal, or financial advice. All trademarks and project names belong to their respective owners, and their use here does not imply affiliation. Content is provided as is, without warranties of any kind. Found a mistake, a safety problem, or something you want removed? Email [email protected] and we will look at it promptly. Full disclaimer page