DEDUPED Hot AI repos. Real use cases. What people build. Get the Monday 5

How to run a private parsing pipeline with telemetry off with Unstructured

Install only the extras for your formats, opt out of analytics and keep parsing on your own hardware.

Short answer: Install only what you parse, for example pip install "unstructured[docx]" or pip install unstructured for text, HTML, XML, JSON and email; then set DO_NOT_TRACK or SCARF_NO_ANALYTICS to a non-empty value before importing the library; Partition a sample email such as example-docs/eml/fake-email.eml with partition from Unstructured.partition.auto. All steps.

  • Data and analytics
  • Intermediate
  • 30 minutes
  • From the README
  • Claude Code
  • Codex
  • Cursor
  • Gemini CLI

privacy. By default the library sends lightweight analytics pings when imported and on partition calls; opt out with DO_NOT_TRACK or SCARF_NO_ANALYTICS.

Who it is forA team processing confidential contracts or email exports.

The problemData teams need to know what a parsing library sends over the network.

The outcomeA local install for your file types with the analytics ping disabled.

What you need first

  • Python with pip; `pip install "unstructured[all-docs]"` for every document type
  • System packages as needed: libmagic-dev, poppler-utils, tesseract-ocr and libreoffice
  • Or Docker, to use the prebuilt image instead of installing dependencies

Steps

  1. Install only what you parse, for example pip install "unstructured[docx]" or pip install unstructured for text, HTML, XML, JSON and email
  2. Set DO_NOT_TRACK or SCARF_NO_ANALYTICS to a non-empty value before importing the library
  3. Partition a sample email such as example-docs/eml/fake-email.eml with partition from Unstructured.partition.auto
  4. Gather system info with python scripts/collect_env.py if you need to report a bug

Prompt for your agent

Using Unstructured-IO/unstructured, install only the extras for <my file types>, export DO_NOT_TRACK=true, partition <my email export>, and confirm the element output.

Caveat. This card is written from the Unstructured-IO/unstructured README, not from a test run by Deduped. Before you start, make sure you have Python with pip. Check the repo for newer instructions before you rely on these steps.

Use this in your AI agent

Ask your agent

Using the Deduped MCP, get the setup steps for Unstructured-IO/unstructured and "Run a private parsing pipeline with telemetry off"

Add Deduped to Claude Code once

claude mcp add --transport http deduped https://dedupedai.com/mcp

Cursor, ChatGPT, others

Share: X LinkedIn Hacker News Email Copy link

Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer