privacy. By default the library sends lightweight analytics pings when imported and on partition calls; opt out with DO_NOT_TRACK or SCARF_NO_ANALYTICS.
Who it is forA team processing confidential contracts or email exports.
The problemData teams need to know what a parsing library sends over the network.
The outcomeA local install for your file types with the analytics ping disabled.
What you need first
- Python with pip; `pip install "unstructured[all-docs]"` for every document type
- System packages as needed: libmagic-dev, poppler-utils, tesseract-ocr and libreoffice
- Or Docker, to use the prebuilt image instead of installing dependencies
Steps
- Install only what you parse, for example
pip install "unstructured[docx]"orpip install unstructuredfor text, HTML, XML, JSON and email - Set DO_NOT_TRACK or SCARF_NO_ANALYTICS to a non-empty value before importing the library
- Partition a sample email such as example-docs/eml/fake-email.eml with partition from Unstructured.partition.auto
- Gather system info with
python scripts/collect_env.pyif you need to report a bug
Prompt for your agent
Using Unstructured-IO/unstructured, install only the extras for <my file types>, export DO_NOT_TRACK=true, partition <my email export>, and confirm the element output.
Caveat. This card is written from the Unstructured-IO/unstructured README, not from a test run by Deduped. Before you start, make sure you have Python with pip. Check the repo for newer instructions before you rely on these steps.
Use this in your AI agent
Ask your agent
Using the Deduped MCP, get the setup steps for Unstructured-IO/unstructured and "Run a private parsing pipeline with telemetry off"
Add Deduped to Claude Code once
claude mcp add --transport http deduped https://dedupedai.com/mcp
Every Monday: the 5 hottest repos and exactly how to use them. Free, one email a week, unsubscribe anytime.
Get them freeShare: X LinkedIn Hacker News Email Copy link
Third-party repos we don't own. AI-written use cases can be wrong. Disclaimer