Document Processor

Document Processor

Extract content from PDFs and DOCX files for analysis, summarization, and note integration.

Design Philosophy

The Large File Problem

Claude can read PDFs directly, but large files (>5MB) often fail or timeout. This skill provides extraction scripts that handle files of any size by processing page-by-page and optionally splitting output into chunks.

Extract First, Summarize Second

The Python scripts focus on extraction quality, not summarization. They produce clean text output that Claude can then analyze, summarize, or integrate into notes. This separation means extraction is deterministic and repeatable.

Progressive Enhancement

The tools work with minimal dependencies (pure Python) but support enhanced extraction when additional tools are installed:

• Base: pypdf + python-docx (always works)
• Better PDF: pdftotext via poppler (better text extraction)
• OCR: tesseract + pytesseract (scanned documents)

Format Preservation

DOCX conversion to markdown preserves document structure: headings become #, bold becomes **, tables become markdown tables. This makes extracted content immediately useful in markdown-based note systems.

Anti-Patterns: What to Avoid

The Direct Read Timeout

Symptom: Trying to read a 50MB PDF directly with Claude's Read tool. Problem: Large files timeout or consume excessive context. Solution: Use extract_pdf.py to process the file, then read the extracted text.

The OCR Assumption

Symptom: Running OCR on every PDF. Problem: OCR is slow and OCR dependencies are heavy. Solution: Only use --ocr flag when standard extraction returns minimal text.

The Full Document Dump

Symptom: Extracting 500 pages and asking Claude to summarize all of it. Problem: Context overflow, poor summaries. Solution: Use --split 50 to process in chunks, summarize each chunk, then synthesize.

The Missing Dependency Loop

Symptom: User tries to use OCR but hasn't installed tesseract. Problem: Confusing errors, wasted time. Solution: Scripts detect missing dependencies and provide clear install instructions.

Quick Start

Check File Size First

Before processing, check file size to choose the right strategy:

ls -lh document.pdf

Basic Extraction

# PDF extraction
python scripts/extract_pdf.py --file document.pdf

# DOCX to markdown
python scripts/extract_docx.py --file document.docx --markdown

PDF Processing Workflow

Step 1: Assess the PDF

# Check file size and type
ls -lh document.pdf

# Quick metadata check
python scripts/extract_pdf.py --file document.pdf --metadata-only

Step 2: Extract Content

For text-based PDFs:

python scripts/extract_pdf.py --file document.pdf

For scanned/image PDFs:

# First, try normal extraction
python scripts/extract_pdf.py --file document.pdf

# If little text extracted, use OCR
python scripts/extract_pdf.py --file document.pdf --ocr

Step 3: Handle Large Documents

For documents > 50 pages, split into chunks:

# Split into 50-page chunks
python scripts/extract_pdf.py --file large.pdf --split 50

Step 4: Extract Specific Pages

# Single page
python scripts/extract_pdf.py --file document.pdf --page 5

# Page range
python scripts/extract_pdf.py --file document.pdf --pages 1-10

# Specific pages
python scripts/extract_pdf.py --file document.pdf --pages 1,5,10,15

DOCX Processing Workflow

Step 1: Basic Extraction

# Plain text
python scripts/extract_docx.py --file document.docx

# As markdown (preserves structure)
python scripts/extract_docx.py --file document.docx --markdown

Step 2: Extract with Images

# Extract text and save images
python scripts/extract_docx.py --file document.docx --markdown --extract-images --output-dir ./images/

Step 3: Metadata Only

python scripts/extract_docx.py --file document.docx --metadata-only

Obsidian Integration

Processing PDF References in Notes

When a note contains PDF references like [[document.pdf]] or [Report](attachments/report.pdf):

1. Identify the PDF path
2. Check file size
3. Extract content using appropriate strategy
4. Insert summary below the reference

Output format:

> **PDF Summary: [Document Title]**
> **Pages:** [count] | **Type:** [article/manual/report]
>
> **Overview:** [2-3 sentence summary]
>
> **Key Sections:**
> - [Section 1]: [brief description]
> - [Section 2]: [brief description]
>
> <details>
> <summary>Extracted Content</summary>
>
> [Page-by-page text content]
>
> </details>

Processing DOCX References

For [[document.docx]] or [Document](path/to/file.docx):

1. Extract as markdown
2. Optionally extract images to attachments folder
3. Insert content or summary

Script Reference

extract_pdf.py

extract_docx.py

Dependency Installation

Core Dependencies (Required)

pip install pypdf python-docx

Or using the requirements file:

pip install -r scripts/requirements.txt

Enhanced PDF Extraction (Optional)

# macOS
brew install poppler

# Ubuntu/Debian
sudo apt install poppler-utils

OCR Support (Optional)

# macOS
brew install tesseract poppler

# Python packages
pip install pytesseract pdf2image Pillow

JSON Output Mode

For programmatic use, both scripts support JSON output:

# PDF
python scripts/extract_pdf.py --file document.pdf --json > output.json

# DOCX
python scripts/extract_docx.py --file document.docx --json > output.json

JSON schema includes:

• success: boolean
• file_path: string
• metadata: object with document properties
• pages or content: extracted text
• error: string (if failed)

Troubleshooting

"pypdf not installed"

pip install pypdf

"python-docx not installed"

pip install python-docx

"tesseract not installed" (for OCR)

brew install tesseract  # macOS
sudo apt install tesseract-ocr  # Ubuntu

"Very little text extracted"

The PDF may be scanned/image-based. Try:

python scripts/extract_pdf.py --file document.pdf --ocr

"File too large for Claude to read"

Use extraction scripts instead of Read tool:

python scripts/extract_pdf.py --file large.pdf --split 50

Examples

Example 1: Process Research Paper

# Extract with page numbers
python scripts/extract_pdf.py --file research-paper.pdf

# Get just abstract and intro (pages 1-3)
python scripts/extract_pdf.py --file research-paper.pdf --pages 1-3

Example 2: Convert Contract to Markdown

# Full conversion with structure preserved
python scripts/extract_docx.py --file contract.docx --markdown > contract.md

Example 3: Process Scanned Receipt

# OCR extraction
python scripts/extract_pdf.py --file receipt.pdf --ocr --json

Example 4: Batch Process Directory

# Process all PDFs in a directory
for f in *.pdf; do
  python scripts/extract_pdf.py --file "$f" --json > "${f%.pdf}.json"
done