Document RAG Pipeline Architecture

Sub-skill of document-rag-pipeline: Architecture.

vamseeachanta Updated

File contents

Architecture

Architecture

Document Folder
      │
      ▼
┌─────────────────────┐
│ 1. Build Inventory  │  SQLite catalog of all files
└──────────┬──────────┘
           ▼
┌─────────────────────┐
│ 2. Extract Text     │  PyMuPDF for regular PDFs
└──────────┬──────────┘
           ▼
┌─────────────────────┐
│ 3. OCR Scanned PDFs │  Tesseract + pytesseract
└──────────┬──────────┘
           ▼
┌─────────────────────┐
│ 4. Chunk Text       │  1000 chars, 200 overlap
└──────────┬──────────┘
           ▼
┌─────────────────────┐
│ 5. Generate Embeds  │  sentence-transformers
└──────────┬──────────┘
           ▼
┌─────────────────────┐
│ 6. Semantic Search  │  Cosine similarity
└─────────────────────┘

vamseeachanta/workspace-hub/tree/main/.agents/skills/_archive/data/documents/document-rag-pipeline/architecture commit 0e95b1e635

Frequently asked questions

npx skillmds@latest add vamseeachanta/document-rag-pipeline-architecture