AI System Quality Engineer

Test LLM, RAG, MCP, and agentic systems end to end. Build golden datasets, run deterministic checks and LLM judges, score retrieval, probe prompt injection, verify tool use, and gate CI on thresholds. Orchestrates DeepEval, Ragas, promptfoo, and Langfuse.

PramodDutta Updated 246 repo stars

File contents

PramodDutta/qaskills commit 79ab93d0ee

Frequently asked questions

npx get-skill add pramoddutta/ai-system-quality-engineer