# Score RAG answer quality and retrieval quality before rollout with Ragas > Measure whether a RAG change actually improved answers and retrieval, instead of guessing from a few spot checks. - Skill: `agentskillexchange/score-rag-answer-quality-and-retrieval-quality-before-rollou` (Agent Skill) - Install (CLI): `npx skillmds@latest add agentskillexchange/score-rag-answer-quality-and-retrieval-quality-before-rollou` - Raw SKILL.md: https://api.skillmd.com/api/skills/agentskillexchange/score-rag-answer-quality-and-retrieval-quality-before-rollou/raw - Safety review: pending (external: skill-scanner PASS, skillspector CAUTION) - Works with: Claude Code, Claude.ai, OpenAI Codex - Category: AI & ML - Author: agentskillexchange (https://skillmd.com/u/agentskillexchange) - Updated: 2026-09-08 - Page: https://skillmd.com/skills/agentskillexchange/score-rag-answer-quality-and-retrieval-quality-before-rollou --- # Score RAG answer quality and retrieval quality before rollout with Ragas Measure whether a RAG change actually improved answers and retrieval, instead of guessing from a few spot checks. ## Prerequisites Python environment, Ragas package, model provider credentials, evaluation dataset or testset generation inputs, access to the target RAG workflow ## Installation Use the upstream install or setup path that matches your environment: - pip install ragas - pip install git+https://github.com/vibrantlabsai/ragas Requirements and caveats from upstream: - - Made with Python - python Basic usage or getting-started notes: - Quick start | - ### Clone a Complete Example Project - ragas comes with pre-built metrics for common evaluation tasks. For example, Aspect Critique evaluates any aspect of your output using DiscreteMetric: - Source: https://github.com/vibrantlabsai/ragas - Extracted from upstream docs: https://raw.githubusercontent.com/vibrantlabsai/ragas/HEAD/README.md ## Documentation - https://docs.ragas.io/en/stable/ ## Source - [Agent Skill Exchange](https://agentskillexchange.com/skills/score-rag-answer-quality-and-retrieval-quality-before-rollout-with-ragas/)