Probe ML and LLM systems for regressions and vulnerabilities with Giskard

Run automated red-team and failure scans against an LLM or RAG app before users find the breakage.

agentskillexchange Updated 28 repo stars

File contents

Probe ML and LLM systems for regressions and vulnerabilities with Giskard

Run automated red-team and failure scans against an LLM or RAG app before users find the breakage.

Prerequisites

Python environment, Giskard open-source package, model or RAG application access, test datasets or prompts, model provider credentials where required

Installation

Use the upstream install or setup path that matches your environment:

  • pip install giskard

Requirements and caveats from upstream:

  • Requires Python 3.12+.

Basic usage or getting-started notes:

Documentation

Source

agentskillexchange/skills/tree/main/skills/probe-ml-and-llm-systems-for-regressions-and-vulnerabilities-with-giskard commit a573376e64

Frequently asked questions

npx skillmds@latest add agentskillexchange/probe-ml-and-llm-systems-for-regressions-and-vulnerabilities