Probe ML and LLM systems for regressions and vulnerabilities with Giskard
Run automated red-team and failure scans against an LLM or RAG app before users find the breakage.
Prerequisites
Python environment, Giskard open-source package, model or RAG application access, test datasets or prompts, model provider credentials where required
Installation
Use the upstream install or setup path that matches your environment:
- pip install giskard
Requirements and caveats from upstream:
- Requires Python 3.12+.
Basic usage or getting-started notes:
sh
Telemetry: Libraries built on giskard-core (including giskard-checks) may send optional, aggregated usage analytics to help improve the product. No prompts, model outputs, or scenario text are included. See [w...
Extracted from upstream docs: https://raw.githubusercontent.com/Giskard-AI/giskard-oss/HEAD/README.md