AI Security Tooling
Scope
Use this skill when adding or organizing:
- LLM security tools (guardrails, detectors)
- Adversarial ML libraries
- AI vulnerability scanners
- Model safety tools
- Security benchmarks and frameworks
Tool Categories
LLM Security Tools
- Guardrails: NeMo Guardrails, LLM Guard, Rebuff
- Detectors: Vigil-LLM, Nova Framework, Garak
- Scanners: ModelScan, AI Security Analyzer
Adversarial ML Libraries
- Attack libraries: ART, CleverHans, Foolbox, TextAttack
- Defense libraries: SecML
- Fuzzing: OSS-Fuzz-Gen, Brainstorm
AI Red Teaming
- Microsoft: Counterfit, PyRIT
- Meta: PurpleLlama
- NVIDIA: Garak, NeMo Guardrails
Benchmarks
- Robustness: RobustBench
- Jailbreak: JailbreakBench
- Safety: Stanford AIR-Bench
- Hallucination: Vectara Leaderboard
Standards & Frameworks
- MITRE ATLAS: AI threat matrix
- NIST AI RMF: Risk management framework
- OWASP: LLM Top 10, GenAI Security Project
Categorization Rules
- LLM guardrails/detectors →
AI Security & Attacks → Model Security
- Prompt injection tools →
AI Security & Attacks → Prompt Injection
- Adversarial ML libraries →
AI Security & Attacks → Adversarial Attacks or AI Security Libraries
- AI RE/debugging tools →
AI Security Tools & Frameworks → AI Reverse Engineering
- AI vulnerability scanners →
AI Security Tools & Frameworks → AI Vulnerability Detection
- Benchmarks →
Benchmarks & Standards
- MCP security tools →
AI Pentesting & Red Teaming → AI Security MCP Tools
Quality Bar
- Prefer canonical repos
- Avoid forks unless they add meaningful features
- Add short descriptions
- Never duplicate an existing URL
- Tool must be AI/ML-focused
Key Vendor Tools
| Vendor |
Tools |
| Microsoft |
Counterfit, PyRIT |
| Meta |
PurpleLlama (Llama Guard, Prompt Guard, Code Shield) |
| NVIDIA |
Garak, NeMo Guardrails |
| IBM |
Adversarial Robustness Toolbox (ART) |
| Google |
OSS-Fuzz-Gen |
| ProtectAI |
Rebuff, LLM Guard, ModelScan |
Notes
Keep additions:
- AI/ML security focused
- Non-duplicated URLs
- Minimal structural changes
Data Source
For detailed and up-to-date resources, fetch the complete list from:
https://raw.githubusercontent.com/gmh5225/awesome-ai-security/refs/heads/main/README.md
Use this URL to get the latest curated links when you need specific tools, papers, or resources not covered in this skill.
1---2name: ai-security-tooling3description: Guide for AI security tooling (detectors, analyzers, guardrails, benchmarks) and consistent placement in README.md.4metadata:5 source: https://skillmd.com/skills/gmh5225/ai-security-tooling6---78# AI Security Tooling910## Scope1112Use this skill when adding or organizing:1314- LLM security tools (guardrails, detectors)15- Adversarial ML libraries16- AI vulnerability scanners17- Model safety tools18- Security benchmarks and frameworks1920## Tool Categories2122### LLM Security Tools23- **Guardrails**: NeMo Guardrails, LLM Guard, Rebuff24- **Detectors**: Vigil-LLM, Nova Framework, Garak25- **Scanners**: ModelScan, AI Security Analyzer2627### Adversarial ML Libraries28- **Attack libraries**: ART, CleverHans, Foolbox, TextAttack29- **Defense libraries**: SecML30- **Fuzzing**: OSS-Fuzz-Gen, Brainstorm3132### AI Red Teaming33- **Microsoft**: Counterfit, PyRIT34- **Meta**: PurpleLlama35- **NVIDIA**: Garak, NeMo Guardrails3637### Benchmarks38- **Robustness**: RobustBench39- **Jailbreak**: JailbreakBench40- **Safety**: Stanford AIR-Bench41- **Hallucination**: Vectara Leaderboard4243### Standards & Frameworks44- **MITRE ATLAS**: AI threat matrix45- **NIST AI RMF**: Risk management framework46- **OWASP**: LLM Top 10, GenAI Security Project4748## Categorization Rules4950- **LLM guardrails/detectors** → `AI Security & Attacks → Model Security`51- **Prompt injection tools** → `AI Security & Attacks → Prompt Injection`52- **Adversarial ML libraries** → `AI Security & Attacks → Adversarial Attacks` or `AI Security Libraries`53- **AI RE/debugging tools** → `AI Security Tools & Frameworks → AI Reverse Engineering`54- **AI vulnerability scanners** → `AI Security Tools & Frameworks → AI Vulnerability Detection`55- **Benchmarks** → `Benchmarks & Standards`56- **MCP security tools** → `AI Pentesting & Red Teaming → AI Security MCP Tools`5758## Quality Bar5960- Prefer canonical repos61- Avoid forks unless they add meaningful features62- Add short descriptions63- Never duplicate an existing URL64- Tool must be AI/ML-focused6566## Key Vendor Tools6768| Vendor | Tools |69|--------|-------|70| Microsoft | Counterfit, PyRIT |71| Meta | PurpleLlama (Llama Guard, Prompt Guard, Code Shield) |72| NVIDIA | Garak, NeMo Guardrails |73| IBM | Adversarial Robustness Toolbox (ART) |74| Google | OSS-Fuzz-Gen |75| ProtectAI | Rebuff, LLM Guard, ModelScan |7677## Notes7879Keep additions:8081- AI/ML security focused82- Non-duplicated URLs83- Minimal structural changes8485## Data Source8687For detailed and up-to-date resources, fetch the complete list from:8889```90https://raw.githubusercontent.com/gmh5225/awesome-ai-security/refs/heads/main/README.md91```9293Use this URL to get the latest curated links when you need specific tools, papers, or resources not covered in this skill.