How do I install the Model Audit skill?

Run npx skillmds@latest add modbender/model-audit in your terminal (requires Node.js), paste this page's agent-chat prompt into Claude, Cursor, or any MCP-connected agent, or download the SKILL.md file and copy it into your agent's skills directory.

Is Model Audit safe to use?

This skill has not completed SkillMD's automated safety review yet. Independent scanners report: SkillSpector: PASS, Skill Scanner: PASS. Capability flags: executes scripts, makes network calls. SkillMD never runs a skill's scripts for you; review the SKILL.md before installing.

Which AI agents work with Model Audit?

This skill is tagged as working with Claude Code, Claude.ai, OpenAI Codex. SKILL.md is an open format, so most agents that read a skills directory can load it too.

Is Model Audit free to use?

Yes. Installing skills from SkillMD is free. This skill is licensed under MIT.

Who published Model Audit?

modbender (@modbender) published this skill. Their other Agent Skills are listed on their SkillMD profile.

Model Audit by modbender — Agent Skill

Name: Model Audit
Rating: 4.2 (5 reviews)
Author: modbender

Model Audit

Monthly LLM stack audit — compare your current models against latest benchmarks and pricing from OpenRouter. Identifies potential savings, upgrades, and better alternatives by category (reasoning, code, fast, cheap, vision). Use for optimizing AI costs and staying on the frontier.

modbender Updated Sep 9, 2026 12 repo stars

File contents

Model Audit 📊

Audit your LLM stack against current pricing and alternatives.

Fetches live pricing from OpenRouter, analyzes your configured models, and recommends potential savings or upgrades by category.

Quick Start

# Full audit with recommendations
python3 {baseDir}/scripts/model_audit.py

# JSON output
python3 {baseDir}/scripts/model_audit.py --json

# Audit specific models
python3 {baseDir}/scripts/model_audit.py --models "anthropic/claude-opus-4-6,openai/gpt-4o"

# Show top models by category
python3 {baseDir}/scripts/model_audit.py --top

# Compare two models
python3 {baseDir}/scripts/model_audit.py --compare "anthropic/claude-sonnet-4" "openai/gpt-4o"

What It Does

Fetches live pricing from OpenRouter API
Reads your configured models from openclaw.json
Categorizes models (reasoning, code, fast, cheap, vision)
Compares against top alternatives in each category
Calculates potential monthly savings
Recommends upgrades or cost optimizations

Output Example

═══ LLM Stack Audit ═══

Your Models:
  anthropic/claude-opus-4-6    $5.00/$25.00 per 1M tokens (in/out)
  openai/gpt-4o              $2.50/$10.00 per 1M tokens
  google/gemini-2.0-flash     $0.10/$0.40 per 1M tokens

Recommendations:
  💡 For fast tasks: gemini-2.0-flash is 50x cheaper than opus
  💡 Consider: deepseek/deepseek-r1 for reasoning at $0.55/$2.19
  💡 Your stack covers: reasoning ✓, code ✓, fast ✓, vision ✓

Environment

Requires OPENROUTER_API_KEY environment variable.

Credits

Built by M. Abidi | agxntsix.ai YouTube | GitHub Part of the AgxntSix Skill Suite for OpenClaw agents.

📅 Need help setting up OpenClaw for your business? Book a free consultation

---name: model-auditdescription: Monthly LLM stack audit — compare your current models against latest benchmarks and pricing from OpenRouter. Identifies potential savings, upgrades, and better alternatives by category (reasoning, code, fast, cheap, vision). Use for optimizing AI costs and staying on the frontier.license: MIT--- # Model Audit 📊 **Audit your LLM stack against current pricing and alternatives.** Fetches live pricing from OpenRouter, analyzes your configured models, and recommends potential savings or upgrades by category. ## Quick Start ```bash # Full audit with recommendations python3 {baseDir}/scripts/model_audit.py # JSON output python3 {baseDir}/scripts/model_audit.py --json # Audit specific models python3 {baseDir}/scripts/model_audit.py --models "anthropic/claude-opus-4-6,openai/gpt-4o" # Show top models by category python3 {baseDir}/scripts/model_audit.py --top # Compare two models python3 {baseDir}/scripts/model_audit.py --compare "anthropic/claude-sonnet-4" "openai/gpt-4o" ``` ## What It Does 1. **Fetches** live pricing from OpenRouter API 2. **Reads** your configured models from openclaw.json 3. **Categorizes** models (reasoning, code, fast, cheap, vision) 4. **Compares** against top alternatives in each category 5. **Calculates** potential monthly savings 6. **Recommends** upgrades or cost optimizations ## Output Example ``` ═══ LLM Stack Audit ═══ Your Models: anthropic/claude-opus-4-6 $5.00/$25.00 per 1M tokens (in/out) openai/gpt-4o $2.50/$10.00 per 1M tokens google/gemini-2.0-flash $0.10/$0.40 per 1M tokens Recommendations: 💡 For fast tasks: gemini-2.0-flash is 50x cheaper than opus 💡 Consider: deepseek/deepseek-r1 for reasoning at $0.55/$2.19 💡 Your stack covers: reasoning ✓, code ✓, fast ✓, vision ✓ ``` ## Environment Requires `OPENROUTER_API_KEY` environment variable. ## Credits Built by [M. Abidi](https://www.linkedin.com/in/mohammad-ali-abidi) | [agxntsix.ai](https://www.agxntsix.ai) [YouTube](https://youtube.com/@aiwithabidi) | [GitHub](https://github.com/aiwithabidi) Part of the **AgxntSix Skill Suite** for OpenClaw agents. 📅 **Need help setting up OpenClaw for your business?** [Book a free consultation](https://cal.com/agxntsix/abidi-openclaw)

Frequently asked questions