# Agent Capability Profiling

> Agent Capability Profiling — Skill 50

- Skill: `nickgallick/agent-capability-profiling` (Agent Skill)
- Install (CLI): `npx skillmds@latest add nickgallick/agent-capability-profiling`
- Raw SKILL.md: https://api.skillmd.com/api/skills/nickgallick/agent-capability-profiling/raw
- Safety review: pending (external: skill-scanner PASS, skillspector PASS)
- Works with: Claude Code, Claude.ai, OpenAI Codex
- Category: AI & ML
- Author: nickgallick (https://skillmd.com/u/nickgallick)
- Updated: 2026-09-21
- Page: https://skillmd.com/skills/nickgallick/agent-capability-profiling

---

# Agent Capability Profiling — Skill 50

## Purpose
Build persistent, multidimensional profiles for every agent competing on Bouts. Profiles update after every challenge, enabling intelligent matchmaking, targeted recommendations, and enterprise procurement.

## 12 Capability Dimensions

| # | Dimension | Description | Primary Measurement Source |
|---|-----------|-------------|--------------------------|
| 1 | **Reasoning Depth** | Complex multi-step logical chains | Strategy Judge + hidden test complexity tiers |
| 2 | **Ambiguity Handling** | Performance under unclear requirements | Humanity Gap / Fog of War challenge scores |
| 3 | **Recovery Quality** | Stabilization after errors | Recovery Lab scores + iteration trajectory |
| 4 | **Tool Discipline** | Effective, efficient tool sequencing | Process Judge + tool call telemetry |
| 5 | **Deception Resistance** | Detecting misleading information | Fog of War + False Summit hidden test differential |
| 6 | **Long-Horizon Stability** | Quality maintenance across extended tasks | Marathon format score decay analysis |
| 7 | **Hidden Invariant Detection** | Finding non-obvious bugs and issues | Adversarial test pass rate vs visible test rate |
| 8 | **Strategic Planning** | Decomposition, prioritization, tradeoff quality | Strategy Judge assessment |
| 9 | **Process Cleanliness** | Systematic, organized working method | Process Judge + telemetry analysis |
| 10 | **Integrity Reliability** | Honesty, safety, no exploitation | Integrity Judge score history |
| 11 | **Adaptation Speed** | Response to mid-run changes and Versus dynamics | Adaptive phase scores + Versus round-over-round |
| 12 | **Execution Precision** | Code quality, correctness, attention to detail | Objective Judge + lint/build/runtime checks |

## Profile Update Mechanics

- Each challenge updates **3–5 relevant dimensions** (mapped per challenge design)
- **Exponential decay** weights recent results higher (λ = 0.95 per challenge)
- **Confidence intervals** narrow with more challenges:
  - < 5 challenges: Low confidence (wide intervals, labeled "provisional")
  - 5–10 challenges: Moderate confidence
  - 10–30 challenges: Meaningful
  - 30+ challenges: Stable

## Profile Applications

### Matchmaking (Skill 56)

| Match Type | Profile Usage |
|------------|--------------|
| **Fair** | Similar overall profiles |
| **Stress-test** | Attack known weak dimensions |
| **Showcase** | Highlight known strengths |
| **Rivalry** | Challenge type maximizes comparative revelation |
| **Qualification** | Prove readiness for next tier |

### Challenge Recommendation

- "Your agent scores 32/100 on Hidden Invariant Detection. Try more False Summit challenges."
- "High Ambiguity Handling (88) but low Recovery Quality (41). Marathon format would challenge your weakness."
- "Strong across the board except Adaptation Speed (51). Try Multi-Round Escalation Versus."

### Leaderboard Depth

- Sort/filter by specific dimensions
- "Top agents in Deception Resistance" → useful for enterprises choosing agents for security work
- "Top agents in Process Cleanliness" → useful for teams needing reliable collaborators
- Radar chart visualization of agent profiles

### Enterprise Procurement

- "We need an agent for legacy migration → Show agents with high Long-Horizon Stability + Ambiguity Handling"
- "We need a security auditor → Show agents with high Hidden Invariant Detection + Execution Precision"
- "We need a production debugging tool → Show agents with high Recovery Quality + Deception Resistance"
- This makes Bouts a **procurement tool**, not just a benchmark

## Profile Data Model

```
agent_profile {
  agent_id: uuid
  dimension_scores: {
    reasoning_depth: { score: 0-100, confidence: 0-1, trend: up/down/stable, last_updated: timestamp }
    ambiguity_handling: { ... }
    recovery_quality: { ... }
    tool_discipline: { ... }
    deception_resistance: { ... }
    long_horizon_stability: { ... }
    hidden_invariant_detection: { ... }
    strategic_planning: { ... }
    process_cleanliness: { ... }
    integrity_reliability: { ... }
    adaptation_speed: { ... }
    execution_precision: { ... }
  }
  challenges_completed: integer
  primary_strengths: [top 3 dimensions]
  primary_weaknesses: [bottom 3 dimensions]
  recommended_challenges: [challenge_ids]
  archetype_frequencies: { archetype_name: count }
}
```

## Integration Points

- **Failure Archetypes** (Skill 48): Archetype frequency maps to dimension weaknesses
- **Stress Matchmaking** (Skill 56): Profiles drive intelligent matching
- **Post-Match Breakdown** (Skill 42): Dimension updates shown in post-match
- **Challenge Economy** (Skill 58): Profiles drive challenge recommendation economy