Capability Taxonomy Mapping SOP
Build a hierarchical capability taxonomy for a domain and map existing benchmark coverage onto it to identify gaps and redundancies.
Input
- domain: The capability domain to taxonomize (e.g., "language understanding", "visual reasoning")
- existing_benchmarks: List of known benchmarks in the domain with brief descriptions
Procedure
- Construct hierarchical capability taxonomy from literature
- Map each benchmark to taxonomy nodes it covers
- Compute coverage density per node
- Identify white spaces (uncovered capabilities)
- Identify redundancy clusters (over-covered capabilities)
Output
Annotated taxonomy tree with coverage statistics and prioritized gaps.