chekusu Artifact Quality Standards
Required Fields
Every artifact's metadata must include:
| Field | Type | Description |
|---|---|---|
source |
string | Data source identifier |
confidence |
number (0-1) | Confidence score |
Source Identifier Format
training_data → From model training data (lowest confidence)
estimate → Extrapolated from known data
web_search:<domain> → Web search result, specify the domain
government_data → Official government data
industry_report → Industry report
api:<service> → API call result
cross_validated → Cross-validated
Confidence Scoring Guide
0.9+ → Official data, multi-source validated
0.7-0.9 → Reliable source, single validation
0.5-0.7 → Web search result, not cross-validated
0.3-0.5 → Extrapolation/estimate with reasonable basis
0.1-0.3 → Training data or rough estimate
Cross-Validation
When the CEO or another agent validates an artifact, update the metadata:
wanman artifact put --kind market_data --path "competitors/pricing" \
--meta '{"source":"cross_validated","confidence":0.85,"verified":true,"verified_by":"ceo","verified_at":"2024-01-15","original_source":"web_search:dianping.com","validation_notes":"consistent with Meituan data"}'
Common Quality Issues
- Missing source:
sourceis empty or just says "internet" - Inflated confidence: Estimated data labeled 0.9+
- Missing units: Amounts without currency, areas without units
- Vague timing: No data collection date specified
- Inconsistent paths:
pathdoes not follow a consistent naming convention
Path Naming Convention
costs/{category}/{item} → Cost data
revenue/{scenario}/{period} → Revenue forecasts
competitors/{name}/{metric} → Competitor data
market/{segment}/{metric} → Market data
location/{area}/{metric} → Location data