assess-sensitivity
Purpose
Perturb a specified input, assumption, model choice, analysis choice, or weight and measure the resulting output sensitivity.
Input contract
required: [baseline_input, perturbation_axes, output, comparison_metric]
optional: [assumptions, perturbation_design, uncertainty_model, baseline_ranking]
constraints: [each perturbation is attributable to one declared axis; the output comparison metric is fixed before evaluation; preserve the caller's scale and direction]
Procedure
- Define the baseline input, output, perturbation axes, and comparison metric.
- Generate the caller-specified perturbation scenarios, including weight or leave-one-out variants where applicable.
- Recompute the output for each scenario and retain the scenario-level evidence.
- Compare scenarios, identify unstable regions and dominant drivers, and classify convergence or instability.
- Return a sensitivity report with rankings, effect magnitudes, and rationale.
Output contract
produces: [sensitivity_report, scenario_results, instability_regions, dominant_drivers, stability_verdict]
delta_fields: [findings, evidence_updates, decisions, uncertainties]
Quality gates
- Preserve source weight perturbation of +/-20% per dimension, weight-vector sum 1.0 with +/-0.001 tolerance, at least 4 scenarios, and stability labels
stable/sensitive/unstable with $\tau$ bands >=0.8, 0.5-<0.8, and <0.5.
- Rank comparison reports at least one Kendall $\tau$ or Spearman $\rho$ and all alternatives differing by >=2 positions.
- Conclusion sensitivity rates every assumption, identifies critical assumptions, reports interaction effects, and gives an overall robustness rating.
- Fragility index retains 0.0 as robust and 1.0 as extremely fragile; do not reinterpret it as a probability.
Parameterization
The caller must provide the baseline object/output, perturbable axes, scenario generator or bounds, comparison metric, stability labels, and any fixed statistical bands. For ranking calls provide the normalized weight vector and scoring matrix; for conclusion calls provide assumptions and challenged variants; for meta-analysis calls provide included studies, outliers, and subgroup variables.
Failure and counterexamples
Reject when the baseline is undefined, scenarios change more than one undeclared axis, the comparison metric is missing, or a stability verdict is given without scenario results. Do not infer causal dominance from sensitivity alone.
Provenance map
- resolved: hypothesis-formation/weight-perturbation
- resolved: convergence/rank-comparison
- resolved: convergence/method-sensitivity-report
- resolved: deep-insight/conclusion-sensitivity-measurement
- resolved: stress-test/fragility-measurement
- resolved: convergence/conclusion-sensitivity
- resolved: knowledge-acquisition/sensitivity-analysis-design
- intermediate: Pass3/assess-rank-robustness
- intermediate: Pass3/measure-sensitivity
- intermediate: Pass3/design-meta-sensitivity
- resolved: deep-insight/convergence-assessment
Verbatim source criteria excerpts
weight-perturbation line 22: The elements of the input weight vector must sum to 1.0 (+/-0.001 tolerance allowed)
weight-perturbation line 23: The number of rows in the scoring matrix (number of gaps) must be >= 2
weight-perturbation line 24: At least 4 perturbation scenarios must be generated (+/-20% per dimension)
weight-perturbation line 35: stable (all scenarios $\tau$ >= 0.8) / sensitive (any scenario 0.5 <= $\tau$ < 0.8) / unstable (any scenario $\tau$ < 0.5)
rank-comparison line 27: Must report at least one rank correlation metric (Kendall tau or Spearman rho), and must list all alternatives with ranking differences >= 2 positions.
conclusion-sensitivity line 24: Must consider interaction effects between assumptions.
fragility-measurement line 33: fragility_index: Overall fragility (0.0 = robust, 1.0 = extremely fragile)
Preserved source criteria ledger
| source |
physical line |
kind |
source criterion |
| hypothesis-formation/weight-perturbation |
14 |
numeric |
Weight vector sums to 1.0 (+/-0.001); scoring matrix has >=2 rows; at least 4 perturbation scenarios; verdict is stable/sensitive/unstable. |
| hypothesis-formation/weight-perturbation |
21 |
numeric |
Apply +/-20% perturbations per dimension; stable means all $\tau$ >=0.8, sensitive means any 0.5<=$\tau$<0.8, unstable means any $\tau$<0.5. |
| convergence/rank-comparison |
22 |
numeric |
Report Kendall tau or Spearman rho and all alternatives with ranking differences >=2 positions. |
| convergence/conclusion-sensitivity |
23 |
gate |
Every assumption receives a sensitivity rating; identify critical assumptions, interaction effects, and overall robustness. |
| stress-test/fragility-measurement |
20 |
numeric |
Fragility index ranges from 0.0 robust to 1.0 extremely fragile. |
1---2name: assess-sensitivity3description: "Perturb a specified input, assumption, model choice, analysis choice, or weight and measure sensitivity of a specified output; report convergence/instability, unstable regions, and dominant drivers."4metadata:5 source: https://skillmd.com/skills/yogsoth-ai/assess-sensitivity6---78# assess-sensitivity910## Purpose1112Perturb a specified input, assumption, model choice, analysis choice, or weight and measure the resulting output sensitivity.1314## Input contract1516```yaml17required: [baseline_input, perturbation_axes, output, comparison_metric]18optional: [assumptions, perturbation_design, uncertainty_model, baseline_ranking]19constraints: [each perturbation is attributable to one declared axis; the output comparison metric is fixed before evaluation; preserve the caller's scale and direction]20```2122## Procedure23241. Define the baseline input, output, perturbation axes, and comparison metric.252. Generate the caller-specified perturbation scenarios, including weight or leave-one-out variants where applicable.263. Recompute the output for each scenario and retain the scenario-level evidence.274. Compare scenarios, identify unstable regions and dominant drivers, and classify convergence or instability.285. Return a sensitivity report with rankings, effect magnitudes, and rationale.2930## Output contract3132```yaml33produces: [sensitivity_report, scenario_results, instability_regions, dominant_drivers, stability_verdict]34delta_fields: [findings, evidence_updates, decisions, uncertainties]35```3637## Quality gates3839- Preserve source weight perturbation of +/-20% per dimension, weight-vector sum 1.0 with +/-0.001 tolerance, at least 4 scenarios, and stability labels `stable`/`sensitive`/`unstable` with $\tau$ bands >=0.8, 0.5-<0.8, and <0.5.40- Rank comparison reports at least one Kendall $\tau$ or Spearman $\rho$ and all alternatives differing by >=2 positions.41- Conclusion sensitivity rates every assumption, identifies critical assumptions, reports interaction effects, and gives an overall robustness rating.42- Fragility index retains 0.0 as robust and 1.0 as extremely fragile; do not reinterpret it as a probability.4344## Parameterization4546The caller must provide the baseline object/output, perturbable axes, scenario generator or bounds, comparison metric, stability labels, and any fixed statistical bands. For ranking calls provide the normalized weight vector and scoring matrix; for conclusion calls provide assumptions and challenged variants; for meta-analysis calls provide included studies, outliers, and subgroup variables.4748## Failure and counterexamples4950Reject when the baseline is undefined, scenarios change more than one undeclared axis, the comparison metric is missing, or a stability verdict is given without scenario results. Do not infer causal dominance from sensitivity alone.5152## Provenance map5354- resolved: hypothesis-formation/weight-perturbation55- resolved: convergence/rank-comparison56- resolved: convergence/method-sensitivity-report57- resolved: deep-insight/conclusion-sensitivity-measurement58- resolved: stress-test/fragility-measurement59- resolved: convergence/conclusion-sensitivity60- resolved: knowledge-acquisition/sensitivity-analysis-design61- intermediate: Pass3/assess-rank-robustness62- intermediate: Pass3/measure-sensitivity63- intermediate: Pass3/design-meta-sensitivity64- resolved: deep-insight/convergence-assessment6566## Verbatim source criteria excerpts6768- `weight-perturbation` line 22: The elements of the input weight vector must sum to 1.0 (+/-0.001 tolerance allowed)69- `weight-perturbation` line 23: The number of rows in the scoring matrix (number of gaps) must be >= 270- `weight-perturbation` line 24: At least 4 perturbation scenarios must be generated (+/-20% per dimension)71- `weight-perturbation` line 35: stable (all scenarios $\tau$ >= 0.8) / sensitive (any scenario 0.5 <= $\tau$ < 0.8) / unstable (any scenario $\tau$ < 0.5)72- `rank-comparison` line 27: Must report at least one rank correlation metric (Kendall tau or Spearman rho), and must list all alternatives with ranking differences >= 2 positions.73- `conclusion-sensitivity` line 24: Must consider interaction effects between assumptions.74- `fragility-measurement` line 33: fragility_index: Overall fragility (0.0 = robust, 1.0 = extremely fragile)7576## Preserved source criteria ledger7778| source | physical line | kind | source criterion |79|---|---:|---|---|80| hypothesis-formation/weight-perturbation | 14 | numeric | Weight vector sums to 1.0 (+/-0.001); scoring matrix has >=2 rows; at least 4 perturbation scenarios; verdict is stable/sensitive/unstable. |81| hypothesis-formation/weight-perturbation | 21 | numeric | Apply +/-20% perturbations per dimension; stable means all $\tau$ >=0.8, sensitive means any 0.5<=$\tau$<0.8, unstable means any $\tau$<0.5. |82| convergence/rank-comparison | 22 | numeric | Report Kendall tau or Spearman rho and all alternatives with ranking differences >=2 positions. |83| convergence/conclusion-sensitivity | 23 | gate | Every assumption receives a sensitivity rating; identify critical assumptions, interaction effects, and overall robustness. |84| stress-test/fragility-measurement | 20 | numeric | Fragility index ranges from 0.0 robust to 1.0 extremely fragile. |