Steeringsafety Eval

steeringsafety-eval

SteeringSafety: A Systematic Safety Evaluation Framework of Representation Steering in LLMs — Siu et al. (2025) (arXiv:2509.13450, 2025)

What this evaluates

This framework evaluates the effectiveness of representation steering methods in modifying specific safety behaviors (harmfulness, hallucination, bias) while measuring cross-perspective entanglement. It probes whether steering interventions achieve their target behavioral changes without causing unintended degradation in other safety or reasoning capabilities.

Datasets

• SteeringSafety Benchmark (17 datasets) — total ?; splits: train (-1), val (-1), test (-1); repo https://github.com/wang-research-lab/SteeringSafety

Metrics

• effectiveness (primary) — range: percent
  • Measures the improvement on the target behavior (e.g., accuracy increase for harmfulness, reduction rate for hallucination/bias) compared to the unsteered baseline.
• entanglement — range: percent
  • Quantifies unintended changes across all other safety perspectives when steering a target behavior, calculated as the average deviation from baseline performance on non-target metrics.
• effectiveness-entanglement ratio — range: other
  • The ratio of effectiveness to entanglement, where higher values indicate better trade-offs (greater safety improvement per unit of side effects).

Input / output format

Input: Text prompts from curated datasets targeting specific safety perspectives (harmfulness, hallucination, bias) and neutral prompts (e.g., Alpaca) for KL divergence checks.

Output: Model-generated text responses to each prompt.

Scoring recipe

# Effectiveness: improvement on target behavior vs baseline
effectiveness = (steered_acc - baseline_acc) / baseline_acc
# Entanglement: average absolute deviation across non-target perspectives
entanglement = sum(abs(steered_acc_p - baseline_acc_p) for p in non_target) / len(non_target)
# Tradeoff ratio
ratio = effectiveness / entanglement if entanglement > 0 else float('inf')
return effectiveness, entanglement, ratio

Common pitfalls

• KL divergence filtering on neutral prompts (Alpaca) trades effectiveness for safety but can cause conditional steering to activate too frequently on bias prompts, skewing results.
• Entanglement is highly model- and perspective-dependent; averaging across models or perspectives can mask severe, targeted degradation (e.g., social behaviors dropping up to 76%).
• Hallucination steering effectiveness varies drastically by model and hallucination type (intrinsic vs. extrinsic), making cross-model generalization unreliable.

Evidence (verbatim from paper)

For each perspective, we measure both effectiveness (improvement on the target behavior) and entanglement (unintended changes across all other safety perspectives). Our analysis addresses three key questions: (1) Which steering methods and models achieve the highest effectiveness? (2) What patterns of safety entanglement emerge across different interventions? (3) What are the practical tradeoffs between effectiveness and entanglement?

Citation

@misc{siu2025steeringsafety,
  title={SteeringSafety: A Systematic Safety Evaluation Framework of Representation Steering in LLMs},
  author={Siu et al. (2025)},
  year={2025},
  note={arXiv:2509.13450}
}

• arXiv: 2509.13450