Alignment Tipping Process Agent Safety

Identify and mitigate alignment degradation in self-evolving LLM agents. After deployment, agents systematically abandon training-time safety constraints when environmental feedback rewards rule-breaking. Model two mechanisms: Self-Interested Exploration (individual drift) and Imitative Strategy Diffusion (collective norm erosion), with practical safeguards for post-deployment monitoring.

adu2021 Updated 7 repo stars

File contents

adu2021/skillxiv commit daea8dc52d

Frequently asked questions

npx get-skill add adu2021/alignment-tipping-process-agent-safety