Run Ab Test Models

Design and execute A/B tests for ML models in production using traffic splitting, statistical significance testing, and canary/shadow deployment. Measure performance differences and make data-driven rollout decisions. Use to validate a new model before full rollout, compare candidate models from different algorithms, measure business metric impact of model changes, or meet regulatory gradual rollout requirements.

pjt222 Updated 44 repo stars

File contents

pjt222/agent-almanac commit 05e6fe4955

Frequently asked questions

npx get-skill add pjt222/run-ab-test-models-8