Run Ab Test Models

Design and execute A/B tests for ML models in production using traffic splitting, statistical significance testing, and canary/shadow deployment strategies. Measure performance differences and make data-driven decisions about model rollout. Use when validating a new model version before full rollout, comparing candidate models trained with different algorithms, measuring business metric impact of model changes, or when regulatory requirements mandate gradual rollout.

pjt222 Updated 44 repo stars

File contents

pjt222/agent-almanac commit 62de1e706f

Frequently asked questions

npx get-skill add pjt222/run-ab-test-models-2