-
Notifications
You must be signed in to change notification settings - Fork 0
Testing Scripts
John Williams edited this page Mar 13, 2026
·
1 revision
Statistical A/B testing framework for ad creative. Labels ads as control/variant, tracks performance over a configurable window, calculates statistical significance, and recommends winners when confidence thresholds are met.
Ad rotation performance analysis. Compares ad variants within ad groups to identify statistically significant performance differences.
- Run tests for at least 2-4 weeks to accumulate sufficient data
- Only test one variable at a time (headline, description, CTA)
- Use the script's confidence threshold — don't declare winners prematurely
- Pin winning elements and test the next variable