Holdout ‐ A/B Testing & CRO
- by Swicelso OÜ
- From $79/month. Free trial available.
- by Swicelso OÜ
- From $79/month. Free trial available.
Run A/B tests on your storefront without editing theme code. Launch changes safely, measure results, and promote winners only when data proves it works.
Claim app
Verify your developer profile to earn a badge and build trust to your apps
About the Holdout ‐ A/B Testing & CRO
Holdout runs A/B tests on your Shopify storefront without editing theme code. Describe the change you want to test, preview both versions, select your audience and conversion goal, then launch your experiment.
The app measures key metrics including conversion rate, revenue per visitor, add-to-cart rate, and order value. Changes run at display time and leave no code behind in your theme files. When a test reaches statistical significance, Holdout applies the winning version as a runtime rule you can roll back with one click.
Every A/B test follows a minimum duration and calibrated threshold. If the data doesn't meet these standards, Holdout reports it honestly instead of declaring a false winner. Test promotion stays locked until duration, volume, and data checks all pass. You can revert to the original version at any point during or after the test.
Launched: September 28, 2026
Key features
- No theme code. Changes run at display time and leave nothing behind.
- Promotion stays locked until duration, volume and data checks all pass.
- Roll back to the original version in one click, at any point in the test.
Integrations with:
- Checkout,
- Shopify Admin
Category:
Pricing of Holdout ‐ A/B Testing & CRO
Starter
$79 / month
or $624/year and save 34%
- Every test type, price tests included
- 20,000 tested visitors / month
- 3 concurrent tests
- 200 AI suggestions / month
- Data exports
Growth
$149 / month
or $1,188/year and save 34%
- Every test type, price tests included
- 100,000 tested visitors / month
- 10 concurrent tests
- 1,000 AI suggestions / month
- Segment analysis and data exports
- Guided onboarding call
Pro
$349 / month
or $2,784/year and save 34%
- Every test type, price tests included
- 400,000 tested visitors / month
- 50 concurrent tests
- 5,000 AI suggestions / month
- Segment analysis and data exports
- Guided onboarding call
- Monthly review of your running tests
- Priority support, same business day