article thumbnail

How to Minimize A/B Test Validity Threats

ConversionXL

You have an A/B testing tool, a well-researched hypothesis and a winning test with 95% confidence. There are factors threatening the validity of your test, without you even realizing it. Quite simply, validity threats are the factors that threaten the validity of your A/B test results. Not so fast.

article thumbnail

From guesswork to growth: How to build a customer-centric marketing strategy

Martech

Then, we A/B test and build complex funnels, thinking this is data-driven when it’s fundamentally assumption-driven. Through 1:1 interviews tracking how early users found their service, they discovered two critical insights to drive 3,900% growth in 15 months. These insights completely reshaped Dropboxs marketing strategy.

Growth 106
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How to Use A/B Testing and Personalization Best Together

ConversionXL

If you ask most marketers, they will tell you that A/B testing and personalization are two completely different things. We as growth/performance marketers are accountable for results, often measured with conversions, new customers, or revenue. Why and when you should use A/B testing and personalization.

article thumbnail

What is A/B Testing? The Complete Guide: From Beginner to Pro

ConversionXL

A/B testing splits traffic 50/50 between a control and a variation. A/B split testing is a new term for an old technique — controlled experimentation. Yet for all the content out there about it, people still test the wrong things and run A/B tests incorrectly. Table of contents What is A/B testing?

article thumbnail

How to Estimate a “Net Value” for Your A/B Testing Program

ConversionXL

In my experience, I find that teams and organizations report many winning A/B tests with high uplifts, but somehow they don’t seem to bring those uplifts in reality. Five types of A/B test “wins” can exaggerate discovered uplifts. That results in an ROI of 500% and a gross profit on DeFacto’s A/B tests of $2 million.

article thumbnail

PXL: A Better Way to Prioritize Your A/B Tests

ConversionXL

If you’re doing it right, you probably have a large list of A/B testing ideas in your pipeline. We can’t test everything at once, and we all have a limited amount of traffic. You should have a way to prioritize all these ideas in a way that gets you to test the highest potential ideas first. Try it out here.

article thumbnail

The biggest ideal customer profile mistakes businesses make — and how to fix them

Martech

They will use various tactics to find them — website analytics, buyer persona workshops, lookalike modeling, A/B testing and even “intuition.” As they develop an ideal customer persona, they do it without the most critical element to driving scaled growth in organizations — profitability. It’s unsustainable.