ConversionXL

DECEMBER 13, 2022

A/B testing splits traffic 50/50 between a control and a variation. A/B split testing is a new term for an old technique — controlled experimentation. Yet for all the content out there about it, people still test the wrong things and run A/B tests incorrectly. Table of contents What is A/B testing?

A/B testing 127

A/B testing Objectives and Key Results X-functional Represent 127

ConversionXL

SEPTEMBER 15, 2017

A/B testing tools like Optimizely or VWO make testing easy, and that’s about it. They’re tools to run tests, and not exactly designed for post-test analysis. Most testing tools have gotten better at it over the years, but still lack what you can do with Google Analytics – which is like everything.

A/B testing 123

A/B testing X-functional Trust Represent 123

ConversionXL

DECEMBER 2, 2015

A/B testing – for all the content out there about testing, huge amounts of people still mess it up. From testing the wrong things to running the tests incorrectly, there are lots of ways to get it wrong. What is A/B testing and How Does It Work? What to Test to Improve Our Chances of Winning?

A/B testing 88

A/B testing X-functional Objectives and Key Results Represent 88

ConversionXL

JULY 30, 2018

You are probably ending your A/B tests either too early or too late. The standard best practice in the conversion optimization industry is to wait until two conditions have been met before ending an A/B test. First, that a representative sample is obtained. The test has been running for two months.

A/B testing 100

A/B testing X-functional Represent Conversion 100

ConversionXL

FEBRUARY 7, 2017

.” Outliers could contain valuable information, they could be meaningless aberrations caused by measurement and recording errors, they could cause problems with repeatable A/B test results. How Outliers Affect A/B Testing. You can easily imagine anecdotally how outliers could affect a single A/B test result.

A/B testing 84

A/B testing X-functional Represent Follow-up 84

ConversionXL

NOVEMBER 9, 2022

Representing data to stakeholders and team members to understand the market, progress, financials, etc. I interviewed Tina Donati, Head of Marketing at Alloy Automation, to learn how each marketing function can use data visuals: Use data visuals internally—extensively. Marketers use data visuals in two ways: Internally. Externally.

Objectives and Key Results 110

Objectives and Key Results Represent Presentation Promote 110

ConversionXL

DECEMBER 7, 2016

Now, jump to 2015: according to a study published by VentureBeat last year , 77% of “digital natives” (roughly, generation Y and a huge part of X) expect their online experience to be personalized. Netflix, for instance, uses A/B tests extensively for home screen layouts on different platforms, featured shows, and even movie artworks.

UX 115

UX Technique Conversion Product 115