article thumbnail

Multi-Armed Bandit: When to Do Bandit Tests Instead of A/B Tests

ConversionXL

First, let’s dive into bandit testing and talk a bit about the history of the N-armed bandit problem. What is bandit testing? The practical differences between A/B testing and bandit testing Explore-exploit Benefits of bandit testing A few flavors of bandit methodology Epsilon-greedy method What about other algorithms?

article thumbnail

A/B testing alternatives for low-traffic websites

ConversionXL

In a world where A/B tests are done by over 70% of online businesses , choosing not to follow a data-driven methodology to make informed decisions on website changes might seem unreasonable. Or if your management refuses to justify the costs of A/B testing? Alternatives to A/B testing for low-traffic sites.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

What Does A/B Testing Have to do with Machine Learning?

Hubspot

To some marketers, A/B tests are a no-brainer. Even though the test is a timeless marketing technique, it can be a little frustrating because of the uncertainty of it all. Thankfully, there's an unlikely superhero to point to when we're talking about the upgrades to a regular A/B test — machine learning.

article thumbnail

How to Minimize A/B Test Validity Threats

ConversionXL

You have an A/B testing tool, a well-researched hypothesis and a winning test with 95% confidence. There are factors threatening the validity of your test, without you even realizing it. Quite simply, validity threats are the factors that threaten the validity of your A/B test results. Not so fast.

article thumbnail

Ignorant No More: Crash Course on A/B Testing Statistics

ConversionXL

If you don’t know basic statistics, you won’t be able to tell whether your tests suck. Why Do I Need to Know A/B Testing Statistics? It’s probably a lot more fun to put up a test between a red and green button and wait until your testing tool tells you one of them has beat the other.

article thumbnail

What Can You Do With Other People’s A/B Test Results? [Rant]

ConversionXL

Lots of people on the internet are running tests, can I just copy their winning tests? Let other people do the failing, I’ll just test (or implement) the winning stuff. The thing is – other people’s A/B tests results are useless. So testing something okay against a stupid idea is likely to work.

article thumbnail

11 Things That Work More Often Than Not in A/B Tests

ConversionXL

Whether you’re just starting your first a/b tests or you’re just looking for continuous and never ending improvements, these tactics are worth a look. At the very least, question your assumptions and give ‘em a test. For brands, during our autoplay tests we saw a 7x increase in completions of Promoted Videos.