article thumbnail

Multi-Armed Bandit: When to Do Bandit Tests Instead of A/B Tests

ConversionXL

First, let’s dive into bandit testing and talk a bit about the history of the N-armed bandit problem. What is bandit testing? The practical differences between A/B testing and bandit testing Explore-exploit Benefits of bandit testing A few flavors of bandit methodology Epsilon-greedy method What about other algorithms?

article thumbnail

How to Estimate a “Net Value” for Your A/B Testing Program

ConversionXL

In my experience, I find that teams and organizations report many winning A/B tests with high uplifts, but somehow they don’t seem to bring those uplifts in reality. Five types of A/B test “wins” can exaggerate discovered uplifts. That results in an ROI of 500% and a gross profit on DeFacto’s A/B tests of $2 million.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

9 things to do when SEO is great but sales and leads are terrible

Search Engine Land

Improve your site’s user experience (UX) UX and SEO have been talked about for years and are intrinsically linked, but many sites still haven’t spent time improving UX. Landing pages : If your landing pages aren’t converting, begin A/B testing them. An SEO specialist can help you: Identify which page elements to test (e.g.,

article thumbnail

When to Run Bandit Tests Instead of A/B/n Tests

ConversionXL

As Andrew Anderson said in an Adobe article : Andrew Anderson: “In an ideal world, you would already know all possible values, be able to intrinsically call the value of each action, and then apply all your resources towards that one action that causes you the greatest return (a greedy action). 12:01 visitor B sees Variation 2.

article thumbnail

How to Get More Followers on Instagram (Without Buying Them)

ConversionXL

We’re intrinsically wired to connect with one another, and understanding the importance of these social bonds is a surefire way to drive engagement and loyalty. Here are some ways you can apply the metrics you are tracking to your Instagram strategy: A/B test different messaging and creative versions in your Instagram story.

Niche 152
article thumbnail

When “Free” Converts (and When It Doesn’t)

ConversionXL

And we’ve mentioned in the past, free shipping is something that works more often than not in conversion optimization (though it’s an important operations decision, not just a quick A/B test). As CityLab put it , “We gravitate towards the free choice, regardless of its intrinsic value.”.

article thumbnail

2 Data-Driven Frameworks We Use to Optimize Sales Engagement

SalesLoft

Were I focused on the inputs, I would have fleshed out the issue tree to include facets of intrinsic and extrinsic motivation. Similarly, our sales development reps have limited influence on which cadences they run since those are optimized via A/B testing. In contrast, high effectiveness results mostly from skill.