Download our FREE ebook of 43 A/B testing case studies from the world's leading companies for test ideas and inspiration. Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

A/B Testing Case Studies

One of the best way to come up with A/B testing ideas is to learn from the experience of others. On this page you will find A/B testing case studies and conversion rate optimization case studies from the world’s largest brands and companies. We hope these stories will inspire you and help generate test ideas you can implement on your own website.

Testing ApartmentGuide’s Mobile Site Increases Revenue and Leads

Testing ApartmentGuide’s Mobile Site Increases Revenue and Leads

ApartmentGuide.com is an online marketplace that allows property management companies to post apartments and renters and buyers to search for them. The website makes money by selling priority property placements to companies that wish to showcase their listings at the top of the site’s search results.

After seeing the popularity of ApartmentGuide.com’s mobile site take off, RentPath, the media company that owns and operates the ApartmentGuide brand, wanted to find a way to grow revenue generated from mobile users.

For Insound, Testing the 15-Year-Old Search Algorithm Drives 39% Lift

For Insound, Testing the 15-Year-Old Search Algorithm Drives 39% Lift

Insound has witnessed a fascinating shift in music buying behavior over the years. Around 2005, vinyl LPs started selling at a greater rate. By 2007 they were outselling CDs. By 2008, they accounted for the majority of all sales. As sales migrated to a new (old) format Clearhead hypothesized that the search algorithm—which had been the same for 15 years—could be optimized. They were right.

How 2 Words Lifted Insound’s Checkout Funnel Conversion to 54%

How 2 Words Lifted Insound’s Checkout Funnel Conversion to 54%

Insound came to us in a pinch. WIth just 2.5 weeks to drive results before holiday promotions launched, Insound asked my team at Clearhead to run a test to help patch a leaky checkout funnel. This test had to be 1. easy to implement and 2. high impact. Whoever says button tests are too simple to drive meaningful results might want to reconsider. Two words went a long way in this checkout funnel test on Insound.com. We put our money on “Almost Done”.

In Product Image Tests, A Wash is Sometimes a Win

In Product Image Tests, A Wash is Sometimes a Win

For online retailers, product images are paramount. Imagery must help make up for the fact that the buyer is sitting behind (or holding) a flat screen and cannot factor tactile experience into the purchase decision. Imagery possibilities can also be endless: Do you go with models or no models? 360-degree shots or static? Product videos? Which thumbnail is the best default? Experimenting with how products are displayed on your website is thus a very valuable and lucrative thing to A/B test.

Why We Switched to Optimizely

Why We Switched to Optimizely

We’re glad to welcome Cooper Maruyama, conversion rate optimization expert and founder of Landers Optimized, to the Optimizely blog for today’s guest post. The biggest difference between conversion optimization and all other sub-sectors of online marketing is the technology required to do it well. Website optimization requires qualitative analysis, via tools such as SurveyMonkey and […]

6 Best Practices from 251,391 Website Experiments (and How to Apply Them)

I’ve had the good fortune to attend several optimization talks & conferences with our CEO, Dan Siroker. One thing I admire about good speakers is their ability to distil complex ideas into simple truths.

Simple is good.

In this forum, we try to keep things short & sweet because we know you are frantically busy. After all, this is a blog—not API documentation.

With that in mind, here are Dan’s 6 “Best Practices” from 251,391 A/B and Multivariate tests

1-800-DENTIST Boosts Sign-ups by 23.3%

1-800-DENTIST Boosts Sign-ups by 23.3%

1-800-DENTIST pairs consumers with dentists in their area through online sign-ups, using a nationwide network of thousands of dental professionals. Upon entering their site, visitors input personal information in a five-step flow to match them with the best local dentist. Challenge: 1-800-DENTIST is no stranger to A/B testing. Last year, their product team used Optimizely […]