One of the best way to come up with A/B testing ideas is to learn from the experience of others. On this page you will find A/B testing case studies and conversion rate optimization case studies from the world’s largest brands and companies. We hope these stories will inspire you and help generate test ideas you can implement on your own website.
ApartmentGuide.com is an online marketplace that allows property management companies to post apartments and renters and buyers to search for them. The website makes money by selling priority property placements to companies that wish to showcase their listings at the top of the site’s search results.
After seeing the popularity of ApartmentGuide.com’s mobile site take off, RentPath, the media company that owns and operates the ApartmentGuide brand, wanted to find a way to grow revenue generated from mobile users.
Insound has witnessed a fascinating shift in music buying behavior over the years. Around 2005, vinyl LPs started selling at a greater rate. By 2007 they were outselling CDs. By 2008, they accounted for the majority of all sales. As sales migrated to a new (old) format Clearhead hypothesized that the search algorithm—which had been the same for 15 years—could be optimized. They were right.
Whenever possible, product managers at The Guardian make decisions about functionality and design on news pages and other web properties with A/B tests. Through a combination of A/B and user testing, PM Kerstin Exner dramatically improved paid subscription conversions for The Guardians’ online dating site, Soulmates.
Insound came to us in a pinch. WIth just 2.5 weeks to drive results before holiday promotions launched, Insound asked my team at Clearhead to run a test to help patch a leaky checkout funnel. This test had to be 1. easy to implement and 2. high impact. Whoever says button tests are too simple to drive meaningful results might want to reconsider. Two words went a long way in this checkout funnel test on Insound.com. We put our money on “Almost Done”.
For online retailers, product images are paramount. Imagery must help make up for the fact that the buyer is sitting behind (or holding) a flat screen and cannot factor tactile experience into the purchase decision. Imagery possibilities can also be endless: Do you go with models or no models? 360-degree shots or static? Product videos? Which thumbnail is the best default? Experimenting with how products are displayed on your website is thus a very valuable and lucrative thing to A/B test.
uSell.com is an online marketplace for customers to sell their smartphones and other used electronics. To gauge customer interest in selling new products to validate business expansion plan, the team at uSell ran an A/B test measuring conversions on electronics with addition of new products to sell. This is the story of that test, the […]
We’re glad to welcome Cooper Maruyama, conversion rate optimization expert and founder of Landers Optimized, to the Optimizely blog for today’s guest post. The biggest difference between conversion optimization and all other sub-sectors of online marketing is the technology required to do it well. Website optimization requires qualitative analysis, via tools such as SurveyMonkey and […]
SimCity 5 sold 1.1 million copies in the first two weeks of its launch in March 2013. 50% of sales were digital downloads. For EA, A/B testing was an integral to the release’s digital success. Here is the story of how the product team at Maxis, who managed SimCity’s release, used Optimizely to amplify sales.
I’ve had the good fortune to attend several optimization talks & conferences with our CEO, Dan Siroker. One thing I admire about good speakers is their ability to distil complex ideas into simple truths.
Simple is good.
In this forum, we try to keep things short & sweet because we know you are frantically busy. After all, this is a blog—not API documentation.
With that in mind, here are Dan’s 6 “Best Practices” from 251,391 A/B and Multivariate tests
1-800-DENTIST pairs consumers with dentists in their area through online sign-ups, using a nationwide network of thousands of dental professionals. Upon entering their site, visitors input personal information in a five-step flow to match them with the best local dentist. Challenge: 1-800-DENTIST is no stranger to A/B testing. Last year, their product team used Optimizely […]