Download our FREE ebook of 43 A/B testing case studies from the world's leading companies for test ideas and inspiration. Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

X

Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more!

Get It Now

A/B Testing

A/B testing or split testing is the practice of showing two different versions of a page to users to determine which one performs better. Learn about A/B testing tips and best practices that companies have used to improve conversions on their websites and mobile apps.

Introducing the 2016 Testing Toolkit


Introducing the 2016 Testing Toolkit

We want to make sure 2016 is the your best year yet; that you make decisions grounded in data and customer understanding, and that your ambitious goals are within reach.

That’s why we’ve put together a toolkit of resources to help start or grow an A/B testing program. Whether you’re on test number one or 1,000, these tools can help make sure you run more winning experiments this year than ever before.

Trunk Club Increased Mobile App Conversions 43% By Adding This Step

Trunk Club Increased Mobile App Conversions 43% By Adding This Step

Mobile app optimization helps the Trunk Club team ensure that their app is efficient at converting browsers to customers, but it also helped them with an important discovery—finding the right customers to focus on, which means stylists can focus their attention on customers that are most likely to purchase clothing from their trunks.

Headline A/B Testing to Boost Ad Impressions: A Case Study from Ringier

Headline A/B Testing to Boost Ad Impressions: A Case Study from Ringier

Blick, the leading online and print tabloid in Switzerland, has boldly ventured into unchartered territory for most in the media industry: editorial A/B testing. By experimenting with headlines and teaser images, Blick’s editorial team is able to better understand what readers are most interested in, in real time.

How Discovery Increased Ad Viewability & CTR Through A/B Testing

How Discovery Increased Ad Viewability & CTR Through A/B Testing

Discovery Communications is a global mass media and entertainment company with an astonishing portfolio of television networks, including the Discovery Channel, Animal Planet, TLC, the Oprah Winfrey Network, and Science Channel. It has 2.9 billion global subscribers, a reach that totals 2 in 5 people on the planet.

The product team at Discovery Communications is driven by testing; they’re constantly iterating on their user experience to improve both content engagement and their display ad metrics.

3 Tips on Mastering Mobile App A/B Testing


3 Tips on Mastering Mobile App A/B Testing

One of the tools app developers and mobile product managers are increasingly adding to their toolkits is A/B testing. Having a discipline around A/B testing enables mobile app makers to deliver engaging, high-ROI experiences by optimizing elements like signup flows, checkout funnels, and navigational elements, to name a few.

Here are three simple yet effective tips for those just getting started with mobile A/B testing from the mobile product managers who own testing at Pinterest, CheapOAir, What to Expect, and Credit Sesame.

How Testing Everything Transformed Blu Dot’s Retail Business

How Testing Everything Transformed Blu Dot’s Retail Business

Blu Dot tests everything. Really. I know what you’re thinking. Is testing everything possible? Is it even practical? The answer is yes on both counts. This is the very true story of a company that, within two years, evolved from never having conducted a split test to an organization that is continuously developing, prioritizing and validating hypotheses—big and small, broad and targeted.

Brainstorm Your Next A/B Test — In 1 Minute

Brainstorm Your Next A/B Test — In 1 Minute

For this week’s One Minute Monday, Ryan Krebs from our Partnerships team shares advice on coming up with your next test idea.

See this napkin? This is they key to your testing success because it is a canvas for your testing ideas. Ideation is an important part of testing. To get started thinking about test ideas, we recommend you first identify your key business metrics on your website and then start brainstorming tests to affect them.

5 Onboarding Techniques to Convert Trials into Paying Customers

5 Onboarding Techniques to Convert Trials into Paying Customers

If the sign-up rate for your product’s free trial is high, then you’re doing something right. It’s a great sign if people are willing to take time and give up some information to try out your software for a few weeks.

But are they really trying it? Are they making full use of the trial or just taking a quick glance and disappearing?

Benchmark data says 80% of your free trial users are doing just that — fading away never to become a paying customer.

The truth is that turning free trial users into paying customers is just as important as getting people to try your product. These are five examples of email marketing and A/B testing strategies that can improve your company’s free trial to paying customer conversion rates.

Targeting Your Test to Specific URLs — In 1 Minute

Targeting Your Test to Specific URLs — In 1 Minute

One of the most important parts of setting up an experiment is deciding where you want it to run, as in which pages specifically are you deciding to target. You can be as narrow as a single URL or as broad as your entire site. It all depends on which of the four URL match types you use. In this One Minute Monday, we’ll cover what these match types mean and why they’re important for you.

21 Ideas to Increase Revenue From Your Online Store

21 Ideas to Increase Revenue From Your Online Store

The bad news: If you have an e-commerce website, mobile site, or mobile app, it’s likely that up to 72% of shoppers abandon their shopping cart before completing a purchase in your store.

The good news: This post (and a little optimization) will help you fix that.

Here at Optimizely, we work with a number of retail teams who are experimenting with new and unique ways to drive revenue from their online stores. I recently spoke with several of these retailers and others experts to learn about their successes and failures, and have combined my findings into our latest long read: The Ultimate Guide to Optimizing Your Online Store.

This post summarizes some of the test ideas retailers have found most impactful for optimizing the experience they deliver shoppers.