Optimizely Blog

Grow your Optimization and A/B testing skills

X

Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more!

Get It Now

A/B Testing Best Practices

A/B testing best practices and case studies from the CRO experts. Start improving your conversion rates today by following these tips and processes.

Avoid Wasting Resources with this 7-Step A/B Testing Process

Avoid Wasting Resources with this 7-Step A/B Testing Process

After optimizing for digital media audiences at Sky and Daily­­motion, I’ve learned the importance of a strong A/B testing process to drive effective optimization. Follow this 7-step process for effective A/B testing to ensure that your tests are meaningful, that resources are not wasted, and that you know what to expect each and every time you get ready to run an experiment.

4 Steps for Creating a Problem-Centric Split Test Hypothesis

4 Steps for Creating a Problem-Centric Split Test Hypothesis

Hypotheses are the statements that clarify our thinking leading up to a test. They make a clear prediction about how changes in customer experiences will impact a given goal. They provide a rationale for why customers might react positively or negatively to that change.

But even with standard hypothesis best practices, there are opportunities to elevate your testing, align your hypothesis with challenges that are core to your business, and increase the odds of producing a positive result. It starts with identifying problems.

Is Your Website Traffic Ruining Your A/B Tests?

Is Your Website Traffic Ruining Your A/B Tests?

A/B testing can transform your business into a polished science. Remember the scientific method from 8th-grade science? Well, a good A/B test meets all of those criteria and—if you set your tests up correctly—your results will tell you exactly what works for your customers…and what doesn’t. Assuming of course, that you’re testing your customers.

Unfortunately, getting traffic to your site isn’t the same thing as getting the right traffic to your site. The right traffic is qualified to buy what you’re selling and interested in converting. The wrong traffic…isn’t.

Conversion Rate Optimization Best Practice: Ignore Best Practices

Conversion Rate Optimization Best Practice: Ignore Best Practices

Why do marketers insist on looking for “best practices” and “conversion optimization tips” that simply don’t work? Conversion rate optimization (CRO) is context-specific which is why not adhering to specific conversion rate optimization best practices is a best practice.

A structured process is your best chance at getting valid results you can use to build your internal team and take your marketing efforts to the next level.

A/B Testing for Low Traffic Websites

It takes a lot of traffic to get statistically significant results for A/B tests. High-traffic websites like Google and Facebook should A/B test everything, but low-traffic websites shouldn’t bother.

At least that’s how the argument goes. But I would like to offer a different perspective. I think low-traffic websites should A/B test, not only because doing so has enormous cultural benefits, but also because A/B testing does work for low-traffic sites.

Apply Emotions and Learn More from Your A/B Tests

Apply Emotions and Learn More from Your A/B Tests

A large opportunity for improvement exists in the realm of optimization. Most marketers optimize their websites and campaigns on pure intuition alone.

A/B testing can be so much more. It can help us tap into our customer’s emotional needs, goals and help us build a better customer journey. To do this you have to test differently. Instead of testing elements, you need to start testing concepts using behavioural and emotional methodologies.

3 Tips to Improve Your A/B Testing Process

3 Tips to Improve Your A/B Testing Process

In the long-term, your A/B testing process is one of the most important factors driving performance of your conversion optimization efforts.

I want to share three tips that will make your A/B testing process more impactful. We use these techniques on daily basis to convince companies to invest in CRO, spot real customer problems, and run long-term optimization programs more efficiently.

3 A/B Testing Case Studies on Seeking The Global Maximum

3 A/B Testing Case Studies on Seeking The Global Maximum

As the following case studies reveal, there are huge wins to be had from thinking big and being open to questioning the status quo. There are also important revelations lurking in smaller tests that can point the way to a major redesign. And sometimes testing is the only way to find true north amidst the chaos and confusion of major changes.