Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more! Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

X

Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more!

Get It Now

A/B Testing Best Practices

A/B testing best practices and case studies from the CRO experts. Start improving your conversion rates today by following these tips and processes.

Avoid Wasting Resources with this 7-Step A/B Testing Process

Avoid Wasting Resources with this 7-Step A/B Testing Process

After optimizing for digital media audiences at Sky and Daily­­motion, I’ve learned the importance of a strong A/B testing process to drive effective optimization. Follow this 7-step process for effective A/B testing to ensure that your tests are meaningful, that resources are not wasted, and that you know what to expect each and every time you get ready to run an experiment.

4 Steps for Creating a Problem-Centric Split Test Hypothesis

4 Steps for Creating a Problem-Centric Split Test Hypothesis

Hypotheses are the statements that clarify our thinking leading up to a test. They make a clear prediction about how changes in customer experiences will impact a given goal. They provide a rationale for why customers might react positively or negatively to that change.

But even with standard hypothesis best practices, there are opportunities to elevate your testing, align your hypothesis with challenges that are core to your business, and increase the odds of producing a positive result. It starts with identifying problems.

Is Your Website Traffic Ruining Your A/B Tests?

Is Your Website Traffic Ruining Your A/B Tests?

A/B testing can transform your business into a polished science. Remember the scientific method from 8th-grade science? Well, a good A/B test meets all of those criteria and—if you set your tests up correctly—your results will tell you exactly what works for your customers…and what doesn’t. Assuming of course, that you’re testing your customers.

Unfortunately, getting traffic to your site isn’t the same thing as getting the right traffic to your site. The right traffic is qualified to buy what you’re selling and interested in converting. The wrong traffic…isn’t.

Conversion Rate Optimization Best Practice: Ignore Best Practices

Conversion Rate Optimization Best Practice: Ignore Best Practices

Why do marketers insist on looking for “best practices” and “conversion optimization tips” that simply don’t work? Conversion rate optimization (CRO) is context-specific which is why not adhering to specific conversion rate optimization best practices is a best practice.

A structured process is your best chance at getting valid results you can use to build your internal team and take your marketing efforts to the next level.

A/B Testing for Low Traffic Websites

It takes a lot of traffic to get statistically significant results for A/B tests. High-traffic websites like Google and Facebook should A/B test everything, but low-traffic websites shouldn’t bother.

At least that’s how the argument goes. But I would like to offer a different perspective. I think low-traffic websites should A/B test, not only because doing so has enormous cultural benefits, but also because A/B testing does work for low-traffic sites.

Apply Emotions and Learn More from Your A/B Tests

Apply Emotions and Learn More from Your A/B Tests

A large opportunity for improvement exists in the realm of optimization. Most marketers optimize their websites and campaigns on pure intuition alone.

A/B testing can be so much more. It can help us tap into our customer’s emotional needs, goals and help us build a better customer journey. To do this you have to test differently. Instead of testing elements, you need to start testing concepts using behavioural and emotional methodologies.