Download our FREE ebook of 43 A/B testing case studies from the world's leading companies for test ideas and inspiration. Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

X

Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more!

Get It Now

Product Development

Optimizely’s Vision for Product Development Teams

Optimizely’s Vision for Product Development Teams

Earlier this week, Optimizely’s Chief Product Officer Claire Vo and Jon Noronha, our VP of Product Management, presented via a live webinar on Optimizely’s vision for product development teams and previewed our upcoming roadmap.  They explained how product development teams need to be able to balance velocity with proving value. Here are some of the […]

Stop Launching.
Start Rolling Out.

Stop Launching. <br/> Start Rolling Out.

Splashy, big-bang launches were once the most common way software companies released new software. Product and engineering worked tirelessly to get a new product or feature ready while marketing and PR feverishly prepped launch materials. They often even put together extravagant launch parties to celebrate the occasion. But for every successful big bang launch, there […]

Product Experimentation Pitfalls, Post #5: Failing to Scale Across Teams

Product Experimentation Pitfalls, Post #5: Failing to Scale Across Teams

This is the final post in our Product Experimentation Pitfalls blog series, written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.    So far in this series, I’ve highlighted several pitfalls on the path to product experimentation. We’ve seen how some common mistakes can slow down […]

Product Experimentation Pitfalls, Post #4: Measuring and Driving Experiment Velocity

Product Experimentation Pitfalls, Post #4: Measuring and Driving Experiment Velocity

This is the fourth post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  So far in this series, we’ve talked about the hidden challenges that can stop experimentation from getting off the ground, like getting tricked by statistics, or choosing […]

Product Experimentation Pitfalls, Post #3: Getting Tricked by Statistics

Product Experimentation Pitfalls, Post #3: Getting Tricked by Statistics

This is the third post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  Analyzing an A/B test is deceptively simple. You count up how many conversions happened in each variation, you divide by the number of users exposed […]

Product Experimentation Pitfalls, Post #2: Experimenting Without Enough Traffic

Product Experimentation Pitfalls, Post #2: Experimenting Without Enough Traffic

This is the second post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  An experiment is like a metal detector. When there’s valuable treasure close to the surface, it’s an incredible tool that can lead you straight to the gold. […]

Product Experimentation Pitfalls Blog Series, Post #1: The Perils of Experimenting With the Wrong Metrics

Product Experimentation Pitfalls Blog Series, Post #1: The Perils of Experimenting With the Wrong Metrics

This is the first post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  Highlights: Measuring experiment results is relatively straightforward when you are driving toward a simple goal such as conversion. When product teams optimize for long-term or […]