Download our FREE ebook of 37 A/B testing case studies from the world's leading companies for test ideas and inspiration. Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

X

Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more!

Get It Now

Developers

Articles by developers for developers about how to best make use of the Optimizely platform.

How Realtor.com Delivered a Faster, Better Customer Experience with Experimentation

How Realtor.com Delivered a Faster, Better Customer Experience with Experimentation

Creating a faster and more engaging site experience often requires tradeoffs between various revenue streams of the business. Can the increase in conversion from more engaged users more than offset any loss in ad revenue? It’s a bold bet that Realtor.com’s analytics and experimentation team set out to answer at the beginning of 2018. A […]

Ask an Experimenter: Joy Scharmen, Director of DevOps at Optimizely

Ask an Experimenter: Joy Scharmen, Director of DevOps at Optimizely

Welcome to the second installation of Ask an Experimenter, a new series where we interview experts about how they are building a culture of experimentation at their companies. Our interview today is with Joy Scharmen, Optimizely’s Director of DevOps. Tell us a little about yourself. I’m Joy, an engineering director here at Optimizely. Our team […]

Tutorial: Get alerted when feature flags change, via AWS Lambda and Webhooks

Tutorial: Get alerted when feature flags change, via AWS Lambda and Webhooks

At Optimizely, we’re always looking for ways to eat our own dogfood. Once we added feature flags to Optimizely Full Stack, we started adopting flags to remotely configure our own application. In the last few months, we’ve found this has been especially helpful for our end-to-end testing. Being able to toggle features on and off […]

Product Experimentation Pitfalls, Post #5: Failing to Scale Across Teams

Product Experimentation Pitfalls, Post #5: Failing to Scale Across Teams

This is the final post in our Product Experimentation Pitfalls blog series, written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.    So far in this series, I’ve highlighted several pitfalls on the path to product experimentation. We’ve seen how some common mistakes can slow down […]

Product Experimentation Pitfalls, Post #4: Measuring and Driving Experiment Velocity

Product Experimentation Pitfalls, Post #4: Measuring and Driving Experiment Velocity

This is the fourth post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  So far in this series, we’ve talked about the hidden challenges that can stop experimentation from getting off the ground, like getting tricked by statistics, or choosing […]

Product Experimentation Pitfalls, Post #3: Getting Tricked by Statistics

Product Experimentation Pitfalls, Post #3: Getting Tricked by Statistics

This is the third post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  Analyzing an A/B test is deceptively simple. You count up how many conversions happened in each variation, you divide by the number of users exposed […]

Product Experimentation Pitfalls, Post #2: Experimenting Without Enough Traffic

Product Experimentation Pitfalls, Post #2: Experimenting Without Enough Traffic

This is the second post in our Product Experimentation Pitfalls blog series written by Optimizely’s Director of Product Management, Jon Noronha. See here for more information on this 5-part series.  An experiment is like a metal detector. When there’s valuable treasure close to the surface, it’s an incredible tool that can lead you straight to the gold. […]