Download our FREE Testing Toolkit for A/B testing ideas, planning worksheets, presentation templates, and more! Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

Announcing Flexible Segmentation for Deeper Insights on Experiment Results


Announcing Flexible Segmentation for Deeper Insights on Experiment Results

Today at Opticon, we announced the launch of Flexible Segmentation — a major enhancement to the segmentation capabilities of the Optimizely results page. Now analysts can drill-down into the most important granular segments and understand how they performed against key experiment metrics. This capability allows experimenters to: Combine multiple user attributes to pinpoint segments of […]

How to Make Statistically Sound Decisions Using Confidence Intervals


How to Make Statistically Sound Decisions Using Confidence Intervals

As an experimenter, the pressure to make a decision after you’ve run an A/B test can lead to some pretty wacky interpretations of non-significant experiment results. After all, what does it even mean for something to be “trending in the direction of statistical significance” (a phrase actually stated confidently during a recent experiment review at […]

Leveraging Interaction Effects in A/B and Multivariate Testing


Leveraging Interaction Effects in A/B and Multivariate Testing

“Interaction effects”. This phrase can strike fear into the heart of anyone who has contemplated running multiple concurrent A/B tests. At best, experimenters view interaction effects as an inconvenient reality which forces them to consider making experiments mutually exclusive. At worst, interaction effects can make it difficult or impossible to interpret the results of concurrent […]

Improving Snippet Performance and Matching with 3rd Party Analytics


Today, we’re pleased to share a pair of new updates to the Optimizely JavaScript snippet which are launching in general availability: a more performant event logging endpoint (/events), and new JavaScript methods for event timing. /events Logging Endpoint: Better performance through batching Our customers care a lot about the performance impact of including our snippet […]