Download our FREE ebook of 43 A/B testing case studies from the world's leading companies for test ideas and inspiration. Download Now

Optimizely Blog

Tips & Tricks for Building Your Experimentation Program

Today, at Opticon, we announced Stats Accelerator, which enables companies to accelerate experimentation through intelligent traffic optimization. With Stats Accelerator, customers will be able to:

  • Accelerate experimentation and achieve statistical significance up to 300% faster
  • Maximize conversions from time-bound experiments or campaigns
  • Reduce the manual work required to adjust traffic to winning variations

When Optimizely introduced Stats Engine in 2015, it represented a breakthrough in how companies could experiment on their digital channels. Developed in conjunction with statisticians at Stanford University, Stats Engine made it possible for customers to act on their data more quickly and more confidently than ever before.

Over the past two years, we’ve continued to work with our customers to understand how we can make the process of evaluating and acting on their experiment results even faster and easier. One challenge our customers always talk to us about is the desire to move faster. They want ways to help them increase the velocity at which they can test and learn. Today we’re excited to announce a new capability, Stats Accelerator, that will help our customers experiment faster than they ever could have in the past.

Stats Accelerator enables companies to accelerate experimentation and reach statistical significance up to 300% faster with intelligent traffic optimization. Using machine learning, Stats Accelerator automates the flow of traffic to your experiments, so you can drive learnings and impact more rapidly. By speeding up the experimentation process, you’ll be able to gather learnings and thus iterate more rapidly. A hypothetical experiment that would have previously taken 2 weeks, could be completed in only a few days using Stats Accelerator. Alternatively, you could double the number of variations in your experiment and reach statistical significance in the same amount of time as before.

Stats Accelerator can also help customers maximize the impact of their time sensitive content, i.e. content which is only going to be relevant for a short period. For example, a Black Friday promotion may only be live for a few days or a week. Stats Accelerator can help efficiently automate your traffic to ensure that you drive the most conversions for your campaign while it’s running.

We are currently piloting Stats Accelerator with a handful of customers, and we’ve been hearing positive feedback during the beta period. Stats Accelerator will work across all Optimizely Web and Full Stack solutions, enabling customers to accelerate their experiments and automate their traffic allocation no matter where they are experimenting.

AirAsia had this to say:

“As a company that is continuously experimenting on all of our product experiences across multiple digital channels, we are always looking for ways to automate processes and increase our pace of execution. The faster we can iterate and learn, the more we can improve our customer experiences and drive value for our business. We’re excited about the prospect of this new capability to help us scale our efforts and increase our pace of experimentation.”

Suzen Lim, User Experience Manager, AirAsia

We will be sharing more information about Stats Accelerator at Opticon and we’ll provide additional updates on the availability soon! If you are interested in learning more during the beta period, please reach out to your Optimizely Customer Success Manager. You can view the live stream or the recording from our keynote

Optimizely X