Showing posts in “Best Practices

What’s Next? Steps For Prioritizing Your Experiment Backlog


prioritizing test ideas

Prioritization is a critical skill to master when building out a testing program. It’s about making smart choices and applying discipline to the decision-making process.

In my experience helping companies build their test programs from scratch, as well as optimizing more mature programs, I’ve seen the benefits of adopting a rigorous prioritization scheme time and time again. Based on experience working with Optimizely customers, here are three crucial key steps to follow when bringing prioritization into your optimization strategy.

User Testing: A Pillar of Great Experiments


If this temple in Agrigento Sicily island in Italy was an experiment, then user testing would be one of its pillars .

If you’re working on optimizing your conversion rate, chances are, you’ve already done some testing on your website. Maybe it’s A/B testing or multivariate testing, or maybe you’ve run a heat map or two. These are all tools available to you to deliver the best experience possible to your visitors. In this article we’re going to talk about another one, user testing: what it is, and how you can use it to come up with really good hypotheses for your experiments.

Why An Experiment Without A Hypothesis is Dead On Arrival


Experiments without hypothesis are dead on arrival

Imagine you set out on a road trip. You packed the car, made a playlist, and set out to drive 600 miles—but you don’t actually know where you’re headed. When you arrive at a destination, and it’s not at all what you imagined it would be.

Running an experiment without a hypothesis is like starting a road trip just for the sake of driving, without thinking about where you’re headed and why. You’ll inevitably end up somewhere, but there’s a chance you might not have gained anything from the experience.

In this post, we’ll show you how to craft great hypotheses, how they fit into your experiment planning, and what differentiates a strong hypothesis from a weak one.

How to Prioritize Your Test Ideas and Other Critical Questions


Kyle Rush

When I’m not running experiments on Optimizely’s conversion funnels, I love to interact with the optimization community. GrowthHackers has one of the best communities out there and last week I hosted an Ask Me Anything (AMA). The questions were very high quality and covered topics like running multiple tests at the same time, how to overcome technical hurdles, how multi-armed bandits can be helpful, what to do with inconclusive tests, and more.

If this piques your interest, have a read through the questions and, of course, continue to ask me anything.

5 Traits of Best-in-Class Optimization Teams


Award

What are your best customers doing?

That is the #1 question I hear from customers on a day-to-day basis. How do others companies do optimization and testing? It’s a great question.

Based on thousands of interactions with Optimizely customers and four years of enterprise enablement, I can confidently point to five traits that all best-in-class optimization teams possess…

2 Controversial Site Redesigns That Should Inspire You to A/B Test

Original version of Netflix page.

When it comes to making better data-driven decisions, the sooner the better. Often the temptation is to wait until after the redesign is done or the feature is rolled out. “Oh, we’re doing a redesign; we’ll do the A/B testing afterwards.” The fact is you actually want to A/B test the redesign. One story from Digg and another from Netflix show why.

Around 2010, Optimizely co-founders Dan Siroker and Pete Koomen were introduced to the folks at Digg by their new VP of Product Keval Desai to talk about using Optimizely. Their response was, “We are busy working on a complete overhaul of our site. After we do that, then we’ll do A/B testing.”

Introducing Audiences: A New Way to Deliver Personalized Experiences

audiences-feature

75% of US customers appreciate when companies customize messaging and offers to them, but most companies struggle to achieve this in the digital space.

In a world where your customers interact with you every day at multiple touch points across multiple channels, Audiences make it even easier for you to optimize and deliver them personalized experiences.

The Secret Weapon to Superior Calls to Action

Marketing And Advertising

Great content marketing campaigns engage your target audience and build trust and authority online by educating that audience.

Without a strong call to action, you’re not giving your content a fair chance to convert unique visitors into leads in your database. And that, my friends, is a problem. Especially if you’re fighting for budget, or need to justify the spend on a content-centric marketing strategy. This post explains 3 ways to make your CTAs powerful lead and revenue drivers for your organization.

Qualitative Questions That Lead to Great A/B Tests

Unanswered Questions - Brainstorming Concept

You’ve asked everyone in your company. You’ve looked to your competitors. You talk about it with your friends at happy hour. You’re trying to come up with ideas for your next big A/B testing win. Pulling qualitative feedback is the next best place to look. If you’re not getting qualitative with your data to understand your visitors better, then you’re missing out on one of the biggest pieces of learning.