Prioritization is a critical skill to master when building out a testing program. It’s about making smart choices and applying discipline to the decision-making process.
In my experience helping companies build their test programs from scratch, as well as optimizing more mature programs, I’ve seen the benefits of adopting a rigorous prioritization scheme time and time again. Based on experience working with Optimizely customers, here are three crucial key steps to follow when bringing prioritization into your optimization strategy.
Imagine you set out on a road trip. You packed the car, made a playlist, and set out to drive 600 miles—but you don’t actually know where you’re headed. When you arrive at a destination, and it’s not at all what you imagined it would be.
Running an experiment without a hypothesis is like starting a road trip just for the sake of driving, without thinking about where you’re headed and why. You’ll inevitably end up somewhere, but there’s a chance you might not have gained anything from the experience.
In this post, we’ll show you how to craft great hypotheses, how they fit into your experiment planning, and what differentiates a strong hypothesis from a weak one.
When I’m not running experiments on Optimizely’s conversion funnels, I love to interact with the optimization community. GrowthHackers has one of the best communities out there and last week I hosted an Ask Me Anything (AMA). The questions were very high quality and covered topics like running multiple tests at the same time, how to overcome technical hurdles, how multi-armed bandits can be helpful, what to do with inconclusive tests, and more.
If this piques your interest, have a read through the questions and, of course, continue to ask me anything.
Brooke Beach has a challenge common amongst many: producing a lot of content with limited resources without sacrificing quality.
Her marketing team has come up with a system that combines data from website analytics, marketing automation, and live chat to help create the right content for the right audiences. Intrigued as to how live chat contributes to this optimization equation, I talked to Brooke about how they go about it, and the impact it’s had on the business.
On November 18th, 2014, we publicly released Optimizely’s iOS editor. Before we launched, there was one problem the whole team rallied behind to fix: we weren’t proud of the product. To fix this issue, we went beyond a Minimum Viable Product (MVP) to an MVPP—the Minimum Viable Product we’re Proud of.
This is the story of how we pulled this off, what we learned along the way, and product development tips to help you ship great products, from the perspective of someone who just did it.
From conversations with our customers, we’ve learned that some folks who do A/B testing also have day-to-day responsibilities ranging from SEO to front end development to content marketing. But, it’s apparent that the folks who do conversion optimization have one thing in common: an obsession with growth. Their work directly contributes to company growth and impacts wins and fails. In essence, everyone who practices A/B testing and optimization is a Growth Marketer.
We’re curious about what it means to be a Growth Marketer… So we’re asking you.
Employees at extremely fast growing companies have an exciting opportunity to meet many smart, interesting new people. This also presents a challenge: memorizing their names. It might seem impossible after you reach a certain size and have multiple offices around the world. Maybe knowing everyone is unrealistic, but at least we can strive to match a name with a face.
During our last hack sprint, I thought, wouldn’t it be nice to have a tool that could help us recognize (and maybe even get to know) each other?
Your optimization strategy is an exercise in rigorous prioritization. When your most valuable resource is time, it is essential that your experiments run on high-priority pages and generate a measurable effect. Learn how to estimate test impact, leverage your website analytics, and develop a robust testing strategy with data that will let you you make the most of your limited time.
Earlier this year, we released a major addition to Optimizely’s preview tool: the ability to impersonate visitors.
In this post, I will describe our design process and the decisions we made along the way when building this feature to shed some light on how product features are ideated, developed, and released at Optimizely.