On Building an Optimization Agency: The Inception & The Future

Growing

Around 2007, Matty Wishnow had a revelation about decision-making: most decisions businesses make—whether it’s a marketing plan, a design brief, or a feature on a product roadmap—are “really a bunch of hypotheses masquerading as priorities.” He realized that most businesses didn’t really employ data or testing to drive their decisions.

“It was almost just like something that somebody had to check off on a checklist, all the analysis was postmortem; everything was still driven by gut,” Matty told me.

This epiphany drove him to start a digital agency called Clearhead. Today, some of Clearhead’s clients include Adidas, Fresh Direct, Blu Dot, Sephora, Keurig, and Patagonia.

I spoke with Matty and Brian at Clearhead, about how they approach client engagements, how they’ve seen the optimization landscape change over the years, and advice for agencies starting to offer optimization.

Your Email Open Rate is High? That’s Nice.

email open rate

A high open rate is nice. It’s an important signal you’re writing evocative subject lines and optimizing your send time. But if people don’t take action or convert on that email they opened, then the act of opening is much less meaningful. Getting maximum value out of A/B testing marketing email requires optimizing for key metrics that really matter to the business—and open rate is not one of them.

What’s Next? Steps For Prioritizing Your Experiment Backlog

prioritizing test ideas

Prioritization is a critical skill to master when building out a testing program. It’s about making smart choices and applying discipline to the decision-making process.

In my experience helping companies build their test programs from scratch, as well as optimizing more mature programs, I’ve seen the benefits of adopting a rigorous prioritization scheme time and time again. Based on experience working with Optimizely customers, here are three crucial key steps to follow when bringing prioritization into your optimization strategy.

User Testing: A Pillar of Great Experiments

If this temple in Agrigento Sicily island in Italy was an experiment, then user testing would be one of its pillars .

If you’re working on optimizing your conversion rate, chances are, you’ve already done some testing on your website. Maybe it’s A/B testing or multivariate testing, or maybe you’ve run a heat map or two. These are all tools available to you to deliver the best experience possible to your visitors. In this article we’re going to talk about another one, user testing: what it is, and how you can use it to come up with really good hypotheses for your experiments.