This team has data, not opinions: A/B testing at the Romney Campaign

From day one, Mitt Romney’s digital campaign team understood a common truth: the campaign is not a creativity contest – what looks best and what works best for the website is not always the same.

“We tried to be very conscious that this team doesn’t have creative opinions, this team has data,” says Ryan Meerstein, a senior political analyst from Targeted Victory, the agency who ran testing and optimization for the Romney campaign. “It’s hard for the team to argue with a graph that proves what works and what doesn’t.”

Continue reading

Kyle Rush on Surprising Results, His Major, and the Future [Part Two]

This is the final, ultra-optimized version of contribute.barackobama.com. Every pixel, every word, every dollar sign has been scrutinized, iterated and heavily tested. This page was the portal to Barack Obama’s $690 million online fundraising machine.

This is the second part of our interview with Kyle Rush of the 2012 Obama for America Digital Team. Click here to read part one.

Continue reading

Just because you can…

Today’s guest blog is from Kyle Duford, Director of eCommerce at Chrome Industries. Previously, Kyle managed eCommerce at Speck.

Growing up my Dad had a few choice catchphrases — mostly ones I can’t write here. “Life is like a big wheel, what goes around comes around,” he’d say at just the moment the young version of me would want to retaliate to someone who did me wrong at school or when I questioned violence on the news. He particularly surprised me when his business partner orchestrated a way to virtually steal my father’s entire company just before he retired. His response? “He must need the money more than me. What goes around, comes around.” Eventually the scum got his comeuppance.

Another phrase that stuck with me from my early years was just as simple, “Just because you can, doesn’t mean you should.”

Continue reading

Kyle Rush on Optimizely, Testing, and Obama [Part One]

Kyle Rush, right, was the Deputy Director of Frontend Web Development at Obama for America.

We interviewed Kyle Rush of the 2012 Obama for America Digital Team about A/B testing at the campaign. 

Continue reading

What exactly is a ‘conversion’? It’s up to you!

The goal of any A/B test is to compare two (or more) versions of a web page and see which version performs best. What “performs best” actually means is entirely up to you and depending on the test’s goals, it could mean any number of things. But however you define “performs best,” you’ll measure this by a conversion goal, an aggregate goal, or an what I like to call an ultimate conversion goal.

Continue reading