A/B Testing Ideas

Inspiration, examples, and ideas for new A/B tests to run on your website or mobile app.

Brainstorm Your Next A/B Test — In 1 Minute


Ryan Krebs One Minute Monday Optimiely

For this week’s One Minute Monday, Ryan Krebs from our Partnerships team shares advice on coming up with your next test idea.

See this napkin? This is they key to your testing success because it is a canvas for your testing ideas. Ideation is an important part of testing. To get started thinking about test ideas, we recommend you first identify your key business metrics on your website and then start brainstorming tests to affect them.

Lessons We Learned from Email A/B Tests in 2014


black and white keyboard mouse

This year, the Marketing Automation team at Optimizely got serious about tracking our email A/B tests. In 2015, Optimizely will be taking experience optimization to the next level, and continue to rigorously test campaigns in order to provide the best experience for our customers.

Looking back at some A/B tests we ran this year, here are some lessons learned, along with where I hope to take our email experiments in 2015.

Unconventional Places to Find Ideas for Your Next A/B Test

Investigator searching for data with magnifying glass

Before you can come up with meaningful A/B tests for your e-commerce store, you need to understand what your customers value when making purchases and what turns them away. The traditional method of collecting customer feedback via surveys has drawbacks.

Other, more unconventional, sources of information exist that can be extremely helpful in generating ideas for A/B tests. They are your customer service records, public forums, competitor data, and internal search keywords.

The Impact of Symmetry in Online Marketing


symmetry

You may have heard that keeping your ad consistent with your landing page is good. But is that a myth? And if it isn’t, how can you quantify the impact of this symmetry? In early 2013, we performed an experiment on our Pay Per Click landing page aimed at answering these questions.

Our goal was more to answer an interesting question than to find a conversion lift, but we were pleasantly surprised to discover that making our landing page mirror our ads led to a tremendous lift in conversions.

How Pandora Can Increase Users that “Paid Tha Cost to be Da Bo$$”


Snoop Dogg Album Cover

Hip Hop BBQ. Ever heard of it? It’s may or may not be the best Pandora station to ever grace this earth. While skipping through songs on Hip Hop BBQ, I landed on one from Snoop Dogg’s album, “Paid Tha Cost to be Da Bo$$.” This got me thinking, naturally, about app subscription models. How do apps get users to pay tha subscription cost to be da bo$$?

In this Teardown Tuesday, I’ll offer ideas for Pandora to create a steady, healthy stream of predictable revenue by increasing paid subscriptions. If you have an app with a freemium subscription model, this is for you.

Test Ideas to Drive More Holiday Revenue on Oasis Stores’ iOS App


oasis-logo

It’s only August but Christmas planning in the e-commerce world is in full throttle. If you’re in e-commerce, then you have 3 months left to nail down the user experience, fill up those email lists and make the checkout funnel as frictionless as possible before Christmas code lockdown arrives. You’ve probably experienced this on the web for years, but what about your iPhone apps?

Oasis is one veteran UK brand who will definitely be looking for a prosperous Christmas season, especially on mobile.

How Flipboard Can Keep Users from Flipping Out


flipboard

You only have one chance to make a first impression. This saying could not be more true when it comes to mobile apps. The first time someone launches an app is often the first interaction that he or she has with the brand and with the company. This is especially true for mobile-first companies that before the app, had no online presence.

A great example is Flipboard. Let’s take a look at how Flipboard can experiment with the new user experience to optimize the first impression and ultimately increase loyalty and usage.

5 CRO Elements to Test on Facebook


fb_icon_325x325

In an August 2013 CMO Survey, 66% of respondents indicated that their companies are putting more pressure on measuring social ROI. The challenge? There isn’t a clear cut path for doing so.

While there isn’t a ‘silver bullet’ in quantifying social ROI, you can create a system for maximizing the impact of every moment your audience spends on Facebook. That’s where conversion rate optimization (CRO) comes in.