A/B Testing Ideas

Inspiration, examples, and ideas for new A/B tests to run on your website or mobile app.

3 Tactics to Increase E-commerce Sales


While low-cost retail leaders like Amazon dominate online retail, a race to the bottom can seem like the only way to keep up. After all, Time reports that Amazon owns 23% of online retail market share. The world of e-commerce is a hyper-competitive space.

A/B testing three key areas, pricing, product pages, and product recommendations is pivotal to stay competitive today. This blog post aims to get other online retailers caught up on these three aspects. Let’s jump into the specifics to see the impact optimization can have for online retailers.

How Top of The Funnel A/B Tests Help Determine Your Website Content

top of the funnel a/b tests

What if you need to quickly come up with some new blog ideas, or you have to redo the copy on a page before the tight deadline your client or boss sent you. Where can you get instant feedback from?

Your top of the funnel A/B tests.

If you’re running social media, advertising or email campaigns, you’re probably doing some A/B testing on them to optimize the click-through rates. Let’s have a look at how you can use this in your website and blog copy.

Brainstorm Your Next A/B Test — In 1 Minute

Ryan Krebs One Minute Monday Optimiely

For this week’s One Minute Monday, Ryan Krebs from our Partnerships team shares advice on coming up with your next test idea.

See this napkin? This is they key to your testing success because it is a canvas for your testing ideas. Ideation is an important part of testing. To get started thinking about test ideas, we recommend you first identify your key business metrics on your website and then start brainstorming tests to affect them.

Lessons We Learned from Email A/B Tests in 2014

black and white keyboard mouse

This year, the Marketing Automation team at Optimizely got serious about tracking our email A/B tests. In 2015, Optimizely will be taking experience optimization to the next level, and continue to rigorously test campaigns in order to provide the best experience for our customers.

Looking back at some A/B tests we ran this year, here are some lessons learned, along with where I hope to take our email experiments in 2015.

Unconventional Places to Find Ideas for Your Next A/B Test

Investigator searching for data with magnifying glass

Before you can come up with meaningful A/B tests for your e-commerce store, you need to understand what your customers value when making purchases and what turns them away. The traditional method of collecting customer feedback via surveys has drawbacks.

Other, more unconventional, sources of information exist that can be extremely helpful in generating ideas for A/B tests. They are your customer service records, public forums, competitor data, and internal search keywords.

The Impact of Symmetry in Online Marketing


You may have heard that keeping your ad consistent with your landing page is good. But is that a myth? And if it isn’t, how can you quantify the impact of this symmetry? In early 2013, we performed an experiment on our Pay Per Click landing page aimed at answering these questions.

Our goal was more to answer an interesting question than to find a conversion lift, but we were pleasantly surprised to discover that making our landing page mirror our ads led to a tremendous lift in conversions.

Ideas for Pandora’s App to Increase Paid Users

Snoop Dogg Album Cover

Hip Hop BBQ. Ever heard of it? It’s may or may not be the best Pandora station to ever grace this earth. While skipping through songs on Hip Hop BBQ, I landed on one from Snoop Dogg’s album, “Paid Tha Cost to be Da Bo$$.” This got me thinking, naturally, about app subscription models. How do apps get users to pay tha subscription cost to be da bo$$?

In this Teardown Tuesday, I’ll offer ideas for Pandora to create a steady, healthy stream of predictable revenue by increasing paid subscriptions. If you have an app with a freemium subscription model, this is for you.

Test Ideas to Drive More Holiday Revenue on Oasis Stores’ iOS App


It’s only August but Christmas planning in the e-commerce world is in full throttle. If you’re in e-commerce, then you have 3 months left to nail down the user experience, fill up those email lists and make the checkout funnel as frictionless as possible before Christmas code lockdown arrives. You’ve probably experienced this on the web for years, but what about your iPhone apps?

Oasis is one veteran UK brand who will definitely be looking for a prosperous Christmas season, especially on mobile.