CrossBrowserTesting.com

A Design, Development, Testing Blog

  • Product Overview
  • Pricing
  • Back Home
  • Free Trial
  • Design
  • Development
  • Manual Testing
  • Test Automation
  • Visual Testing

The Advantage of A/B Testing With Browser Screenshots

January 17, 2019 By Alex McPeak Leave a Comment

ab testing screenshots

When we think of web testing, we often attribute it to the role of QA professionals. However, digital marketing teams also have a lot to gain from testing different aspects of their website.

There are many ways to perform web testing in marketing, which we’ve outlined in our Marketer’s Guide to Testing.

One of the more common testing practices that marketers experiment with is A/B testing, which lets you test two scenarios at once to determine which your audience responds to better. This is done by having control and variable scenarios, which are randomly displayed to users when they visit your site.

These changes can be as small as testing the color of a CTA button to seeing whether adding a video on a landing page will increase registrations. For example, one user may see a green “Sign Up Now” button, while the other sees a red one. During an A/B test, you may look to see which one gets more clicks in order to inform which color you want to set the button to.

Just like in QA, different testing methods in marketing often require the assistance of tools. For A/B testing, Optimizely is the gold standard. Optimizely allows you to go into your page and live edit through the dashboard to make two versions of the same web page and see which performs better with site visitors.

It also keeps all your results organized so you can make informed decisions about what resonates most with customers and use data to make intelligent changes in the UI of your application.

However, while those changes may consistently look great in the Optimizely editor on the browser you’re using, it’s also worth seeing what your experiments look like outside the editor and in different environments.

With Preview Mode, you can see what your A/B tests look like across browsers and devices with the CrossBrowserTesting integration in Optimizely. This feature will load your page and take screenshots in all of the major desktop browsers including Internet Explorer, Chrome, Firefox, and Safari, as well as mobile with Android and Mobile Safari.

By clicking “Cross-Browser Test” under “Preview,” you’ll be presented with thumbnails of screenshots in each browser that you can click into. This will allow you to verify that the changes from the A/B test are visually consistent, and if not, you’ll know to go back and make those changes in the editor. For more information, you can read more about how to run a cross-browser test in Optimizely.

cross-browser-create.png

Image via Optimizely

How do you prevent cross-browser issues in the first place? Optimizely provides a few valuable tips on using the editor so you can avoid common pitfalls. For general tips on creating a cross-compatible website, check out our eight essential tips.

A/B testing is the first step in understanding your users and what they want, but to ensure your tests are effective, it’s also important to preview those tests on different environments before going live. Collecting browser screenshots of your tests is the next step in collecting reliable data from your customers.

Filed Under: Visual Testing Tagged With: ab testing, integrations, marketing, optimizely, screenshots

About Alex McPeak

Alex McPeak is a Content Marketing Specialist for CrossBrowserTesting and is always looking to provide insights in testing, development, and design for the software community, appearing in outlets such as Abstracta, DZone, and Ministry of Testing. She's especially interested in writing about the latest innovations in technology and is forever #TeamiPhone.

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Try CrossBrowserTesting

Everything you need for testing on the web. Browsers & Devices included.


  • Grid In The Cloud
  • Simple CI Integrations
  • Native Debugging Tools
  • Real iOS and Android
  • 2050+ Browser/OS Combinations
  • Intuitive REST API

Start Testing Today

Want Testing Tips?

Want the latest tips & strategies from industry experts right to your inbox? Sign up below.
 

Join Over 600,000 Testers & Developers And Start Testing Today

Learn more Free Trial

Features

  • Live Testing
  • Selenium Automation
  • Automated Screenshots
  • Screenshot Comparison
  • Local Testing
  • Real Devices

Solutions

  • Automated Testing
  • Visual Testing
  • Manual Testing
  • Enterprise
  • Internet Explorer

Resources

  • Browsers & Devices
  • Blog
  • Webinars
  • Integrations
  • ROI Calculator

Company

  • About Us
  • Careers
  • Plans
  • Terms of use
  • Security

Support

  • Help Center
  • API Docs
  • Schedule A Demo
  • Contact Us
  • Write For Us