• About Us
  • Services
  • Case Studies
  • Blog
  • Contact Us
  • 30 Multivariate & A/B Split Testing Tools, Tutorials & Resources

    Crossroads by Captain DJ.

    Getting targeted traffic for a website is just the first step in a thorough SEO process. What comes next? Landing page optimization or conversion (rate) optimization/CRO follows. After all you want the visitors you get to stay on your site and perform the desired action (like ordering or subscribing).

    One of the foremost ways to optimize landing pages for more conversions is A/B split testing

    sometimes also referred to as simply AB testing. The concept is pretty simple. In the most basic set up you show version A of a page to half of your visitors while in the other half will see version B.

    Of course in reality it’s a bit more complex.

    You will have more than two versions in many cases and you won’t split 50/50 but will choose a smaller portion of your overall traffic to test. Also you will probably only subject new visitors to your tests in some cases in order not to scare away your repeat visitors by frequent changes.

    When you prepare more than two versions of your content (as in A, B, C etc.) it’s not necessarily called multivariate testing then. Multivariate testing rather refers to tests with multiple variables you check.

    The most known tool for A/B split testing is Google Website Optimizer. Like with many free tools and similarly to Google Analytics it’s not the easiest to use tool though.

    There are more user friendly tools out there by now. Over the course of the last year A/B split & multivariate testing has been booming. I discover new tools, tutorials and other resources every other day. Nonetheless it’s by now a best practice that has been around for years. So this is not about early adopting a methodology. AB testing is common sense by now on the Web.

    Introductions to A/B Split Testing

    Examples and Case Studies

    Resources

    Tools

    Guides & Tutorials

    The biggest problem with A/B and multivariate testing is the time and resources needed. Even a simple test for small website entails three different departments be it, SEO, analytics, web design.

    How do you perform your A/B tests? I am still undecided which tools best suit my requirements.

    FOLLOW
    ABOUT THE AUTHOR
    I help people with blogs, social media & search. I help you succeed on the Web. I've been online publishing for 15 years. I started back in 1997.

    34 Responses to “30 Multivariate & A/B Split Testing Tools, Tutorials & Resources”

    1. Paras Chopra says:

      Hi Tad,

      Thanks for putting up this excellent list of A/B testing resources! Clearly, there is a plethora of educational material available and lack of awareness doesn’t seem to a problem. According to my experience, A/B testing is something many online businesses want to do, but the plain-old inertia prevents them from deep-diving into it. They still have a fear that it isn’t they can do easily.

      A/B and multivariate testing technology isn’t the bottleneck. For example, my startup Visual Website Optimizer http://visualwebsiteoptimizer.com/ is laser-focused on making testing as simple as possible. Contrary to your point, it tries to hand over control of testing initiatives to the marketer, eliminating IT and other departments from the loop. In fact, I’d say it takes “effort” and “commitment” out of the question.

      The major stumbling block in A/B testing adoption is lack of motivation or it-isn’t-for-me attitude. I think the issue of not doing enough A/B testing is entirely behavioral, not related to methodology or tools involved. What do you think?

    2. That’s quite a list. The examples and case studies are probably the best resource of all.

    3. Really love the Visual Website Optimizer. It’s a great tool for advertisers, especially to become independent from IT!

    4. Dan says:

      Great job with the list covering all aspect of conversion rate optimisation from strategy to the practical implementation.

    5. [...] 30 Multivariate & A/B Split Testing Tools, Tutorials & Resources – SE Optimize [...]

    6. Great posting, good to see more and more resources avaialble to marketers on this subjec that not so long ago was quite tricky to fully research.

      You missed Maxymiser from your list of tools, hope you won’t mind me posting here to bring it to your readers attention. We provide a full service testing solution from offices in the USA, UK and Germany.

    7. senthiledp says:

      Oh, great! I always like opportunities to learn more about SEO, especially now when I’m fighting to improve it on my blogs, thanks.

    8. Tad Chef says:

      Hey Paras, thanks for the feedabck. You’re tool had been on th elist already!

      David: Yeah, the examples are insightful, even the simple Twitter example. That’s why I inclueded not only the tools.

      Dan: We have another, even better CRO list linked in the above post at the top:
      http://white.net/noise/blog/2010/05/46-croconversion-rate-optimization-resources-for-web-design-seo-social-media-experts.html

      Alasdair: Thanks for the addition but I can’t find much info about the actual tool on your site. Features, screen shots, pricing? Sounds more like a “solution” aka service.

    9. Hi Tad,

      Indeed, we don’t publish pricing but you can find more about the tool in the datasheet linked to at the base of the page below. Our main differentiator is the One Touch deployment method which is one tag one time meaning no re-tagging or tag changes between tests:

      http://www.maxymiser.com/solutions/one-touch-methodology

    10. Great job! I like the most is case studies and tutorial which no one provide and if provides there are very rare case. Providing tools is not great work but providing all the useful stuff related to that is the most important job of all.

    11. [...] of the foremost ways of optimizing your web design is via A/B testing(sometimes referred to as split testing). An A/B test examines the effectiveness of one landing page [...]

    12. [...] 30 Multivariate & A/B Split Testing Tools, Tutorials & Resoures [...]

    13. Karol K. says:

      Really good list, it went straight to my delicious.com profile! :)

      I’ve released a tool for checking the statistical significance of a split test’s results. It’s free and I invite everyone to give it a try.

      http://newinternetorder.com/how-to-check-the-significance-of-an-ab-split-test/

    14. [...] usability and conversions.One of the foremost ways of optimizing your web design is via A/B testing (sometimes referred to as split testing). An A/B test examines the effectiveness of one landing [...]

    15. 5 Small Biz Web Design Trends to Watch - Trotting Weasel says:

      [...] of the foremost ways of optimizing your web design is via A/B testing (sometimes referred to as split testing). An A/B test examines the effectiveness of one landing [...]

    16. 5 Small Biz Web Design Trends to Watch | Dotisio says:

      [...] of the foremost ways of optimizing your web design is via A/B testing (sometimes referred to as split testing). An A/B test examines the effectiveness of one landing [...]

    17. [...] 30 Multivariate & A/B Split Testing Tools, Tutorials & Resources … – Crossroads by Captain DJ. Getting targeted traffic for a website is just the first step in a thorough SEO process. What comes next? Landing page. [...]

    18. 5 Small Biz Web Design Trends to Watch | Online Marketing Strategie says:

      [...] of the foremost ways of optimizing your web design is via A/B testing (sometimes referred to as split testing). An A/B test examines the effectiveness of one landing [...]

    19. Test Test Test for best results in Wordpress | yfenni.net says:

      [...] 30 Multivariate & A/B Split Testing Tools, Tutorials & Resources (seoptimise.com) [...]

    20. [...] of the foremost ways of optimizing your web design is via A/B testing (sometimes referred to as split testing). An A/B test examines the effectiveness of one landing [...]

    21. [...] of the foremost ways of optimizing your web design is via A/B testing (sometimes referred to as split testing). An A/B test examines the effectiveness of one landing [...]

    22. What You Need to Know Now – SEO Glossary « WYSIWYG Marketing says:

      [...] http://white.net/noise/blog/2010/07/30-multivariate-ab-split-testing-tools-tutorials-resources.ht… [...]

    23. 30 New SEO Terms You Have to Know in 2011(SEOptimise) - Sorta Techie Online Marketing & Branding Blog Archive • Sorta Techie Online Marketing & Branding says:

      [...] http://white.net/noise/blog/2010/07/30-multivariate-ab-split-testing-tools-tutorials-resources.ht… [...]

    24. [...] For more articles and tools for split testing, visit this compilation of resources from SEOptimise. [...]

    25. [...] Ad/placements so that you could increase the chances of sales every time. See this nice collection no A/B split testing which helps you to understand better and recommendations on Split testing your landing pages, [...]

    26. [...] them – and testing those improvements. Make changes to the website, set up a control, and perform some A/B testing (try Visual Website Optimizer or check out this cool WP plugin) to see how your audience responds [...]

    27. [...] – and contrast those improvements. Make changes to a website, set adult a control, and perform some A/B testing (try Visual Website Optimizer or check out this cold WP plugin) to see how your assembly responds [...]

    28. [...] them – and testing those improvements. Make changes to the website, set up a control, and perform some A/B testing (try Visual Website Optimizer or check out this cool WP plugin) to see how your audience responds [...]

    29. Burner says:

      A brilliant comprehensive list. I wish I had found this site a few years ago. Had to learn to of this stuff the hard way.

    30. [...] this nice collection no A/B split testing which helps you to understand better and recommendations on Split testing your landing pages, [...]

    31. [...] of the foremost ways of optimizing your web design is via A/B testing(sometimes referred to as split testing). An A/B test examines the effectiveness of one landing page [...]

    32. [...] reasons. The principles can be used for all types of marketing, advertising and promotions.You can do all kinds of things to make your blog look better and seem more polished, but the quality…isn't what your readers prefer, so you have to pay close attention to feedback. You can continuously [...]

    33. Anna Kitowska says:

      Nice collection Tad! Case studies are always useful and, especially in case of AB tests, they are a very interesting read. When it comes to helpful tools, try usabilitytools.com We have a pricing system which allows to run a split test for 10 000 pageviews for free after signing up.

    Leave a Reply