A/B Testing or Bucket Testing

A/B Testing (Bucket Testing) is mostly used to study the impact of various product designs in website metrics, two simultaneous versions were run in a single or set of web pages to measure the difference in click rates, interface and traffic.

A/B testing
or bucket testing is a method of marketing testing by which a baseline control sample is compared to a variety of single-variable test samples in order to improve response rates. A classic direct mail tactic, this method has been recently adopted within the interactive space to test tactics such as banner ads, emails and landing pages.

Significant improvements can be seen through testing elements like copy text, layouts, images and colors. However, not all elements produce the same improvements, and by looking at the results from different tests, it is possible to identify those elements that consistently tend to produce the greatest improvements.

A/B testing is a method used in order to increase the effectiveness of Google AdSense ads by comparing the performance of 2 different advertisements (A and B). This approach is most appropriate for improving the performance of an ad by changing it's appearance (color of the text, color of the border, shape of the ad etc...) instead of actual ad placement (where the ad is located on the page).

A/B Testing is a great way for finding the better performing version of text, layouts, images, colors or any other element. in a website.
Prashant Vadher - PHP AB Testing

is a free PHP script that enables you to setup A/B tests on your website so quickly.

Features of phpA/B Application :
  • Test anything : Whether you want to test changes to your copy, HTML, CSS, javascript, or test completely different designs, phpA/B offers a way to do it.
  • Google Analytics integration : phpA/B integrates automatically into your Google Analytics, allowing deeper insight into your tests’ impact on users.
  • High performance : PHP-based tests run before users even begin loading your web pages. Javascript-based A/B tests cause funny twitches in your UI.
  • Search bot filtering : Don’t let search engine robots skew your data. phpA/B automatically filters them out of your tests.
How to begin Testing with phpA/B:
- Check this Page for Step-by-step details details..
Companies well-known for using A/B Testing :
Many companies use the designed experiment approach to making marketing decisions. It is getting more of a common practice as the tools and expertise grows in this area. One study suggests up to two-thirds of web companies are dabbling in A/B testing.
While it is widely used behind the scenes to maximize profits, the practice occasionally makes it into the spotlight.
  • Amazon.com pioneered its use within the web ecommerce space. Also stirred controversy by testing into optimal price-points.
  • BBC.
  • Google. One of their top designers, Douglas Bowman, left and spoke out against excessive use of the practice.
  • Intuit
  • Microsoft
  • Ebay
  • Yahoo!
Other Terms Used :
  • A/B/N Testing: A/B testing with more than two alternatives ("N" cells)
  • A/B/..Z Testing: Same as above
  • A/B/A: Only two alternatives, but one is repeated. This enables a quick visual of when the test reaches significance.
  • Multivariate Testing: A designed experiment where effects from two or more potential causal factors can be isolated from one another.
  • Multivariant Testing: same as above.

Thanks and Regards
Prashant Vadher | QC Engineer


Post a Comment

Design by Prashant Vadher