Aaron Shear from Clickz shares his thoughts on doing A/B testing for large websites with multiple categories and product pages. He says “One of the most difficult things to explain to upper management is just how problematic it can be to do A/B testing on SEO 
strategies on large sites. There are so many moving parts that could easily cause the test to be contaminated through the process.
The most commonly used strategy for A/B testing in large businesses is to take an entire category, or just a sampling of pages within the site, and make a few changes. The idea here is that you can take a small sample of the site with little to no harm and measure its change. This type of test will fail in every case, due to what I call the bleeding factor.”
He also suggests that its better to do A/B testing on a global level to all the similar page types and then measure on the impact however small it may be.
Leave a Reply