Let's say you’ve brainstormed as a marketing TEAM and you have four great ideas for a landing page DESIGN. It can be tempting to run all four treatments at once to declare a winner, but similar to the variations issue above, it’s not a true A/B test if you have multiple different treatments running at once. A number of factors from each different design can GET in there and muddy the test result waters, so to speak. The beauty of an A/B test is that its results are straightforward and CONCRETE. We suggest running two VERSIONS against each other, and then running a second test afterwards to compare the winners. Think of it as a really techy basketball bracket.

Let's say you’ve brainstormed as a marketing team and you have four great ideas for a landing page design. It can be tempting to run all four treatments at once to declare a winner, but similar to the variations issue above, it’s not a true A/B test if you have multiple different treatments running at once. A number of factors from each different design can get in there and muddy the test result waters, so to speak. The beauty of an A/B test is that its results are straightforward and concrete. We suggest running two versions against each other, and then running a second test afterwards to compare the winners. Think of it as a really techy basketball bracket.