InterviewSolution
Saved Bookmarks
InterviewSolution
| 1. |
Why Isn’t My Split Exactly 50/50? |
|
Answer» Sometimes during A/B TESTS you may NOTICE that the traffic numbers of each variation are not identical. This doesn’t mean that anything is wrong with the test, just that random VARIATIONS work, well, randomly. THINK about flipping a coin. You have a 50-50 shot of heads or tails, but sometimes you get three tails in a row. As more traffic hits your SITE, however, the numbers should become closer to 50-50. Sometimes during A/B tests you may notice that the traffic numbers of each variation are not identical. This doesn’t mean that anything is wrong with the test, just that random variations work, well, randomly. Think about flipping a coin. You have a 50-50 shot of heads or tails, but sometimes you get three tails in a row. As more traffic hits your site, however, the numbers should become closer to 50-50. |
|