Split Test Variant Selection: Round Robin vs. Random

In this article, you'll learn how the selection process for split test variants works and the difference between the round robin and random methods. Please note, this feature is only available from the Deluxe version onwards. The previous method used was round robin.

1st user receives variant 1
2nd user receives variant 2
3rd user receives variant 3
4th user receives variant 3
5th user receives variant 1
6th user receives variant 2
7th user receives variant 3
8th user receives variant 3
9th etc.

If two or more split tests with the same weighting but different test content are started simultaneously, the same combinations would always be delivered during the round robin, i.e. always variant 1 (split test A) with variant 1 (split test B) etc.

In practice, this could mean that I would like to test, for example, the speech Hello (Var. 1) against the speech Welcome (Var. 2) or Dear interested party (Var.3), but also the color of the text in red (Var. 1), blue (Var. 2) or black (Var. 3).

With the round robin method, only the combinations “Hello / red,” “Welcome / blue,” and “Dear prospective customer / black” would be possible, as the three split tests are limited to these combinations.

The → Random method closes this gap, allowing all possible combinations of the three split tests to be delivered.

Favorite variants and combinations remain controllable by the weighting, as they are displayed more frequently than the others.

Start your tests today and elevate your marketing strategies to the next level.