For the complete documentation index, see llms.txt. This page is also available as Markdown.

Create a New A/B Test

Good to know

  1. You can create a new A/B Test in both the Production Environment and the Development Environment. Creating in one environment also creates the same A/B Test in the other environment.

  2. Try copying an existing A/B Test to save time. If the settings for the new A/B Test are the same or similar to an existing one, you can copy the existing A/B Test to quickly create a new one.

Click the + Create new A/B Test button in the upper right of the A/B Test menu on the Dashboard to create a new A/B Test.

Create a new A/B Test

Step 1. Enter A/B Test information

A/B Test information
  • A/B Test name: Required. Enter the name of the A/B Test you want to run.

  • A/B Test description: Optional. A description helps other team members understand what the A/B Test is about.

  • A/B Test hypothesis: Optional. Enter the hypothesis you want to validate through the A/B Test.

Step 2. Configure A/B Test groups

This configuration is about registering the current version (baseline) and the improved version(s) to be compared in the A/B Test. The existing version that users are already seeing before the A/B Test starts is called Group A, and the version(s) you want to test are added to Group B, C, and so on. You can add test groups using the + Add new group button at the bottom.

A/B Test group configuration

You can delete groups when there are 3 or more groups, targeting groups other than Group A. Click the X button on the right to delete a specific group.

Step 3. Complete test creation

Once you have finished configuring the test groups, click the Create test button in the lower right.

Create test

You have now completed creating the A/B Test. You will be taken to the detail screen of the newly created A/B Test.

Next steps after test creation

Last updated