Data Analysis

The Data Analysis tab is only accessible in the Production Environment.

Overview

The Data Analysis tab is displayed by default when entering an A/B Test detail view in the Production Environment that is not in Draft state. Here you can view the goals configured for the A/B Test and the collected data. Note that collected data can only be viewed at least 1 hour after the A/B Test starts.

Data is updated every 1 hour.

1. Draft State

When no goal has been set

Since there is nothing to display, a Not enough data yet message appears.

When a goal has been set

You can view the configuration for the goal. Since the test has not started, no data is shown. Data will be available within 1 hour of starting the A/B Test.

When Data Segment Analytics have been configured

A message appears indicating that data will be available within 1 hour of starting the A/B Test.

After 1 or more hours since starting the A/B Test

Data collection results appear. If there are significant results, you can also see a Significant badge. When the A/B Test is stopped, data will no longer be updated, but data up to the stopping point will remain available for viewing.

Data Segment Analytics also takes approximately 1 hour to update, and similar to goals, you can view data up to the point the test was stopped. After stopping, you cannot add Segment Criteria, so the Set Manually button disappears.