Health Check
Use the Health Check to verify that everything is ready to start an A/B Test, or that the test is running correctly.
User Identifier Delivery
Checks whether the User Identifier selected as the distribution basis for the A/B Test is being sent to Hackle correctly.
If the alert is red
Refer to the User Identifier document to send User Identifier information.
Check the Real-time Exposure Status from the button below. Verify that the User Identifier selected as the distribution basis exists.
If the alert is yellow
Check Real-time Exposure Status for users exposed within the last 1 hour. If there are none, check again after a user has been exposed.
If there are exposed users, check the User Identifier delivery. A code change may have caused the delivery to fail. Refer to the User Identifier document.
Event Delivery
Checks whether the events used when registering goals, retention, and funnels in the A/B Test are being sent correctly.
If the alert is red
Send the event items in the box below to Hackle. Click an item to check its real-time status.
If items remain after delivery, check the User Identifier information. Events must include the User Identifier information used as the distribution basis. Refer to the User Identifier document.
If the alert is yellow
Click each event item to check whether the event has been sent within the last 1 hour.
If the item still appears even though there is a delivery history, check the User Identifier information. Events must include the User Identifier information used as the distribution basis. Refer to the User Identifier document.
A/B Test Exposure
Checks whether at least one user has been exposed to the A/B Test and distributed to a test group. You can verify whether users have actually participated in the A/B Test in the production environment. This can be checked 1 hour after the A/B Test starts.
Check that both the User Identifier delivery and Event delivery items are normal.
Verify that at least 1% of traffic has been allocated. If the test has started but traffic is still at 0%, users will not be exposed to the A/B Test.
Check that the A/B Test Targeting is working correctly. Property information used in targeting conditions must be collected. Refer to the Set Targeting document.
Data Calculation
Checks the calculation results of the registered goals, retention, and funnels. For any item whose result is 0, go through the checks below in order.
Verify that the A/B Test integration, event delivery, and A/B Test exposure are all normal.
For items with a filter applied, check the event property used in the filter. Open the relevant event in Event Management and check its Event Property.
Last updated