Kakao Message A/B Test
If you want to find the most effective Kakao Message campaign creative, use A/B Tests.
You can compare and analyze which creative drives higher user engagement under the same conditions to optimize your campaign.
A/B Test configuration is only available in the Production Environment.
Message composition, metric settings, and traffic settings can be configured in the Production Environment. If you want to test in the Development Environment, complete the test-related settings in the Production Environment first, then switch to the Development Environment to run a send test.
Step 1. Writing A/B Test Messages
Click [+ A/B Test] in the message composition area to prepare the experiment and create multiple messages.
You can write a new message or copy an existing message to create multiple messages and run an A/B Test.
Up to 10 messages can be added. (Up to 10 including the control group when running a control group test)
Metric Settings
Once you have finished configuring the messages for the A/B Test, you must set at least one metric in the [Metric Settings] area below that aligns with the campaign's main goal. (Minimum 1 — Maximum 5)
A metric is the reference value for objectively judging which message performed better among the test groups. Click the [+ Create Metric] button in the lower right to create and add the metrics you need. (In CRM campaign A/B Tests, only event metrics can be added)
Deleting and copying metrics can be done from [Metric Management] in the left sidebar.
Step 2. A/B Test Settings
Detailed A/B Test configuration continues in the Send Settings step.
Traffic Settings
Configure the traffic split for users who will receive the A/B Test messages.
You can run an initial test on a portion of traffic, then send the better-performing message to the remaining users to optimize campaign results.
You can run a test on all traffic to check preferences for each creative.
Step 3. Starting the A/B Test
The A/B Test starts when the Kakao Message send begins. After the test starts, some time is required for initial data to be aggregated and reflected in the Dashboard.
❗️ Deactivating the campaign will end the ongoing A/B Test.
After deactivating the campaign, you can edit the message content. When you send the message again, a new version of the A/B Test will start.
Results from previous versions are saved separately, and you can view data by version.
Step 4. Ending the A/B Test
The A/B Test and the Kakao Message campaign status can be configured separately.
After reviewing the results, if you want to send only the best-performing message, click [End Test] to select the best-performing message (Winner).
End Test Click the End Test button directly to end the ongoing A/B Test.
Send Message If the A/B Test was run on a portion of traffic, you can send the better-performing message to the remaining users.
Schedule-based (Immediate Send, Scheduled Send): After sending to the configured traffic, the message is sent to the remaining traffic.
Event-based, API-based: The Winner group's message is sent to all users.
Click the [End] button at the top right of the screen to end the Push Message campaign.
Last updated