# Kakao Message A/B Test

{% hint style="success" %}
If you want to find the most effective Kakao Message campaign creative, use A/B Tests.

You can compare and analyze which creative drives higher user engagement under the same conditions to optimize your campaign.
{% endhint %}

{% hint style="info" %}
A/B Test configuration is only available in the **Production Environment**.

Message composition, metric settings, and traffic settings can be configured in the Production Environment. If you want to test in the Development Environment, complete the test-related settings in the Production Environment first, then switch to the Development Environment to run a send test.
{% endhint %}

### Step 1. Writing A/B Test Messages

Click \[+ A/B Test] in the message composition area to prepare the experiment and create multiple messages.

![](/files/41A6dRkP1cvjTbmGmmsR)

You can write a new message or copy an existing message to create multiple messages and run an A/B Test.

Up to 10 messages can be added. (Up to 10 including the control group when running a control group test)

![Example](/files/dFBmnxwalry9HJFAEogx)

#### Metric Settings

Once you have finished configuring the messages for the A/B Test, you must set at least one metric in the \[Metric Settings] area below that aligns with the campaign's main goal. (Minimum 1 — Maximum 5)

A metric is the reference value for objectively judging which message performed better among the test groups. Click the \[+ Create Metric] button in the lower right to create and add the metrics you need. (In CRM campaign A/B Tests, only event metrics can be added)

![](/files/kYQYtNE8HOa2GzM0BxjU)

Deleting and copying metrics can be done from \[Metric Management] in the left sidebar.

### Step 2. A/B Test Settings

Detailed A/B Test configuration continues in the **Send Settings** step.

#### Traffic Settings

Configure the traffic split for users who will receive the A/B Test messages.

* You can run an initial test on a portion of traffic, then send the better-performing message to the remaining users to optimize campaign results.

![](/files/IMzHNxPhbngAM0suFOLs)

* You can run a test on all traffic to check preferences for each creative.

![](/files/rRq2QW9ScQRpRFhr7cOb)

### Step 3. Starting the A/B Test

The A/B Test starts when the Kakao Message send begins. After the test starts, some time is required for initial data to be aggregated and reflected in the Dashboard.

![](/files/MeXQHyN5EbwsacWAKF0y)

> ❗️ Deactivating the campaign will end the ongoing A/B Test.

After deactivating the campaign, you can edit the message content. When you send the message again, a new version of the A/B Test will start.

Results from previous versions are saved separately, and you can view data by version.

![Ongoing A/B Test will end](/files/LnG5qkfNU9cy08EH3BXG)

![View previous version data](/files/16xYcVVrPtKpC6MYiKB4)

### Step 4. Ending the A/B Test

The A/B Test and the Kakao Message campaign status can be configured separately.

* After reviewing the results, if you want to send only the best-performing message, click \[End Test] to select the best-performing message (Winner).

![](/files/V8kWA2PnAxhqilWduP93)

1. **End Test**\
   Click the End Test button directly to end the ongoing A/B Test.
2. **Send Message**\
   If the A/B Test was run on a portion of traffic, you can send the better-performing message to the remaining users.
   * **Schedule-based (Immediate Send, Scheduled Send)**: After sending to the configured traffic, the message is sent to the remaining traffic.
   * **Event-based, API-based**: The Winner group's message is sent to all users.

Click the \[End] button at the top right of the screen to end the Push Message campaign.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.hackle.io/en/crm-marketing/kakao-message-guide/kakao-ab-test.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.