Ctrlk
HomepageBlogContact Sales
For the complete documentation index, see llms.txt. This page is also available as Markdown.

How to Run a URL Test

Preparation

1

Create a URL Test

Go to the A/B Test tab > click the [Create New A/B Test] button > click [URL Test] in the modal to create a new URL Test.

2

Enter the hypothesis to validate

Enter the hypothesis you want to validate through the experiment and a name for the experiment to create it.

3

Enter group descriptions and URLs

In the URL Test detail screen, go to the [URL Settings] tab to enter a description for each group and input the URLs, then save.

For Group A, enter the URL of the existing version where the URL Test starts.

To set multiple URLs as experiment targets, use **[+ Add OR Condition]**. For example, if you set URL 1 or URL 2, all traffic entering either URL becomes the experiment target.

Select a matching condition

Choose the condition that fits your experiment scope and URL structure.

  • Exactly matches: Includes only URLs that exactly match the URL you entered.

    • Input URL: http://www.example.com/category/1/product/1/display/1

    • Excluded example: http://www.example.io/category/1/product/1/display/1

    • Excluded example: http://www.example.com/category/1/product/1/display/1/utm=source

  • Starts with: Includes all URLs that start with the URL you entered.

    • Input URL: http://www.example.com/category/1/product/1

    • Included example: http://www.example.com/category/1/product/1/display/10

    • Included example: http://www.example.com/category/1/product/1?search_keyword=example&utm..

  • Contains: Includes all URLs that contain the segment you entered.

    • Input value: promotion/best-seller/product/1/display/10

    • Included example: www.hackle.io/promotion/best-seller/product/1/display/10

    • Included example: www.hackle.co.kr/promotion/best-seller/product/1/display/10/utm=source

Korean URLs are compared the same as their encoded values. You can enter URLs containing Korean characters as they are.

4

Check and insert the integration code

Click the [View Code] button at the top to see the Code Guide.

Add that code inside the <head> of the page at the URL you want to test.

If you entered 3 URLs to test, you must add the code inside the <head> of all 3 pages for the experiment to work correctly.

5

Set Metrics

Click [Set Metrics] at the top to add metrics that measure the impact and success of this experiment.

6

Set Targeting

Use [Set Targeting] to define which users will be exposed to this experiment.

Mutually Exclusive Settings

If multiple experiments are running simultaneously or you want to manage traffic separately, you can configure mutually exclusive settings.

Mutually Exclusive Settings can be configured by clicking the [Mutually Exclusive Settings] tab as shown in the image below.

Running

1

Start the experiment

Once preparation is complete, click [Start] at the top to begin the URL experiment. In the modal that appears, verify the URL and integration status.

2

Health Check

Before running the experiment, check the integration status, registered event delivery status, and more.

3

Traffic Allocation

The traffic percentage to allocate to the A/B Test can be set from 0(%) to 100(%), and is distributed evenly (1/N) among the configured groups.

You can change the traffic percentage after the experiment starts, but note that you cannot set a lower value than the previously configured value.

4

Data Analysis & Result Interpretation

Once the experiment is running, detailed data for the configured [Metrics] will be displayed.

Even if you add a metric while the experiment is in progress, that metric is calculated based on data from the test start time, so you can add it at any time during the experiment.

5

Changing the Status

Even after an experiment is running, you can use Pause or Version Management.

PreviousURL Test vs A/B Test
NextURL Test Integration Code

Last updated