How to implement A/B testing

Why perform A/B testing? #

A/B testing is an experiment where two or more variants of a page are shown to users at random, and statistical analysis is used to determine which variation performs better for a given goal.

Testing takes the guesswork out of website optimization and enables data-informed decisions that shift business conversations from "we think" to "we know".

How to setup #

Entering campaign settings page by clicking [+Create New Campaign] if you want to set up a test from totally new.

Tip：If you want to run AB test on a previously created campaign, you can enter the campaign settings page at the following location.

You can see the campaign patterns on the left side of the settings page. Click on "+ Add version" to start testing.

Select [Create an A/B test] to create multiple patterns so that you can easily know which of the multiple patterns is more effective based on the test results.

By selecting [Create a control group] to create a pattern that displays the original page content, you can verify the actual effectiveness of the campaign by displaying the campaign to some visitors and having some users view the original page.

After completing the A/B test implementation, you can analyze the A/B test results.

Note：If the amount of data is small, the results will not be useful, so wait a little while until the data is accumulated.