A/B Testing in Mobile

Last Updated July 26, 2022

Brief Overview

WalkMe Mobile AB testing allows you to manage any new campaigns or changes in a way that will ensure your users are getting the best experience. Having the ability to experiment with multiple versions of a campaign simultaneously provides more value to UI/UX designers and marketing teams, while also maintaining a seamless experience for your end-users. 

How It Works

In the Mobile Console, users manage AB Tests by creating groups, adding campaigns, and assigning percentages.

In App Settings, you will see a new tab called A/B Testing. Here you can view a list of all the A/B Test groups created, including:

  • Indicators for the number of campaigns in use
  • The last modified date; and
  • Whether the A/B Test is active or inactive

Limitations: Supported from SDK 2.14.0 for both iOS and Android.

Use Cases

Common use cases include:

  • Multiple versions of the same campaign (different images, text, etc)
  • Single campaign to % of user base
  • Control group (sees no campaign)

Creating an A/B Test

From the App Settings (Settings>App Settings):

    1. Go to A/B Tests tab.
    2. Click New A/B Test to display the test builder. 
      • An entry for the control group is predefined with 0%. 
    3. Type the Group Name.
    4. Click Add Campaign and select the desired campaign from the dropdown.
      • Repeat this step for up to 9 entries.
    5. Assign percentages as desired.
      • Sum of percentages must equal 100.
    6. Mark the test as Active.
    7. Click Save.
    8. Publish the campaigns.

Note the following:

  • Default max number of simultaneous active A/B Tests is 5.
  • If the same campaign appears in multiple A/B groups, and a user gets assigned this campaign more than once, the user will get the campaign once.

Reviewing Results

Once A/B Tests have run their course, you can review the campaign engagement and compare the impressions/clicks between the campaigns in each test.

Download the “A/B Testing Campaign Engagement” report.

Check out more about the Mobile Reports Tab.

Was this article helpful?

Thanks for your feedback!

Be part of something bigger.

Engage with peers, ask questions, share ideas

Ask the Community
×

Select account type

Close
< Back

Mobile account login

< Back