Campaign Manager: A/B Testing

Hi all,
Has anyone done any A/B testing on Campaign Manager lately, and if so, how’ve they done the split?

I’m looking to just do a 50/50 split based upon 2 different emails.

Not bothered about decision making and AI on this occasion (although it’s obviously crucial down the line), just how to split the DB at random.

Any ideas?

1 Like

I am looking for the same, did you ever find out how to do this?

Hi @toby and @fjeldberg

Are you referring to A/B testing for emails? If so, I’d be happy to walk you through it.

How to Set Up an Email A/B Test

  1. On your Mautic instance, navigate to Channels > Email and create a new email.
  2. Write, design, or code your email as desired. Once finished, click Save & Close.
  3. In the top right corner, under More options, select Add A/B Test.
    image
  4. Create the second version of your email. Ensure this version is different, as you’ll be testing which performs better.
  5. In the right sidebar, rename the internal title to distinguish it from the first variant.
  6. Set the Traffic Weight. For a 50/50 split, enter 50 in the field.
  7. In A/B Test Winner Criteria, choose how you want to determine the winner. Personally, I often go with Read rate, but other metrics can be considered based on your goals.
    image
  8. Once done, click Save & Close.
  9. On the Email Statistics page, on the bottom, you’ll find a tab called Variants. Here, you’ll see both email variants with their corresponding traffic percentages (e.g., 50% each).
  10. That’s it! You’re now ready to use your A/B tested email in the desired campaign.

Note: You can create more than just two variants in an A/B test and adjust the traffic weight distribution as needed.

Hope this helps!
Best regards,
Ricardo

Hi @ricfreire thanks for the detailed reply! I can’t speak for @toby but I would like a way to do something on a campaign level. Such as sending 50% on route in the campaign an the other 50% another way. So not just A/B testing emails, but the entire flow.

Hi,
Here are 2 ways to do it: