Preliminary A/B Testing?

Hey everyone, I migrated from Zoho Campaigns to Mautic. Zoho Campaigns had a feature that I wanted to try to recreate in Mautic, which is A/B testing different subject lines for an email with a small fraction of the list for an hour before sending the winning subject/email to the rest of the list.

Here’s what I did:

  • Created Segment Email (the subject line was Subject A)
  • Created two variants with the two subject lines, each with 5% traffic weight and made both available but did not schedule them
  • Made the parent segment email available and scheduled for 10am on Friday

Then 10am Friday came around, and nothing was sent out even after waiting an hour. So I went into the Variant A specifically and clicked “Send”, thinking it would send only to the 5% slated for Variant A, but it seems to have sent out to both variants, as well as the parent segment email.

How should I have gone about this to achieve the result I wanted? I was thinking that at 10am, 5% each would go to the two variants, and in around an hour I would have the ability to manually send out the winner to the remaining 10% of recipients.

Thanks in advance!

Your software
My Mautic version is: 6.0.3-apache