Forum Discussion

c_hixon's avatar
c_hixon
Practitioner
2 years ago

A/B Testing

We're looking to setup our first A/B email test within Braze and I was wondering if someone could help with the following questions: 

1. Is the initial test over as soon as the winner is determined? 

2. What happens if there is no winner?

 

  • Linh's avatar
    Linh
    Active Member

    Hi c_hixon! Maybe I could help with your question.  

    1. I think the duration of the test is decided by you and your team when setting up the campaign, so the test would be running as long as you want it to be. Unless you select the Intelligent Selection option which will repeatedly look at performance data and shift campaign traffic toward winning variants gradually. 

    2. When an A/B test doesn't show a clear winner, it could be due to the fact that there are not many determining differences between the 2 variants, or the volume is not enough to give a significant result. Try to target a larger audience over a longer period of time. And rethink your A/B testing strategy after all 🙂 

    Hope this helps!

    Linh.