experimentation
12 TopicsAudience Path through event properties
Hello community! I need your help to set up a Canvas Flow: Context: In our subscription we are customising the unsubscribe flow based on the reason. We register this reason as an event property of the event that triggers the flow ( subscription cancel complete). Problem: It does not find the way to direct the users in a flow or another depending on the property of the event, since the ''audience path'' tool does not allow to split by event property. How would you do it? I could do it through conditions and liquid, but the flows are not exactly the same for all properties/reason. Thank you very much!Solved45Views1like3CommentsSystem-led QA with Braze
Hi there! Our team has had a few incidents where emails have been sent to the wrong audience (i.e. filtering didn't save, filtering never added, duplicate tabs open, etc). We've implemented a number of human-led QA processes (see below) but we want to implement system-level guardrails as well. Does anyone know of a) Braze features that would let us do this or b) hacky ways that involve our engineering team? Any/all help would be GREATLY appreciated! What we plan to implement: formal QA process (including live QA) Braze approval process Audience and rate limits Datadog alerts for post launch if anything sends to audience >10K20Views0likes1CommentTransactional Push Notification ideas?
Hi - We hope to launch some basic transactional push notifications which we were told were high performers! I was wondering if anyone has done something similar and if they had any ideas of some of the 'lower hanging fruit' of transactional push's that were high performing... Some examples that we are starting with are: 1. Order Confirmed 2. Order Shipped 3. Order Delivered Are there any other 'transactional' messages such as the above that you have seen success with?32Views0likes1CommentForge Canvas Template: Product repurchase reminder (with timing and channel testing)
Hello fellow Braze orchestrators, I didn't make it to Forge in person this year, but it was great tuning in to the keynotes and catching up on all the latest Braze innovations. 🔥 Here is a quick Canvas that we are about to launch to drive repurchase of two of our products that customers need to by on a regular basis. Entry criteria: purchase of a certain SKU Experimentation (both set up as Personalized Path): Message timing (30 days vs 45 days after the purchase) Message channel (email vs SMS, in this case) Message sequence: A user gets a reminder to repurchase the product she might be running low on; If a user engages with the message from step 1, but does not purchase, he receives a reminder 3 days later with a special offer, to incentivize the purchase. Let me know if you see any opportunities for improvement. I imagine, soon we will be able to simplify this flow by leveraging all the upcoming Braze AI tools. Cheers, Olga Baker Charlie Banana / P&G92Views5likes1CommentForge Canvas Template: Frequency/Channel mix Experiment Setup”
This Canvas serves as a starting point for setting up an experiment aimed at sending specific sub-groups of a user population down the engagement journey that has the highest likelihood of converting them. The criteria that differentiate the journey in this Canvas are tied to two variables: 1. Frequency: n times over n periods depending on the use case, industry, and type of product. For example, n times per week for n weeks. Both the 'times' and 'periods' should be customized according to the use case. 2. Channel mix: combinations of at least 2 channels based on the use case, industry, and type of product. For example, a push notification followed by an email or an IAM followed by an email. The channels to test should be customized based on the use case. The goal here is to leverage Braze's personalization systems to take experiments to the next level: no more simple A/B tests where all users are sent down the engagement journey that converts the most overall. Instead, specific sub-groups of the population will be sent down different, specific paths based on their unique characteristics/preferences. This allows us to avoid a 'one size fits all' approach and instead create multiple journeys that users can experience based on what they prefer (and what tends to convert users like them better 😉 )." I’ve been using this setup for a while, and the uplift compared to a single experience for the entire population (chosen after multiple iterations of a classic A/B test) is significant. Let me know what you think and if you have any ideas for improving this setup!65Views2likes1CommentConversion Rate over 100%?
Hi, I'm struggling to understand the performance of one of our Canvases. I have both the conversion event and exit criteria as "any purchase", and users cannot re-enter the canvas. When I analyze the variants, I see more conversions than entries, leading to a conversion rate over 100%, which shouldn't be possible. Does anybody know what could be going wrong here? thanks!110Views0likes5CommentsThe Personalized Variation Test in Campaign
We are doing our first A/B test out of Braze and the client wants to utilize the Personalized Variation test vs. the Winning Variation test. Now since we don't have many campaign history to go by since we just started deploying out of Braze, does that matter if we still run the Personalized Variation test? Does it go by past history characteristics OR solely similar characteristics on the initial test?156Views0likes0CommentsQuestion on testing for BlaBlaCar - Test and Learn AMA
GuendalinaIn the intro to this AMA session, I saw that you've been testing different "From" names in different markets. We've done this as well in multiple markets across Europe and North America. I'm curious to learn which types of names worked better than others, how many variations you tested and how long the tests lasted for.386Views1like2CommentsIdeas for email open and click through rate testing
Hi all Just wondering what sort of tests others use to test open rate and click-through rate. For example: - Subject lines - Time of day - CTA wording - Localisation Would love to gather a laundry list of ideas to experiment with. 📃😁202Views0likes1CommentMeasuring Primary Conversion (A) and Conversion B in Canvas
Hi All, Hope you are all doing well. Had a query around tracking for Conversion Events A and B in the canvas. If I have my primary conversion defined as " sales form completed" and the secondary as "sales form started", would the same users appear potentially in both conversion events or only unique users are accounted for (once) across both conversion events A and B? Cheers RajSolved307Views0likes1Comment