How Froomle supports AB testing This page describes how our platform supports AB testing. Concept The user_group field describes which group a user is in and thus which party provides recommendations for this user. This value is set by Froomle in the recommendations and should be maintained in the subsequent integration events (click_on_recommendation, impression, …). For Froomle recommendations, the value froomle is used for this field. Blacklist is used for robot users. Froomle provides a fallback mechanism in case our personalized recommendation service is down or responding too slowly. In this case, such recommendations will contain the value fallback. Alternatively you can specify the user_group in your recommendation request and agree with us on how to handle the different versions AB Test scenarios Compare different versions of Froomle configurations Froomle provides recommendations to all users, and takes care of distributing users evenly across AB test segments. We use a single user group ("user_group":"froomle"), set by the Froomle platform Compare Froomle configuration(s) with non-Froomle recommendations These can be Froomle 'baseline' recommendations, NO recommendations or third-party recommendations. Froomle receives requests for ALL user groups (also for the groups for which we don’t need to provide recommendations!). Either the user groups are split by the Customer, either by Froomle. Froomle configures the Froomle and the baseline recommendations in its own platform for the froomle user_group. Froomle returns empty recommendations for the non-froomle user_group. For these requests, the customer can decide to show third-party recommendations/own solution (manually picked articles, …) Customer can use the user_group variable returned by Froomle to show the right recommendations. Integration events should be sent to Froomle for ALL user groups to enable us to measure & visualize (relative) results. Ideally this entails what is recommended (recommendation), what is shown (impression) and what is interacted/clicked (click_on_recommendation) Note: . If the customer does the user_group distribution, this field value should be sent in all events sent to Froomle (both integration as analytics events) The below figure illustrates our capabilities: