Fastr Workspace - How to perform A/B Testing

Overview

In Fastr Workspace you are able to set up A/B tests for comparing the performance of your experiences. This article will go over the options for setting up a basic A/B test, as well as some frequently asked question. For information on the basic publishing steps, please review here: 

Fastr Workspace - How to Publish

Creating an A/B Test

1. The first step is having multiple experiences in a single content slot, as shown below. For this example, you can see that I currently have "Example A" live in my content slot. I have created an "Example B", which is a different experience that I want to use for A/B testing.
2. Next, you will want to click on your second experience, and drag it on top of the currently live experience. You can see in the example below, I am click and dragging Example B, and placing it on top of Example A
   
3. This will automatically set-up an A/B test with 50/50 traffic, as shown below. To change the traffic, you can just click on the "50%" area and type a new number in. The values will automatically adjust to reflect 100% traffic as you make changes. 
   
4. Please note: Your schedule will not be saved unless you publish these changes. As a final step, it is required that you select the "Publish Changes" icon as shown here. This is required in order to make sure that your schedule is finalized: 
   
5. If you'd like to cancel your A/B test, you can just click and drag the experience and remove it from the designated publishing area. Once again, this would require the "Publish Changes" icon to be selected to finalize these changes.

A/B Testing FAQs

1. How do I measure the results of my A/B Test?
   • Answer: For full information about analytics, please contact support@getfastr.com for the time being
2. Can I A/B test with an empty experience?
   • Answer: Yes, you are able to set-up an A/B test where some traffic is not seeing an experience. This can be helpful for a promotion banner that is not visible to 100% traffic. You can set this up by changing the traffic percentage below 100%, as shown here: 
     
3. Can I schedule an A/B test?
   • Answer: Yes, you are able to set-up an A/B test inside of a schedule entry. For more information on setting up a schedule, please review here: Fastr Workspace - How to Schedule
4. Can I set-up an A/B test with more than two experiences?
   • Answer: Yes, you are able to have an A/B test with as many experiences as you would like. You would just drag and drop any additional experiences into the same slot, and adjust the traffic as needed. 

If you have any follow-up questions or need further assistance, please feel free to reach out to us at support@getfastr.com — we're happy to help!