What can you do with the A/B test feature?
By using this feature, you can compare site performance with and without Videowise widgets in order to measure their impact on the site.
A/B test requirements
In order to have the A/B test record accurate results, you will need to make sure the Videowise pixel version is at least 1.5 - for this, simply check your Videowise tracking pixel and make sure the PIXEL_VERSION is at least 1.5.
Should you not have the required pixel version, simply go to this document and follow the steps to install the latest version of the tracking pixel.
Useful tip: The A/B test feature is available for all widgets except the Autoplay Ambient Video and the Product gallery video.
How to perform an A/B test
Create, set up and install the widget you wish to perform an A/B test for (A/B tests can only be performed for widgets on the live version of your theme).
Go to the A/B Testing tab of the widget you wish to perform the A/B test on.
Set the audience percentages (50-50% by default, but you can adjust it by using increments of 10%)
4. Once the test is underway, you will start seeing the indicators of the A/B test.
Audience - the percentage of the audience you set at the beginning of the test.
Views - number of unique views within the same session
Orders - number of total orders
Total revenue - total amount of revenue brought in by the orders
RPS (Revenue per session) - Total revenue / Views
AOV (Average order value) - Total revenue / Orders
Conversion rate - The ratio between orders and views, expressed as a percentage
Be advised that once you end an A/B test (by clicking on the "End test" button, there is no way to reactivate the same test - if you wish to perform an A/B test on the same widget, you will need to start a new A/B test.
Also, A/B test views and orders do not count towards Analytics, as they are just part of an A/B test, not the overall results of Videowise throughout the site.
Best practice: We recommend running an A/B test for at least two weeks in order to get relevant results.