Reporting on product recommendations

This is for:

Developer

In this article, we’ll show you how to find the key metrics for each of your Recommendations experiences.

Intro

For each of your Recommendations experiences, we report the key metrics that will enable you to understand the value that the experience is driving for your business, not only in narrow terms of revenue and conversions, but also the in the wider context of engagement, for example, understanding the effectiveness of recommendations in encouraging your visitors to create a shopping cart, complete their order, and discover more products in your inventory.

These metrics will help you answer questions such as:

  • What is the RPV for those visitors that saw the experience?

  • How many transactions were a direct result of a product recommendation?

  • What percentage of visitors that interacted with a recommended product went on to purchase that product?

And help you with higher-level decisions around experience strategies and planning.

Warning

For the highest possible accuracy, it is vital that you emit the required Recommendations events and that you validate your QProtocol setup.

Warning

If you are not seeing any metrics, it is likely that you are not emitting the events that power reporting. Our latest Recommendations package "@qubit/recommendations": "^1.1.3" includes these events automatically, but if you are not using this package, we recommend you migrate to it, or emit the events manually in your Variation.js file.

Getting started

To view the metrics for an Recommendations experience, select Experiences from the side menu and open the desired experience.

If you are interested in the test results for your experience and specifically the performance of an experience as it compares to your control, switch to Results. If you would like to edit the experience, switch to Settings.

Using the Performance summary

The Performance summary card displays the key metrics for your Recommendations experience over the last 28 days.

For each metric, we provide a brief explanation in the form of a tooltip. Refer to the following tables for additional details.

Revenue

Key Metric Type Description Sub Metric Value Reporting

Attributed revenue

Currency

Total revenue attributed to visitors over the 28-day period that clicked a recommended product within 28 days of being recommended to

% of site-wide revenue attributable to the experience

Revenue driven by product recommendations

Attributed transactions

Integer

Total transactions attributed to visitors over 28-day period that purchased a recommended product that they clicked within 28 days of being recommended to

% of total site-wide transactions attributable to the experience

Transactions driven by product recommendations

Revenue Per Visitor

Currency

Total Revenue Per Visitor over the 28-day period for visitors that clicked a recommended product

Uplift compared to RPV for all site visitors

Uplift in RPV from product recommendations

Revenue Per Converter

Currency

Total Revenue Per Converter over the 28-day period for visitors that clicked a recommended product

Uplift compared to RPC for all site visitors

Uplift in RPC from product recommendations

Engagement

Key Metric Type Description Sub Metric Value Reporting

Interaction rate

%

Percentage of visitors that clicked (interacted) at least 1 recommended product within 28 days of being recommended to

Engagement driven by recommendations

Purchase rate

%

Percentage of those interactions that resulted in the purchase of the clicked product

Transactions driven by recommendations

Products per converter

Integer

Average number of unique recommended products purchased by visitors within 28 days of being recommended to

Uplift compared to products per converter for all site visitors

Effectiveness of recommendations in driving product discovery

Distinct products clicked

Integer

Total number of unique recommended products clicked by visitors within 28 days of being recommended to

Effectiveness of recommendations in encouraging visitors to explore an inventory

Total product clicks

Integer

Total number of recommended products clicked by visitors within 28 days of being recommended to

Effectiveness of recommendations in promoting products

Distinct products purchased

Integer

Total number of unique recommended products clicked and then purchased within 28 days of being recommended to

Effectiveness of recommendations in encouraging order completion

Total products purchased

Integer

Total number of recommended products clicked and then purchased within 28 days of being recommended to

Effectiveness of recommendations in encouraging order completion

For several metrics, we provide further context through a sub-metric. This either reports the impact of an experience as a percentage of the total site-wide metric, as seen in this example:

attributed revenue

Or a percentage uplift, compared to the site average, as seen in this example:

rpv

To the right of each metric is a line graph showing the selected metric over the entire 28-day period. By positioning the cursor over the timeline, you can see the metrics for any given data point over the reporting period:

data point

For several metrics, the line graph shows distinct lines for both the experience and your site’s accumulated traffic.

In the following example, we can see the RPV for an experience and the same metric for all your site’s traffic. The difference between the 2 lines represents the value driven by the experience:

experience vs site

A lightbulb moment

To really drive home the value that your experience is delivering, we present a key headline above the Performance summary card.

In the following example, we see that customers that interacted with the experience spent 26.76% more than the site average over the reporting period:

lightbulb

Metrics are displayed in 1 or more pages.

Navigate through these pages by selecting left arrow and right-arrow