Troubleshoot ART models
Troubleshoot ART models
Coveo Machine Learning (Coveo ML) Automatic Relevance Tuning (ART) models learn from click, search, and custom usage analytics events that occurred sequentially during the same visit. Based on those events, a given ART model extracts candidates, which are queries for which the model can recommend at least one item, and provides the most relevant items as top search results.
|
Note
An ART model learns from the way users interact with your website. The more traffic you have, the better the model will get. However, an ART model needs a minimum of 100 click and search events to start boosting items among the top search results (see About search result ranking). With under 100 events, an ART model doesn’t boost the ranking weight of any item. You can however reduce the amount of events required to build the model if needed. To help a new model, you can train it by linking queries to results. |
|
ART requires real data from a specific community to ensure ART results respond to real user intentions. Therefore, it’s strongly NOT recommended to provide false generated data. |
Sending the required usage analytics event data
Items can be used in ART model building only if they’re identifiable from the usage analytics events that pertain to them.
To that end, the contentIdKey
and contentIdValue
parameters must be present in the customData
of the click events on that item.
For technical details on those events, see Log Click Events.
Reviewing your Coveo ML ART model learning dataset
When you have the required privileges, you can use the Analytics section of the Coveo Administration Console to browse user visits, and therefore evaluate if your search interface produces enough data.
The following procedure assumes that you’re familiar with global dimension filters and Visit Browser features (see Review user visits with the Visit Browser).
-
On the Visit Browser (platform-ca | platform-eu | platform-au) page:
-
Select a date interval of three months (see Review search usage data by date interval).
-
In the Show visits containing section, add the following filters (see Add visit filters):
-
a search event WHERE:
-
Query is not blank or n/a
-
Origin 1 (page/hub) is [
Search page or search hub name
] -
Origin 2 (tab/interface) is [
Tab or search interface name
] -
Language is [
Language
]
-
-
and at least a click event
-
-
-
At the lower right of the screen, you can see the number of visits in the selected period from which an ART model could learn.
Training ART models by linking queries to results
When leveraging Coveo ML, manually adjusting the relevance of search results (e.g., creating query pipeline rules) becomes less necessary. For example, you no longer have to create thesaurus rules since ART models recommend the same results for different queries when they contain synonyms simply by analyzing the usage analytics data of a specific search interface. You can help accelerate the learning process of an ART model by linking queries to results such as pointing synonyms as well as words behind acronyms.
|
Notes
|
To help train Coveo ML ART models by linking queries to results
-
Ensure thatCoveo ML ART is configured and enabled on your search interface (see Create an Automatic Relevance Tuning model).
-
On your search interface, perform a query, and then click the result you want to be recommended.
-
Repeat the procedure for each desired query.
-
Once the model is trained, on the Content Browser (platform-ca | platform-eu | platform-au) page, ensure that the model returns the expected result (see Inspect items with the Content Browser). Repeat the procedure if needed.
|
Note
After the next (scheduled) model update, your model will recommend results based on your training. |