Identify Relevance Issues

You can tune search result relevance with Coveo by analyzing the queries, keywords, and clicked items to identify the top occurrences with clicks on items that don’t appear at the top of the search results list. Identifying items that are poorly ranked for frequent queries helps you focus on important relevance issues to fix.

To identify relevance issues

  1. Access the Administration Console Search Relevance explorer (in the navigation bar on the left, under Analytics, select Reports, and then on the Reports page, in the Name column, click Search Relevance).

    By default, the Relevance Index and Average Click Rank metrics are shown in the data table.

  2. Sort the table with ascending Relevance Index metric values to highlight the most important relevance issues.

    Similarly, you can sort the table with descending Average Click Rank metric values to highlight cases where items were opened far in the list of search results. However, unlike the Relevance Index, the Average Click Rank metric doesn’t consider the frequency of the measured event. Consequently, events with highest Average Click Rank values (particularly those higher than 3), are sometimes for events that occurred only once or just a few times.

  3. Get more details on a user query:

    1. In the table, bring the mouse pointer on a user query with a low Relevance Index value that you would like to investigate.

    2. In the table cell, click Check-Mark that appears next to the query to automatically create a filter to drill down into this query.

      You want to look into more details relative to the picture quality query that has the lowest Relevance Index value.

      Admin-QueryDrillDown1b

      The filter appears on the top bar.

      Admin-QueryDrillDown1c

  4. In the table, add the Search Result (click) or the Document Title (click) dimension (depending on your organization settings) to see which items were opened by visitors performing this query.

  5. Look at the items with the lowest Relevance Index values (particularly those lower than 0.50) with the following questions in mind:

    • Are the item titles good for this query?

    • Are titles misleading?

    • Should some of the keywords of the query be added to the item title or content?

  6. In the search interface, perform the query and look at the search results with the following questions in mind:

    • Does the ranking look good?

    • Are there any clear issues with the item titles?

    • Are the search words emphasized in the item?

    • Are people using different keywords to search for this item?

  7. Consider using the following methods to improve ranking:

Recommended Articles