Finding Search Implementation Successes and Issues With Metrics

Usage analytics cards such as table, metric, and trend cards display colored metric values:

Admin-MetricValueColor

  • A green value either means, depending on the metric, that the value has improved compared to a certain period (in trend cards) and/or that your Coveo search interface has a good search relevance.

  • A black value can either be neutral or have no signification depending on the metric.

  • A red value either means, depending on the metric, that the value is retrogressing compared to a certain period (in trend cards) and/or that your Coveo search interface has search relevance issues.

You can create analytics dashboards to learn for which metrics their search interface performs well and which metrics signal potential relevance issues (see Who Can Perform the Page Actions and Usage Analytics Metrics).

Find Search Implementation Successes and Issues With Metrics

  1. Access a report in Edit mode (see Access a Dashboard in Edit Mode).

  2. In the dashboard:

    1. Add table, metric, or trend cards and report on at least the following relevance metrics, which are necessary to have an overview of search result relevance (see Adding Metric Cards in Usage Analytics Dashboards, Adding Table Cards in Usage Analytics Dashboards, and Adding Trend Cards in Usage Analytics Dashboards):

      For trend and metric cards, you have to select a dimension on which the metric calculation is based on. It is recommended to select Origin 1 (page/hub) or Origin 2 (tab/interface) at first to have the global overview of the search relevance of your interface/search page.

      • Average Click Rank

      • Query Click-Through (%)

      • Relevance Index

    2. Review the metric value colors, and take action if necessary.

      The following table lists all available metrics, thresholds to determine value colors (if any), and for which metrics a higher value is better and vice versa:

      Metric Threshold (if any)1 Higher values are always better2 Low values are always better Goodness of a value depends on the context3
      Activity
      Attach to Case Count
      Click Count
      Query Click-Through (%)
      • Green if > 60%
      • Black between 40-60%
      • Red if < 40%
      Queries With Click
      Relevance Index
      • Green if > 0.7
      • Black between 0.5-0.7
      • Red if < 0.5
      Average Click Rank
      • Green between 1-3
      • Black between 3-6
      • Red if > 6
      Custom Event Count
      Manual Query Count
      Query Count
      Refined Query Count
      Unique User ID
      Unique User IP
      Unique Visitor ID
      Visit Count

      Note 1: Values are colored regardless of the usage analytics card in which the metrics appear.

      Note 2: (If no thresholds) In comparison to a previous period, in trend cards only, higher values are green and lower values are red.

      In other cards (table, metric, …) the values of those metrics are not colored.

      Note 3: Since the goodness or badness of each metric value depends on the search implementation, and on the dimensions and filters applied, the values of those metrics are always displayed in black, regardless of the usage analytics cards in which they appear.

      • A high Custom Event Count value is bad when reporting on the number of cases created.

      • A high Custom Event Count value is good when reporting on the number of cases deflected.