Reviewing the Search Usage Trends From the Summary Dashboard

The Summary dashboard is divided into the four following sections: Activity, Keywords, Relevancy, and Content Gaps. You can use this page to review the search activity, evaluate the search relevance, and identify the content gaps of your search.

The purpose of the administration console Summary dashboard is to provide a quick overview of various search metrics, such as Search Event Count, Click-Through, and Average Click Rank, for selectable date intervals such as Last Week or Last Month. Lists of the top user queries and keywords with low relevance and without results provide valuable information that can be quickly reviewed on a regular basis to help you identify usage trends and anomalies to determine when further analysis is required.

Information in this article refers to the out-of-the-box Summary dashboard that can be renamed, modified, or deleted by a member with the required privileges. Consequently, the Summary dashboard may be missing or modified in your Coveo Cloud organization. You can recreate the Summary dashboard using the Summary template (see Creating Usage Analytics Dashboards).

Access the “Summary” Dashboard in Edit mode

  1. Log in to the Coveo Cloud platform as a member of a group with the required privileges to manage reports in the target Coveo Cloud organization, if not already done.

  2. In the main menu on the left, under Analytics, select Reports.

    The following message appears on the page when Coveo Usage Analytics (Coveo UA) isn’t activated for your Coveo Cloud organization. Contact Coveo Support to activate Coveo UA for your Coveo Cloud organization.

    This section is not available for your Organization.

  3. On the Reports page:

    • Click the Summary dashboard, and then in the Action bar, click Open.

      OR

    • Double-click the Summary dashboard.

    The Summary dashboard comes out-of-the-box in any Coveo Cloud organization. This dashboard could have been deleted, renamed, or modified. If missing, you can recreate the report using the Summary template (see Creating Usage Analytics Dashboards).

  4. In the Summary dashboard, in the top right corner of the screen, click Edit.

    Changes you made prior accessing the Edit mode are kept. You must thus remove these changes (if unwanted) before saving the report.

Review the Available Graphical and Numerical Metrics

  1. Access the “Summary” Dashboard in Edit mode.

  2. In the Summary dashboard, inspect the available metric values:

    You can determine trends by comparing specific data with data from a prior period. When available and selected to be displayed, the indicator shows the percentage of increase or decrease for a metric in comparison with the same selected period that preceded (week, month, year…).

    Admin-DetermineTrend

    (Coveo for Salesforce only) The indicator may be unavailable when the date interval over which you review search usage data exceeds your license limit. In which case, you get the following error message (see Coveo for Salesforce Edition Comparison):

    No trend data available. Selected comparison range exceeds license limit.

    • In the Activity tab:

      • Clicks Over Time

        This timeline graph shows the number of clicks per day for the selected date range and filters. The numerical values on the right side show the Click Event Count total, daily Average, and Peak (highest number of clicks during a day) click values for the selected period. The percentage value represents the % change of the Click Event Count total compared to the total for the same previous period (week, month…). When evaluating adoption, the trend going up indicates that search usage is increasing.

      • Queries Over Time

        This timeline graph is similar to the Clicks Over Time one, but rather reports search count.

      • Visits Over Time

        This timeline graph shows the number of visits (regardless of unique IP addresses and user names) per day for the selected date range and filters. The numerical value on the right side shows the Visit Count and the percentage value represents the % change of this total compared to the total for the same previous period (week, month…). When evaluating adoption, the trend going up indicates that search usage is increasing.

    • In the Keywords tab:

      • Unique Keywords

        This timeline graph shows the number of unique keywords per day for the selected date range and filters. The numerical value on the right side shows the total of Unique Keywords. When hovering over the value, the daily Average, and Peak (highest number of unique keywords during a day) values appear on the timeline for the selected period.

    • In the Relevancy tab:

      • Average Click Rank Over Time

        This timeline graph shows the average position of clicked items in the search results for the specified dimensions. The value is greater than zero. Lower values are better. A value of 1 would mean that users always open the first item in the search results list. A value of 10 and over should be investigated. The upper right numerical values show the average of all daily averages for the selected period.

        The average of daily averages value can be under one because days with no clicks are included in the calculation.

      • Click-Through Over Time

        This timeline graph shows the percentage of queries with at least one click on search results per day for the specified dimensions and filters. The value is between 0 and 100. Higher values are better. The numerical values on the right side show the average of all Search Event Click-Through (%) daily averages for the selected period and the change of this average compared to the one for the same previous period (week, month…). When evaluating adoption, the trend going up indicates that search usage is increasing.

    • In the Content Gaps tab:

      • All Queries

        This timeline graph displays the number of queries per day that were not empty or n/a for the selected date range and filters. The upper right numerical value shows the Search Event Count total for the selected period. When hovering over the value, the daily Average and Peak (highest number of queries during a day) values appear on the timeline for the selected period.

      • Search Events Without Results

        This timeline graph displays the number of queries that did not return anything in the search results list. The upper right numerical value shows the total of queries that don’t return results for the selected period. When hovering over the value, the daily Average and Peak (highest number of queries not returning results during a day) values for search events without results appear on the timeline for the selected period. When improving knowledge management and content coverage, the trend should go down.

Review the Available Dimension Values to Evaluate Search Interface Activity and Results Relevance

  1. Access the “Summary” Dashboard in Edit mode.

  2. In the Summary dashboard, inspect the available dimension values:

    The Summary dashboard tabs show different lists and charts, such as the most frequently submitted queries and keywords, and the most active countries/search interfaces.

    • In the Activity tab:

      • The Countries - Visits pie chart helps you outline usage as a function of the users location based on the number of visits in each country for the selected date range and filters.

        You can use the Country dimension to evaluate the adoption per country. Low adoption could be due to an improper search solution localization.

      • The top Device - Visits bar chart helps you outline usage as a function of the users device category based on the number of visits for the selected date range and filters.

        You can use the Device Category dimension to evaluate adoption variation as a function of the Device category used to search. A low adoption for tablet or smartphone users may indicate poor user experience on these devices or suggest that optimizing mobile version of the search pages is not required due to low number of visits using these devices.

      • The Top Tab list helps identify the name of the most popular search interfaces from which any type of events are performed. Typically, search interfaces have different URLs.

      • The Top User Queries list helps identify what people are searching for the most. Ensure that your search page returns relevant results when those queries are performed.

      • The Top Documents lists help identify potential relevance issues, because this list highlights the most popular items based on the number of visits in which these items were clicked. You can then investigate whether these items appear on top of the results list when queries containing related keywords are performed.

    • In the Keywords tab:

      • The top Trending Keywords lists help identify potential relevance issues, because this list highlights keywords becoming more popular compared to the same previous period (week, month…) based on the number of unique visits in which these keywords were contained in performed queries. You can then investigate whether these keywords are returning relevant results.

      • The Top Keywords list helps identify what people are searching for the most.

    • In the Relevancy tab:

      • The top Queries With Low Relevance list helps identify relevance issues, because this list highlights popular queries with high Average Click Rank values.
    • In the Content Gaps tab:

      • The top Search Events Without Results (Visits) list helps identify content gaps, because no results are returned.

      • The Has Results bar chart helps identity the proportion of queries returning results (true) versus queries not returning results (false).

    </div>

Set the Date Interval Over Which You Want to Review Search Usage Data

  1. Access the “Summary” Dashboard in Edit mode.

  2. In the Summary dashboard, in the top right corner of the report, you can quickly go from the actual date interval selected (last week, month…) to the previous period or next period by clicking the left (Icon-LeftArrowb) and right (Icon-RightArrowb) arrow icons respectively or you can click the box containing the actual date range (e.g., Icon-ActualDateRangeb - by default the last 7 complete days) to access the Report Period dialog, and then select the date range you want to review (see Setting the Period to Review Search Usage Data).

    You can select a period that is incomplete (e.g., the current month), in which case your date range selection will always include the latest available events until the period ends (e.g., the first day of the following month).

    You’re reviewing data per Month and want to see how statistics are trending for the first two weeks of the current month, so you click the right arrow icon (Icon-RightArrowb).

Add One or More Dimension Filters to Refine Search Usage Analytics Data

  1. Access the “Summary” Dashboard in Edit mode.

  2. In the Summary dashboard, in the top left corner of the report, access the dialog to add global dimension filters by clicking the filter addition icon (Icon-FilterAdditionc) (see Adding Global Dimension Filters).

Required Privileges

The following table indicates the required privileges to view and edit dashboards from the Reports page and associated panels (see Privilege Management and Privilege Reference).

Access to dashboards or part of their content may be further restricted as a function of the member (see Managing Access to Usage Analytics Reports and Adding and Managing Permission Filters).

Action Service - Domain Required access level
View summary dashboard

Analytics - Analytics data

Analytics - Dimensions

Analytics - Named filters

Analytics - Permission filters

Analytics - Reports

View
Edit summary dashboard

Analytics - Analytics data

Analytics - Dimensions

Analytics - Named filters

Analytics - Permission filters

View

Analytics - Exports

Analytics - Reports

Edit
Analytics - Administrate Allowed
Recommended Articles