View feedback for generated answers

This is for:

System Administrator Knowledge Manager
In this article
Important

The Coveo Knowledge Hub is currently available as a beta to early-access customers only. Contact your Customer Success Manager for early access to this feature.

Evaluating the answers that are generated by RGA is essential to improving the quality of your RGA implementation.

Reviewing feedback for generated answers is a good first step in evaluating them. By identifying queries that resulted in suboptimal or incorrect answers, you can investigate further to troubleshoot and improve your RGA implementation.

The answer feedback that’s collected using the RGA answer feedback modal appears in the Coveo Knowledge Hub’s Answer Manager, which is the centralized location for managing the answers generated by RGA. For each generated answer with feedback, you can see the question (query), the answer, and the feedback details.

Answer Manager evaluation details | Coveo
Important

For feedback to appear in the Answer Manager, you must associate an answer configuration with your RGA-enabled search interface.
Tip
You are here

In the improving your RGA implementation based on answer evaluation workflow, reviewing the answer feedback identifies the generated answers that need further investigation. An effective answer evaluation strategy, however, should also include inspecting the chunks that were used to generate the answers.

Coveo Knowledge Hub RGA answer evaluation view feedback step

To view the feedback for your RGA-generated answers

  1. Access the Knowledge Hub by selecting Knowledge Hub in the application picker in the Coveo Administration Console header.

    Application picker in the Administration Console | Coveo

  2. In the Knowledge Hub navigation menu, select Answer Manager.

    Important

    For feedback to appear in the Answer Manager, you must associate an answer configuration with your RGA-enabled search interface.

  3. Click the answer configuration that’s associated with the search interface for which you want to review the answer feedback, and then click View in the Action bar.

  4. Select the Evaluations tab. A list of the feedback collected for answers generated in the corresponding search interface appears. An answer’s evaluation is listed as either Helpful or Unhelpful, based on whether the thumbs-up or thumbs-down icon was clicked in the RGA component.

    Tip

    You can filter the evaluation list by Helpful or Unhelpful, by keywords in the question (query), and a date range.
    Answer Manager evaluation list | Coveo
    Note

    An answer configuration shows only the feedback that’s collected after you associate it with the search interface.

  5. To view the evaluation details for a specific answer, click the answer evaluation from the list, and then click View in the Action bar. The Evaluation details show the following:

    Answer Manager evaluation details | Coveo

    • The Question (query) and Answer.

    • The Evaluation date and time.

    • Any Additional notes that were provided in the feedback.

    • Whether the answer was Evaluated as helpful or unhelpful.

    • The Answer ID, which is needed if you want to inspect the chunks that were used by RGA to generate the answer.

  6. After reviewing the feedback for the generated answers, you can choose to do the following:

Required privileges

The following table indicates the privileges required to access the Coveo Knowledge Hub, and view or edit elements of the Answer Manager and associated panels (see Manage privileges and Privilege reference).

Important

Both the Edit and View access level on the Answer manager domain allows the member to view all generated answers for which feedback exists in an answer configuration in the Answer Manager. This may include content to which the member may not have access to otherwise through the repository’s permission system.

Exercise caution when granting this privilege to members.
Action Service - Domain Required access level

Access the Coveo Knowledge Hub

Knowledge - Knowledge hub

Enable

Organization - Organization

View

  • View the answer feedback for an answer configuration in the Answer Manager

  • View the rules for an answer configuration in the Answer Manager

Knowledge - Answer manager

View

  • Add, edit, or delete answer configurations and rules in the Answer Manager

  • View the answer feedback for an answer configuration in the Answer Manager

Knowledge - Answer manager

Edit