About Crawling Module logs

This is for:

Developer System Administrator

When you request help from the Coveo Support team for an issue with the Coveo Crawling Module, your Coveo Support agent downloads your instance logs or asks you to provide them. The information in the Crawling Module logs helps them investigate your issue.

You can also access Crawling Module logs for review and troubleshooting purposes, either through the Coveo Administration Console or directly on the Crawling Module host server.

Each log file contains traces of Crawling Module activity and events, which can be helpful when troubleshooting unusual issues.

For each Crawling Module instance:

  • Crawlers logs contain information regarding content update requests that have been received from Coveo. Each of these log files is identified with a source ID that’s also displayed on the Sources (platform-ca | platform-eu | platform-au) page of the Coveo Administration Console.

  • Dumps are used by the Coveo Support team when investigating your issue, along with logs.

  • JobHandlers logs contain traces of the workers polling Coveo for update tasks. For example, these logs may be useful when you launch a refresh operation in the Coveo Administration Console, but the operation doesn’t appear to be processed by the Crawling Module.

  • Maestro logs are relevant when debugging issues affecting the Crawling Module as a whole, such as communication issues with Coveo, failure to start the workers, and inability to complete downloads.

  • Security-Provider logs contain information relative to security identity update requests that have been received from Coveo.

  • WorkerService logs, also known as NodeAgent logs, provide information on the worker launching process.

Note

Component logs aren’t shared between Crawling Module instances. So, if you have more than one instance and encounter issues with a source, you must review the logs of the Crawling Module instance associated to this source. In other words, you must access the Logs folder on the server on which you deployed the Crawling Module instance with which this source is paired.

Access logs on your host server

On your server, all Crawling Module logs are located under C:\ProgramData\Coveo\Maestro\Logs (ProgramData is hidden by default), unless you changed this location.

Alternatively, you can use the Crawling Module API to create a compressed log archive

Download logs through the Administration Console

Should you need more information about an ongoing or completed source or security provider update operation, you can download a JSON log of the desired activity.

An update log contains nonsensitive information about the update process. It also contains any warning or error that hinders part or all the update operation.

To download an update log

  1. On the Sources (platform-ca | platform-eu | platform-au) or Security Identities (platform-ca | platform-eu | platform-au) page, click the desired resource, and then click Activity in the Action bar.

  2. In the Activity panel that opens, click the desired activity, and then click Download Logs in the Action bar. The downloaded JSON file is named after the unique operation ID representing the selected activity.

See Review resource activity for alternative ways to access this information.

Required privileges

The following table indicates the privileges required to download Crawling Module logs (see Manage privileges and Privilege reference).

Action Service - Domain Required access level
Download Crawling Module logs

Content - Crawling Module

Content - Crawling Module log request

 Edit

Organization - Organization

 View