---
title: Monitor the Crawling Module
slug: '2766'
canonical_url: https://docs.coveo.com/en/2766/
collection: index-content
source_format: adoc
---
# Monitor the Crawling Module
After completing the [Crawling Module deployment process](https://docs.coveo.com/en/3261/), you should monitor your Crawling Module instances to ensure they're running properly and indexing content as expected.

Several monitoring tools are available:

* The [**Crawling Modules**](https://platform.cloud.coveo.com/admin/#/orgid/content/crawling-module/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/crawling-module/)) page of the [Coveo Administration Console](https://docs.coveo.com/en/183/), which displays when each instance last communicated with the Coveo Platform, its current version, and more.
See [About the Crawling Modules page](#about-the-crawling-modules-page) for details.

* A deployment dashboard that displays the state of each component and worker in your Crawling Module instance.
This dashboard is available at [http://localhost:5000/](http://localhost:5000/) or [any other port selected for Maestro](https://docs.coveo.com/en/3264#maestro-port).
See [About the deployment dashboard](#about-the-deployment-dashboard) for details.

* A [notification feature](#subscribe-to-crawling-module-notifications) you can set up to be informed when the Crawling Module stops reporting to the Coveo Platform for three consecutive days.

* The [**Activity Browser**](https://platform.cloud.coveo.com/admin/#/orgid/activity/browser/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/activity/browser/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/activity/browser/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/activity/browser/)) page of the [Coveo Administration Console](https://docs.coveo.com/en/183/), which lets you review the activities related to the Crawling Module.

## About Crawling Module updates

The [**Crawling Modules**](https://platform.cloud.coveo.com/admin/#/orgid/content/crawling-module/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/crawling-module/)) page of the Coveo Administration Console shows the latest version of the Crawling Module available, the version your instance is currently using, and when it was last updated.

The Crawling Module update process is automatic.
As a result, your instance benefits from the latest features and software updates, and is prevented from becoming incompatible with the most recent [Coveo Platform](https://docs.coveo.com/en/186/) update.

To stay up to date, the Crawling Module periodically polls Coveo for a new version.
If an update is available, it will be downloaded and installed within 24 hours, at the [scheduled update time](https://docs.coveo.com/en/3266#editing-the-crawling-module-configuration).
The default time is 11:00 PM in the host server's time zone.

> **Note**
>
> Disconnecting your server from the Internet or shutting it down prevents the Crawling Module from polling Coveo for updates.
> Upon the next successful call for an update, if the Crawling Module is two or more versions behind, the workers stop until it's up to date again.

Since the update process is automatic, you don't need to launch it manually, unless it fails.
In such a case, the [**Crawling Modules**](https://platform.cloud.coveo.com/admin/#/orgid/content/crawling-module/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/crawling-module/)) page reports the issue, and you can either try to [update manually](https://docs.coveo.com/en/3265#updates) or contact the [Coveo Support](https://connect.coveo.com/s/case/Case/Default) team.

> **Tip**
>
> [Subscribe to notifications](#subscribe-to-crawling-module-notifications) to be informed when the Crawling Module is down or obsolete.

## About the Crawling Modules page

The [**Crawling Modules**](https://platform.cloud.coveo.com/admin/#/orgid/content/crawling-module/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/crawling-module/)) page displays the state of the communication between the [Coveo Platform](https://docs.coveo.com/en/186/) and each of your [Crawling Module](https://docs.coveo.com/en/3260/) instances, along with other information.

![Crawling Modules page | Coveo](https://docs.coveo.com/en/assets/images/crawling-module/crawling-modules-page-legend.png)

[cols="2"]
|===
|1
|Download and [deploy the Crawling Module on another server](https://docs.coveo.com/en/3271#deploying-multiple-crawling-module-instances) to index more content.

|2
|[Review Crawling Module-related activities](https://docs.coveo.com/en/1969/) for investigation or troubleshooting purposes.

|3
|The **Latest version** is the version number of the most recent Maestro update.
See [Maestro release notes](https://docs.coveo.com/en/mc8f0179/) for details on the changes in this version.

|4
|If your Crawling Module doesn't use the latest Maestro version, [update it](https://docs.coveo.com/en/3265#updates) as soon as possible so that it keeps indexing your content.

|5
|Each Crawling Module instance is identified by a default name, which you can change in the instance's [Maestro configuration](https://docs.coveo.com/en/3266#editing-the-crawling-module-configuration).

|6
|The Crawling Module sends a status update to the Coveo Platform every five minutes.

|7
|Update your proxy settings in the Crawling Module's [Maestro configuration](https://docs.coveo.com/en/3264#proxy).

|8
|[If this feature is enabled](https://docs.coveo.com/en/3264#enablelogrequests), you can download your Crawling Module logs through the [**Activity Browser**](https://platform.cloud.coveo.com/admin/#/orgid/activity/browser/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/activity/browser/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/activity/browser/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/activity/browser/)).

|9
| Read about [adding workers](https://docs.coveo.com/en/n13k0304/) to determine whether you need more.
|===

## About the deployment dashboard

The deployment dashboard displays the state of each component and worker of a Crawling Module instance, along with other information.
It's available at [http://localhost:5000/](http://localhost:5000/) or [any other port selected for Maestro](https://docs.coveo.com/en/3264#maestro-port).
It's also available from the Windows Start menu under `Coveo Crawling Module`.

![Crawling Module worker dashboard | Coveo](https://docs.coveo.com/en/assets/images/crawling-module/crawling-module-worker-dashboard.png)

[cols="2"]
|===
|1
|The Crawling Module sends a status update to the Coveo Platform every five minutes.

|2
|If your Crawling Module doesn't use the latest Maestro version, [update it](https://docs.coveo.com/en/3265#updates) as soon as possible so that it keeps indexing your content.
The latest version appears on the [**Crawling Modules**](https://platform.cloud.coveo.com/admin/#/orgid/content/crawling-module/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/crawling-module/)) page of the Coveo Administration Console and in the [Maestro release notes](https://docs.coveo.com/en/mc8f0179/).

|3
|Each Crawling Module instance is identified by a default name, which you can change in the instance's [Maestro configuration](https://docs.coveo.com/en/3266#editing-the-crawling-module-configuration).

|4
|The [ID of the Coveo organization](https://docs.coveo.com/en/n1ce5273/) linked to your Crawling Module.

|5
|[`Dumps` and `JobHandler` logs](https://docs.coveo.com/en/3272/) contain the worker ID in their filename.

|6
|The **Current [resource](https://docs.coveo.com/en/2820/)** column displays the ID of the [source](https://docs.coveo.com/en/246/) or [security identity provider](https://docs.coveo.com/en/242/) where the worker sends the data it processes.

|7
|Click the camera icon to save a memory dump of the worker onto your server for troubleshooting purposes.
The dump is saved in the [`Dumps` folder of the Crawling Module installation directory](https://docs.coveo.com/en/3272#access-logs-on-your-host-server).
|===

## Subscribe to Crawling Module notifications

You can subscribe to notifications to be informed when the Crawling Module stops reporting to the [Coveo Platform](https://docs.coveo.com/en/186/) for three consecutive days.
This can be due to the Crawling Module being [outdated](https://docs.coveo.com/en/2766#about-crawling-module-updates), its host server being shut down, a lack of Internet access, a communication issue, etc.

When the Crawling Module can't communicate with the Coveo Platform, it can't index your content changes.
As a result, the content in your Coveo-powered [search interface](https://docs.coveo.com/en/2741/) becomes outdated compared to your actual data.

Subscribing to notifications ensures you're informed early, so you can act and minimize the impact on your search results.

To receive a notification when the Crawling Module is outdated and deactivated

On the [**Notifications**](https://platform.cloud.coveo.com/admin/#/orgid/organization/notifications/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/organization/notifications/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/organization/notifications/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/organization/notifications/)) page, [create a notification](https://docs.coveo.com/en/1583#add-or-edit-an-organization-notification) with the following JSON filter:

```json
{
  "content": {},
  "operations": [
    "DISABLE"
  ],
  "resourceTypes": [
    "CRAWLING_MODULE"
  ],
  "resultTypes": [
    "*"
  ]
}
```

## Required privileges

The following table indicates the [privileges](https://docs.coveo.com/en/1707/) required to view the [**Crawling Modules**](https://platform.cloud.coveo.com/admin/#/orgid/content/crawling-module/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/crawling-module/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/crawling-module/)) page.

See [Sources: required privileges](https://docs.coveo.com/en/3390#required-privileges) for the additional privileges required to add and edit Crawling Module sources.

[cols="~,~,~",options="header"]
|===
|Action
|Service - Domain
|Required access level

.4+a|* View the Crawling Module page

* View Crawling Module related activities

* Download the Crawling Module

|Content - Crawling Module
|View

|Content - Security identities provider
|View

|Content - Sources
|View

|Organization - Organization
|View
|===

> **Important**
>
> A member with the **View** access level on the **Activities** domain can access the [Activity Browser](https://docs.coveo.com/en/1969/).
> This member can therefore see all activities taking place in the organization, including those from Coveo Administration Console pages that they can't access.