Creating a Crawling Module Source (Docker Version)

This article applies to the old Crawling Module, which works with Docker. If you are using the new Crawling Module, see Creating a Crawling Module Source instead.

The old Crawling Module will soon reach its end-of-life. We recommend switching to the new Crawling Module, which doesn’t require Docker.

To identify the Crawling Module you’re currently using, on the Crawling Modules page of the Coveo Administration Console, look at the Maestro reported version:

  • Versions > 1: new Crawling Module

  • Versions < 1: Crawling Module with Docker

Once you have started your workers, you can login to the Coveo Administration Console to create a content source (see Typical Crawling Module Use and Log in to Coveo Cloud). The following on-premises content can be crawled using the Coveo On-Premises Crawling Module (refer to the source-specific documentation for more information):

You can also use the Coveo V2 Platform API to provide Coveo with the content you want to make searchable (see Source API).

Indexing Secured Content

Starting March 26, 2020, Coveo has progressively released connector improvements allowing you to create sources that index permissions that are up and running within minutes. Prior to these improvements, the Coveo team was required to perform some additional work on a source of secured content to make it operational.

The following table lists the dates on which a new version of the connector has been released. If you created or duplicated a Crawling Module source that indexed permissions on or after this date, ensure that you have also edited the Crawling Module configuration to create a security worker that will execute security identity updates.

Sources created before the above dates are no longer supported, but still operational. Should any configuration change be required on such a source, we recommend duplicating the source and deleting the original version. You can then edit the duplicate as desired. You must also adjust your number of security workers.

For more information on sources that index permissions and on how Coveo handles these permissions, see Coveo Cloud Management of Security Identities and Item Permissions.

What’s Next?

Recommended Articles