--- title: Crawling Module requirements slug: '3262' canonical_url: https://docs.coveo.com/en/3262/ collection: index-content source_format: adoc --- # Crawling Module requirements Before you [deploy](https://docs.coveo.com/en/3261/) the [Coveo Crawling Module](https://docs.coveo.com/en/3260/), ensure that your Coveo license, host server, and IP address allowlist meet the following requirements. ## Coveo license ### Product edition To use the Coveo Crawling Module, a valid Coveo Enterprise edition [license](https://docs.coveo.com/en/2864/) is required. Check your [license information](https://docs.coveo.com/en/1562#license-details) to confirm your product edition. ### Connectors Your Coveo license must also include the [connectors](https://docs.coveo.com/en/2734/) you want to use. See [Supported content](https://docs.coveo.com/en/3260#supported-content) for details on what the Crawling Module can [index](https://docs.coveo.com/en/204/). These connectors must allow the Crawling Module as a [content retrieval method](https://docs.coveo.com/en/1612/). To check whether your Coveo license includes the desired Crawling Module connectors: . [Log in to the Coveo Administration Console](https://platform.cloud.coveo.com/) as a [member](https://docs.coveo.com/en/2869/) of a [group](https://docs.coveo.com/en/2867/) with the [privileges required to create sources](https://docs.coveo.com/en/3390#required-privileges) in the target [Coveo organization](https://docs.coveo.com/en/185/). . On the [**Sources**](https://platform.cloud.coveo.com/admin/#/orgid/content/sources/) ([platform-ca](https://platform-ca.cloud.coveo.com/admin/#/orgid/content/sources/) | [platform-eu](https://platform-eu.cloud.coveo.com/admin/#/orgid/content/sources/) | [platform-au](https://platform-au.cloud.coveo.com/admin/#/orgid/content/sources/)) page, click **Add Source**. . In the [**Add a source of content** panel](https://docs.coveo.com/en/3390#add-a-source), select the desired source. If the source has more than one [content retrieval method](https://docs.coveo.com/en/1612/), select the Crawling Module option ([crawlingmodule]). If the Crawling Module source is grayed out, your license doesn't include it. You must then contact the [Coveo Sales](https://www.coveo.com/en/contact) team to upgrade your license. ## Host server Install the Coveo Crawling Module on a server running Windows Server 2022. Alternatively, Windows Server 2016 and above are also supported. This server can be either a physical server on your premises or a virtual server running in Azure. Your server must also host the repository to index or have access to the server on which this repository is located. ### Hardware To determine your server hardware requirements, estimate the number of workers the Crawling Module should have based on the size and [update schedule](https://docs.coveo.com/en/1933/) of your content [sources](https://docs.coveo.com/en/3260#supported-content). By default, after its deployment, the Crawling Module has four content workers and four security workers. #### CPU and RAM CPU and RAM requirements are based on the [number of workers](https://docs.coveo.com/en/3278/), although the type of source you create, the source size, the [item](https://docs.coveo.com/en/210/) size, and other factors can affect your actual needs. As a rule of thumb, consider that each worker typically requires at least: * 0.5 vCPU (virtual CPU) or 0.5 CPU (physical CPU core) * 2 GB RAM If your server CPU or RAM is insufficient, you could experience unresponsiveness or crashes preventing [update operations](https://docs.coveo.com/en/2039/) from completing. Monitor usage to determine when to [scale up your deployment](https://docs.coveo.com/en/n13k0304/). #### Disk space When you install the Crawling Module on your server, select the disk on which you want to deploy it. Coveo recommends starting with a disk space of at least 100 GB. This disk space is mostly used by the [State Store](https://docs.coveo.com/en/3260#components) and [logs](https://docs.coveo.com/en/3272/). Your actual required disk space might be higher depending on the number of [items](https://docs.coveo.com/en/210/) to index, as well as their type and size. As a rule of thumb, consider that 10 million items require _at least_ 10 GB of [State Store](https://docs.coveo.com/en/3260#components) storage. However, complex sources such as SharePoint could require at least 20 GB per 10 million items. The number of logs you have and your retention schedule may also impact your disk space requirements. Typically, the more workers you have, the more logs will be saved on your disk over time. #### Network bandwidth Rebuild operations require the most bandwidth, as they retrieve the entire source content and forward it to your Coveo index. The type and size of your indexed items also impact your bandwidth needs. Ideally, your network speed shouldn't limit your content updates. Therefore, the more bandwidth you have, the better. ## Outbound communication If your environment restricts outgoing communications, ensure to [allow the IP addresses that the Crawling Module uses](https://docs.coveo.com/en/1831#outbound-communication). Moreover, ensure that outbound communication from the Crawling Module server is not blocked or slowed down by SSL decryption, antivirus scans, firewalls, Splunk, endpoint protection, etc. ## Antivirus Since the Crawling Module uses executable files (`.exe` extension), its proper operation is susceptible to be blocked by antivirus software. You should therefore ensure that the antivirus software of the server on which you intend to install the Crawling Module doesn't hinder Crawling Module activities. Furthermore, to ensure that your antivirus software doesn't flag Crawling Module executable files as potential threats, you should add the following to the antivirus software exclusion list: * [Your data folder](https://docs.coveo.com/en/3271#moving-the-maestro-data-folder) (`C:\ProgramData\Coveo\Maestro` by default) * Your installation folder (`C:\Program Files\Coveo\Maestro` by default) ## What's next? * Once you have ensured your environment meets all the above requirements, you can proceed with the [Crawling Module deployment](https://docs.coveo.com/en/3261/). * If you experience unresponsiveness, crashes, or delayed update operations, you might need to [scale up your deployment](https://docs.coveo.com/en/n13k0304/).