Add/Edit Web Source - Panel

When you have the required privileges, you can use a Web source to make the content of a website searchable.

The Web source type behaves similarly to bots of other web search engines such as Google. The source only needs a starting URL and then automatically discovers all the pages of the site following the site navigation and hyperlinks appearing in the pages. Consequently, only pages that are reachable are indexed (in a random order). By default, the source does not include pages that are not under the URL root.