External search engine optimization (SEO)
External search engine optimization (SEO)
When using Coveo to power your public website, it’s important to keep in mind how the content crawled from query-based listing pages appear in external search engines such as Google or Bing. This article provides a high-level overview of some leading practices to ensure that your content can be optimally indexed by external search engines (SEs).
External search engines (SEs) index the web at frequent intervals and rank pages based on content and confidence. To be ranked effectively, pages that must be indexed by external SEs should meet certain standards.
Commerce listing pages powered by Coveo are typically rich with content that should be indexed by external crawlers. Keep in mind that external SE crawlers trigger queries as well as many requests against your website to index your web pages. You may want to minimize the impact of these queries/requests. To learn how, see Exclude Search Interfaces From External Search Engines.
Search-driven content that’s frequently changing such as search pages and recommendation interfaces is irrelevant from an SEO perspective and should therefore not be indexed by external SEs. Consider using static content along with dynamic content.
Server-side versus client-side rendering
It’s easier for common SEs to crawl and index server-side rendered (SSR) websites than client-side rendered (CSR) websites as the content is available to external SEs before it’s rendered on the end user’s browser.
Other strategies, such as dynamic pre-rendering or hybrid SSR/CSR solutions, can also be used to optimize the ranking of Coveo-powered search pages on external SEs.
Coveo Headless is a library for developing your own Coveo-powered UI components. It wraps the complexity of the Coveo APIs while giving you full flexibility over your UI implementation. It is used, for example, in Coveo Atomic, to handle application state and Coveo interactions.
The flexibility of the Coveo Headless framework allows you to implement server-side rendering in your application.
Server-side rendering using the Coveo Search API
You can leverage the Coveo Search API directly to build your search interface from scratch. Since this approach gives you full control over your interface implementation, it allows you to implement server-side rendering.
If you have to use these frameworks to build your search interface, and need the interface to be indexed by external SEs, you can use a pre-rendering tool, such as Prerender, to improve the interface ranking on external SEs.
External SEs usually rank static pages higher than fully dynamic web pages. Whenever an external SE crawls a page, it expects the page to remain similar to the last time it was visited.
Due to their dynamic nature, Coveo-powered search pages that must be indexed and made searchable by external SEs may not rank effectively if some precautions are not taken.
Use static content along with dynamic content
Since external SEs seek stability for optimal ranking, a leading practice is to use both static and dynamic content on the pages that must be indexed by external SEs.
On a Coveo-powered commerce website, you have a Gaming Computers listing page that incorporates product recommendation interfaces. These interfaces recommend items according to the current user’s profile and action history. Those recommendations are dynamic as they differ depending on the user who accesses the page. Since you want this listing page to rank well in external SEs, you incorporate a static interface that always shows the same products regardless of the user who browses the page. Doing so allows external SEs to recognize that some of the content remains the same every time it crawls the Gaming Computers listing page.
Use stable and readable URLs
When indexing content, external SEs expect URLs to be stable and well formatted. URLs typically follow the following format:
protocolis the protocol that the browser uses to request the resource (e.g.,
https). Note that external SEs usually give more importance to URLs that use the
hostNameis the host that holds the resource (e.g.,
urlPathnameidentifies the page location in the directory structure (e.g.,
urlHashpoints the browser to a specific spot in a page or website (e.g.,
queryStringassigns values to specified parameters (e.g.,
When indexing web pages, common external SEs ignore everything that comes after the
? URL characters.
#) to avoid external SEs indexing a new page for every facet combination.
You have a search interface that can be accessed through the following URL:
When a user selects the
computer facet value of the
productType facet, the URL becomes:
Even though a user can type the
https://www.acme.com/en/search#f:productType=[computer] URL to access a search page that only shows items whose
computer, this URL won’t be indexed by external SEs as they ignore everything that comes after the
Use facet selections in the URL pathname
Including facet selections in the URL pathname will cause all possible combinations of facet selections for the specified facets to be indexed by external SEs. This can cause external SEs to make a large number of requests, increasing the query per month (QPM) count for the related Coveo organization (see What Counts as a Query).
To limit the requests made by external SEs in your commerce search interface, you can use canonical URLs to tell external SEs which URL should be indexed when multiple URLs lead to very similar content. For more information on canonical URLs, and how to configure them, see Consolidate duplicate URLs.
Since common external SEs ignore everything that comes after the
? URL characters when indexing web pages, this may cause issues if you want a Coveo-powered commerce search interface that contains specific facet selections to be crawled and indexed by external SEs.
You can make these facet selections indexable by external SEs by moving them directly in the URL pathname.
On a Coveo-powered commerce website, you want certain facet selections to be indexed by external SEs to improve organic ranking when customers are looking for specific brands or product categories.
Therefore, you set your interface to put facet selections for the
productCategory facets directly in the URL pathname.
To avoid having less important facet selections to be indexed by external SEs, you keep the default behavior for other facets, such as
With this configuration, the following facet selections:
will generate the following URL:
Use a Sitemap
It’s a common SEO good practice to have a sitemap for your site. Using a sitemap ensures that your content is indexed by external SEs, hence the item directly related to an end user’s search will be returned rather than the search page that contains the item.
For more information on sitemaps and how to configure them, see Learn about sitemaps.