AI assistants and agents

This is for:

Developer System Administrator

Coveo integrates with LLM apps and AI agent platforms to ground responses in relevant enterprise content. By connecting these experiences to Coveo, organizations can give AI systems governed access to enterprise knowledge while keeping the experience in the platform their teams use.

This article helps developers and system administrators evaluate how Coveo fits into an LLM app or AI agent platform implementation.

What Coveo powers in these platforms

LLM apps and AI agent platforms help organizations understand requests, find information, choose actions, and complete tasks. Coveo adds retrieval capabilities that help these systems find relevant enterprise content or process a request before generating a response or taking an action. The AI system uses the returned information according to the permissions configured for the Coveo organization.

Use cases

  • Ground LLM app and AI agent responses in passages from content indexed in Coveo.

  • Help users find and summarize information from large and complex enterprise content sources.

  • Extend an AI experience with Coveo retrieval while keeping the experience in the platform users already use.

Typical integration pattern

The integration pattern depends on the capabilities of the target platform.

For an LLM app or AI agent platform that connects through an MCP client, the MCP client sends requests to the Coveo Hosted MCP Server. The server returns the results of the requested Coveo tool, and the AI system uses those results to generate a context-aware response. The following diagram shows this representative MCP pattern; packaged integrations and gateway-mediated connections can use different components.

MCP-based integration between Coveo Platform and an LLM app

Coveo has setup instructions for many MCP clients.

Product-specific articles

The following LLM apps, AI agent platforms, and AI agent frameworks have dedicated Coveo integration articles.