ICP Observability Setup

When your integrations run on your own infrastructure, the Integration Control Plane (ICP) can show their logs and metrics in one console, alongside health and runtime status. ICP reads this data from one of two observability providers: Moesif or OpenSearch. With OpenSearch, the data is populated by Fluent Bit tailing the runtime's log files.

Setting up OpenSearch involves four steps:

1. Deploy OpenSearch.
2. Create the index templates for logs and metrics.
3. Configure the integration to write structured logs and metrics.
4. Set up Fluent Bit to ship the logs to OpenSearch.

Complete guide

The full step-by-step procedure, including commands and configuration, is in Observability setup in the Integration Control Plane section.

Related

• Logging, Metrics, and Distributed Tracing — instrument the integration itself.
• OpenSearch — use OpenSearch as a general-purpose log analytics backend.
• Connect an integration to ICP — a prerequisite for viewing data in the console.