1. Deploy OpenTelemetry Collector
Install the Collector (choose your preferred method):otel-collector-config.yaml
file:
Basic OTLP Configuration
Basic OTLP Configuration
- Default HTTP endpoint:
http://localhost:4318
orhttp://your-collector-host:4318
- Default gRPC endpoint:
http://localhost:4317
orhttp://your-collector-host:4317
2. Instrument your application
For direct integration into your Python applications:Replace:Refer to the OpenLIT Python SDK repository for more advanced configurations and use cases.
YOUR_COLLECTOR_ENDPOINT
with your OpenTelemetry Collector endpoint from Step 1.- Local HTTP:
http://localhost:4318
- Local gRPC:
http://localhost:4317
- Remote:
http://your-collector-host:4318
- Kubernetes:
http://my-otel-collector:4318
- Local HTTP:
3. Configure Collector Exporters
Once your LLM application is sending data to the OpenTelemetry Collector, configure exporters to send data to your preferred observability backends: Popular Exporter Configurations:Jaeger (Traces)
Jaeger (Traces)
Prometheus (Metrics)
Prometheus (Metrics)
Multiple Backends
Multiple Backends
- Vendor Agnostic: Route data to multiple backends simultaneously
- Data Processing: Apply transformations, filtering, and sampling
- Protocol Translation: Convert between different telemetry formats
- Buffering & Reliability: Handle network issues and backend outages
- Cost Optimization: Sample and filter data to reduce costs
- Security: Add authentication, encryption, and data anonymization