To directly send OpenTelemetry metrics generated by OpenLIT SDK from your AI Application to Oodle, Follow the below steps.
1

Install OpenTelemetry Collector (Optional)

This step is optional if you have the OpenTelemetry Collector already running.For detailed installation instructions for the OpenTelemetry Collector , please refer to the OpenTelemetry Collector Documentation. This guide provides comprehensive steps to get you up and running with the Collector on various platforms.
2

Configure the OpenTelemetry Collector

  1. Configure HTTP Receiver: In the receivers section of your OpenTelemetry Collector config, ensure the http receiver is set with endpoint: 0.0.0.0:4318 and otlp receiver is set with endpoint: 0.0.0.0:4317. 
    receivers:
    otlp:
        protocols:
            grpc:
                endpoint: 0.0.0.0:4317
            http:
                endpoint: 0.0.0.0:4318
  2. Define Exporters: Add otlphttp exporter to export metrics to Oodle. debug exporter is used as a dummy exporter for traces (As Oodle doesnt work with Traces yet) 
    exporters:
    otlphttp/oodle:
        metrics_endpoint: "https://<OODLE_ENDPOINT>/v1/otlp/metrics/<INSTANCE_ID>"
        headers:
            X-API-KEY: "<API_KEY>"
debug:
    verbosity: detailed
    sampling_initial: 5
    sampling_thereafter: 200
  3. Assign Exporters to Pipelines: Link otlphttp/oodle to service.pipelines.metrics and debug to service.pipelines.traces for data export. 
    service:
    pipelines:
        metrics:
            receivers: [otlp]
            processors: [batch]
            exporters: [otlphttp/oodle]
        traces:
            receivers: [otlp]
            processors: [batch]
            exporters: [debug]
Complete Configuration Example
3

Add the following two lines to your application code:

import openlit

openlit.init(
  otlp_endpoint="YOUR_OTELCOL_URL:4318", 
)
Replace:
  1. YOUR_OTELCOL_URL:4318 with the URL HTTP endpoint of your OpenTelemetry Collector.
    • Example - http://127.0.0.1:4318
Refer to the OpenLIT Python SDK repository for more advanced configurations and use cases.
4

Start monitoring using a pre-built Oodle dashboard

  1. Log into your Oodle Instance.
  2. Click Dashboards in the primary menu.
  3. Click New and select Import in the drop-down menu.
  4. Copy the dashboard JSON provided in the accordion named Dashboard below.
  5. Paste the dashboard JSON text directly into the text area.
  6. Click Import.
  7. Save the dashboard.

Integrations

Start Monitoring your LLM Application