To send OpenTelemetry metrics and traces generated by OpenLIT from your LLM Application to SigNoz, Follow the below steps.

1

Add the following two lines to your application code:

import openlit

openlit.init(
  otlp_endpoint="SIGNOZ_ENDPOINT", 
  otlp_headers=""signoz-access-token=SIGNOZ_INGESTION_KEY"
)

Replace:

  1. SIGNOZ_ENDPOINT with your signoz endpoint URL.

    • Example - https://ingest.{region}.signoz.cloud:443

  2. SIGNOZ_INGESTION_KEY with the api token provided by SigNoz.

    • Example - 896cc137-xxxx-xxxx-b8a0-a6d7ab65f274

Refer to the OpenLIT Python SDK repository for more advanced configurations and use cases.

2

Import the pre-built Dashboard

  1. Log into your SigNoz Instance.
  2. From the sidebar, choose Dashboards.
  3. Click + New Dashboard and select Import JSON in the drop-down menu.
  4. Copy the GenAI Observability dashboard JSON provided here.
    1. To get the GPU Monitoring dashboard, Copy the dashboard JSON provided here
  5. Paste the dashboard JSON text directly into the text area.
  6. Click Load Json.

Integrations

Start Monitoring your LLM Application

Was this page helpful?

DataDogOneUptime