Connections
SigNoz
LLM Observability with SigNoz and OpenLIT
To send OpenTelemetry metrics and traces generated by OpenLIT from your LLM Application to SigNoz, Follow the below steps.
1
Add the following two lines to your application code:
import openlit
openlit.init(
otlp_endpoint="SIGNOZ_ENDPOINT",
otlp_headers=""signoz-access-token=SIGNOZ_INGESTION_KEY"
)
Replace:
-
SIGNOZ_ENDPOINT
with your signoz endpoint URL.- Example -
https://ingest.{region}.signoz.cloud:443
- Example -
-
SIGNOZ_INGESTION_KEY
with the api token provided by SigNoz.- Example -
896cc137-xxxx-xxxx-b8a0-a6d7ab65f274
- Example -
Refer to the OpenLIT Python SDK repository for more advanced configurations and use cases.
2
Import the pre-built Dashboard
- Log into your SigNoz Instance.
- From the sidebar, choose Dashboards.
- Click + New Dashboard and select Import JSON in the drop-down menu.
- Copy the GenAI Observability dashboard JSON provided here.
- To get the GPU Monitoring dashboard, Copy the dashboard JSON provided here
- Paste the dashboard JSON text directly into the text area.
- Click Load Json.