OpenLIT uses OpenTelemetry Auto-Instrumentation to help you monitor LLM applications built using Prem AI models. This includes tracking performance, token usage, costs, and how users interact with the application.Auto-instrumentation means you don’t have to set up monitoring manually for different LLMs, frameworks, or databases. By simply adding OpenLIT in your application, all the necessary monitoring configurations are automatically set up.The integration is compatible with
YOUR_OTEL_ENDPOINT with the URL of your OpenTelemetry backend, such as http://127.0.0.1:4318 if you are using OpenLIT and a local OTel Collector.
To send metrics and traces to other Observability tools, refer to the Connections Guide.For more advanced configurations and application use cases, visit the OpenLIT Python repository.