Community

GitHub

OpenLIT

Website

Send LLM Monitoring data to your existing Observablity Stack

Introduction

Connect to your existing Observablity Tools

OpenTelemetry-native LLM Application Observability

What is OpenLIT?

Quickly start monitoring your LLM Applications in just a single line of code

Quickstart

Configuration

Monitor LLM Costs, Tokens and Performance along with User Interactions with OpenTelemetry

Overview

Monitor your GenAI and LLM Applications

OpenAI

Monitor OpenAI using OpenTelemetry

Anthropic

Monitor Anthropic using OpenTelemetry

Cohere

Monitor Cohere using OpenTelemetry

Mistral

Monitor Mistral using OpenTelemetry

Azure OpenAI

Monitor Azure OpenAI using OpenTelemetry

HuggingFace

Monitor HuggingFace using OpenTelemetry

Amazon Bedrock

Monitor Amazon Bedrock using OpenTelemetry

Vertex AI

Monitor Vertex AI using OpenTelemetry

Groq

Monitor Groq using OpenTelemetry

ChromaDB

Monitor ChromaDB using OpenTelemetry

Pinecone

Monitor Pinecone using OpenTelemetry

Qdrant

Monitor Qdrant using OpenTelemetry

LangChain

Monitor LangChain using OpenTelemetry

LiteLLM

Monitor LiteLLM using OpenTelemetry

LlamaIndex

Monitor LlamaIndex using OpenTelemetry

Haystack

Monitor Haystack using OpenTelemetry

LLM Observability with OpenTelemetry Collector and OpenLIT

OpenTelemetry Collector

LLM Observability with Prometheus and Grafana Tempo using OpenLIT

Prometheus + Tempo

LLM Observability with Prometheus and Jaeger using OpenLIT

Prometheus + Jaeger

LLM Observability with Grafana Cloud and OpenLIT

Grafana Cloud

LLM Observability with New Relic and OpenLIT

New Relic

LLM Observability with Grafana Tempo and OpenLIT

DataDog

LLM Observability with SigNoz and OpenLIT

SigNoz

LLM Observability with Dynatrace and OpenLIT

Dynatrace

LLM Observability with OpenObserve and OpenLIT

OpenObserve

LLM Observability with Highlight.io and OpenLIT