> ## Documentation Index
> Fetch the complete documentation index at: https://docs.openlit.io/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Production-ready AI observability with zero code changes. Monitor LLM applications, track token usage, detect hallucinations, and optimize costs with OpenTelemetry-native instrumentation.

The OpenLIT SDK is an **open-source**, **OpenTelemetry-native** LLM observability platform
that enables production-ready AI application and agent monitoring **without any code changes**.

It includes upstream OpenTelemetry instrumentations for HTTP frameworks, clients, and system components, delivering **complete visibility across your entire AI infrastructure**.

## Goals

* **Zero Code AI Observability** - Enable production-ready LLM monitoring for your AI applications **without any code changes**.

* **OpenTelemetry Native** - Built on OpenTelemetry standards for seamless integration with existing observability stacks like Grafana, Datadog, New Relic, and Dash0.

* **Drop-in Replacement** - Simply replace `opentelemetry-instrument` with `openlit-instrument` to get the same functionality plus comprehensive AI capabilities.

* **Complete Stack Coverage** - AI instrumentations + upstream OpenTelemetry instrumentations for full-stack observability.

* **End-to-End Distributed Tracing** - Complete visibility: HTTP requests → framework routing → database queries → LLM calls → agent workflows → tool usage → responses

* **Advanced LLM Monitoring** - Real-time cost tracking, token usage optimization, performance monitoring, and evaluations scoring.

## Supported instrumentations

The OpenLIT SDK automatically instruments:

<CardGroup cols={2}>
  <Card title="LLM Providers" icon="brain">
    OpenAI, Anthropic, Google, Azure OpenAI, AWS Bedrock, Ollama, Groq, Cohere, Mistral, and more
  </Card>

  <Card title="AI/Agentic Frameworks" icon="cube">
    LangChain, LlamaIndex, CrewAI, mem0, AG2, DSPy, Agno, and more
  </Card>

  <Card title="Vector Databases" icon="database">
    ChromaDB, Pinecone, Qdrant, Milvus, Weaviate, and more
  </Card>

  <Card title="GPUs" icon="server">
    NVIDIA and AMD
  </Card>

  <Card title="HTTP Frameworks and Clients" icon="globe">
    FastAPI, Flask, Django, Requests, HTTPX, aiohttp, urllib and more
  </Card>
</CardGroup>

## Supported languages

<CardGroup cols={3}>
  <Card title="Python" icon="python">
    Complete AI observability with automatic dependency detection. Zero-code instrumentation for production Python LLM applications with real-time performance monitoring.
  </Card>

  <Card title="TypeScript/JavaScript" icon="node-js">
    Full LLM monitoring support for TypeScript / JavaScript applications with distributed tracing, metrics and cost optimization.
  </Card>

  <Card title="Go" icon="golang" href="/latest/sdk/go-overview">
    OpenTelemetry-native instrumentation for Go applications. Wrap your OpenAI and Anthropic clients for automatic tracing, token tracking, and cost monitoring.
  </Card>
</CardGroup>

## How it works

```mermaid theme={null}
flowchart LR
    A[Install OpenLIT] --> B[Instrument your application]
    B --> C[Generates Distributed Traces and metrics]
    C --> D[OpenTelemetry Export]
    D --> E[Observability Dashboard]
```

**Option 1: Zero code instrumentation**

```bash theme={null}
openlit-instrument python your_app.py
```

**Option 2: Manual instrumentation**

```python theme={null}
import openlit

openlit.init()  # Enables Automatic instrumentation for AI apps and agents
```

Both approaches provide production-ready observability: **distributed tracing**, **real-time cost tracking**, **latency monitoring**, **token usage optimization**, and **evaluation scoring**.

## Getting started

Select from the following guides to learn more about production AI monitoring:

<CardGroup cols={2}>
  <Card title="Quickstart: LLM Observability" href="/latest/sdk/quickstart-ai-observability" icon="bolt">
    Production-ready AI monitoring setup in 2 simple steps with zero code changes
  </Card>

  <Card title="Integrations" href="/latest/sdk/integrations/overview" icon="circle-nodes">
    60+ AI integrations with automatic instrumentation and performance tracking
  </Card>

  <Card title="Deploy OpenLIT Platform" href="/latest/openlit/installation" icon="circle-down">
    Deployment options for scalable LLM monitoring infrastructure
  </Card>

  <Card title="Destinations" href="/latest/sdk/destinations/overview" icon="link">
    Send telemetry to Datadog, Grafana, New Relic, Dash0, and other observability stacks
  </Card>
</CardGroup>

<Card title="Zero-code observability with the OpenLIT Controller" icon="tower-broadcast" href="/latest/controller/overview">
  Discover and instrument LLM traffic across Kubernetes, Docker, and Linux using eBPF — no code changes required.
</Card>