Integrations
Monitor your GenAI and LLM Applications
Integrations
Monitor your GenAI and LLM Applications
Monitor LLM Costs, Tokens and Performance along with User Interactions with OpenTelemetry
Start integrating and monitoring your applications with OpenLIT effortlessly. Choose from a range of Integrations to start tracking LLM performance, usage, and costs without hassle.
LLMs
OpenAI
GPT4All
Ollama
Cohere
Anthropic
vLLM
GitHub Models
Azure OpenAI
Azure AI Inference
Mistral
HuggingFace
Amazon Bedrock
Vertex AI
Google AI Studio
Groq
NVIDIA NIM
ElevenLabs
OLA Krutrim
VectorDBs
Frameworks
GPUs
| Integration | Type | Python SDK | Typescript SDK |
|---|---|---|---|
| OpenAI | LLM | ✔️ | ✔️ |
| Anthropic | LLM | ✔️ | ✔️ |
| Ollama | LLM | ✔️ | ❌ |
| Cohere | LLM | ✔️ | ✔️ |
| GPT4All | LLM | ✔️ | ❌ |
| vLLM | LLM | ✔️ | ❌ |
| Azure OpenAI | LLM | ✔️ | ❌ |
| Azure AI Inference | LLM | ✔️ | ❌ |
| Google AI Studio | LLM | ✔️ | ❌ |
| GitHub Models | LLM | ✔️ | ❌ |
| NVIDIA NIM | LLM | ✔️ | ❌ |
| Mistral | LLM | ✔️ | ❌ |
| HuggingFace | LLM | ✔️ | ❌ |
| Amazon Bedrock | LLM | ✔️ | ❌ |
| Vertex AI | LLM | ✔️ | ❌ |
| Groq | LLM | ✔️ | ❌ |
| ElevenLabs | LLM | ✔️ | ❌ |
| OLA Krutrim | LLM | ✔️ | ❌ |
| ChromaDB | VectorDB | ✔️ | ❌ |
| Pinecone | VectorDB | ✔️ | ❌ |
| Qdrant | VectorDB | ✔️ | ❌ |
| Milvus | VectorDB | ✔️ | ❌ |
| LangChain | Framework | ✔️ | ❌ |
| LiteLLM | Framework | ✔️ | ❌ |
| LlamaIndex | Framework | ✔️ | ❌ |
| Haystack | Framework | ✔️ | ❌ |
| EmbedChain | Framework | ✔️ | ❌ |
| NVIDIA GPUs | GPU | ✔️ | ❌ |
Was this page helpful?