What is OpenLIT?

OpenLIT allows you to simplify your AI development workflow, especially for Generative AI and LLMs. It streamlines essential tasks like experimenting with LLMs, organizing and versioning prompts, and securely handling API keys. With just one line of code, you can enable OpenTelemetry-native observability, offering full-stack monitoring that includes LLMs, vector databases, and GPUs. This enables developers to confidently build AI features and applications, transitioning smoothly from testing to production.

This project proudly follows and maintains the Semantic Conventions with the OpenTelemetry community, consistently updating to align with the latest standards in Observability.

​

⚡ Features

• 📈 Analytics Dashboard: Monitor your AI application’s health and performance with detailed dashboards that track metrics, costs, and user interactions, providing a clear view of overall efficiency.

• 🔌 OpenTelemetry-native Observability SDKs: Vendor-neutral SDKs to send traces and metrics to your existing observability tools.

• 💲 Cost Tracking for Custom and Fine-Tuned Models: Tailor cost estimations for specific models using custom pricing files for precise budgeting.

• 🐛 Exceptions Monitoring Dashboard: Quickly spot and resolve issues by tracking common exceptions and errors with a dedicated monitoring dashboard.

• 💭 Prompt Management: Manage and version prompts using Prompt Hub for consistent and easy access across applications.

• 🔑 API Keys and Secrets Management: Securely handle your API keys and secrets centrally, avoiding insecure practices.

• 🎮 Experiemnt with different LLMs: Use OpenGround to explore, test and compare various LLMs side by side.

​

Getting Started

Select from the following guides to learn more about how to use OpenLIT: