Tracing

Automatically track your AI apps with OpenTelemetry to gain insights into performance and behavior.

Metrics

Gather valuable metrics for your AI apps using OpenTelemetry auto instrumentation.

GPU Monitoring

Monitor NVIDIA GPUs with key metrics like usage, temperature, and power using OpenTelemetry.

Cost for Custom Models

Calculate costs for custom and fine-tuned LLMs using your own pricing data.

Create your own Dashboard

Create your first dashboard, set it as default, and get ready to add real-time visualizations.

Prompt Hub

Manage prompts centrally, fetch versions, and use variables for dynamic prompts.

Vault

Store and access sensitive information like LLM API keys securely.

Programmatic Evaluations

Evaluate AI responses for bias, toxicity, and hallucinations to improve performance.

Guardrails

Protect apps against injection, jailbreaking, and leaking of sensitive information.

Exceptions Monitoring

Automatically track and view detailed error stack traces in your app.

OpenGround

Compare different LLMs on performance, cost, and more side-by-side.

Multiple Databases

Switch and manage data across environments and tenants easily.