OpenLIT flexibly adapts to your preferred environment. Select a deployment method that best fits your needs:

Kubernetes

Kubernetes

Deploy OpenLIT on a Kubernetes for scalable AI Engineering capabilities.

Docker

Deploy OpenLIT using Docker for an easy-to-manage AI Engineering setup.

​
Kubernetes

Deploy OpenLIT on your Kubernetes cluster using the OpenLIT Helm chart for a reliable and scalable solution.

1

Helm Repo Setup

shell
helm repo add openlit https://openlit.github.io/helm/
helm repo update
2

Installing the Helm Chart

shell
helm install openlit openlit/openlit

​
Docker

For a quick and straightforward setup, Docker Compose can be used to deploy OpenLIT.

1

Git Clone OpenLIT Repository

git clone git@github.com:openlit/openlit.git
2

Start Docker Compose

From the root directory of the OpenLIT Repo, Run the below command

docker compose up -d

Integrations

Integrate your AI Stack with OpenLIT

Connections

Connect to your existing Observablity Stack

Was this page helpful?

Suggest edits
Quickstart: GuardrailsSDK Configuration