Self-hosting

OpenLIT flexibly adapts to your preferred environment. Select a deployment method that best fits your needs:

Kubernetes

Deploy OpenLIT on a Kubernetes for scalable LLM Monitoring capabilities.

Deploy OpenLIT using Docker for an easy-to-manage LLM Monitoring setup.

Deploy OpenLIT on your Kubernetes cluster using the OpenLIT Helm chart for a reliable and scalable solution.

Helm Repo Setup

shell

helm repo add openlit https://openlit.github.io/helm/
helm repo update

Installing the Helm Chart

shell

helm install openlit openlit/openlit

For a quick and straightforward setup, Docker Compose can be used to deploy OpenLIT.

Git Clone OpenLIT Repository

git clone [email protected]:openlit/openlit.git

Start Docker Compose

From the root directory of the OpenLIT Repo, Run the below command

docker compose up -d

Integrate your LLM Stack with OpenLIT

Connect to your existing Observablity Stack

Was this page helpful?

On this page