Introduction
Self-hosting
Self-host OpenLIT in your preferred environment
OpenLIT flexibly adapts to your preferred environment. Select a deployment method that best fits your needs:
Kubernetes
Deploy OpenLIT on a Kubernetes for scalable LLM Monitoring capabilities.
Docker
Deploy OpenLIT using Docker for an easy-to-manage LLM Monitoring setup.
Kubernetes
Deploy OpenLIT on your Kubernetes cluster using the OpenLIT Helm chart for a reliable and scalable solution.
1
Helm Repo Setup
shell
helm repo add openlit https://openlit.github.io/helm/
helm repo update
2
Installing the Helm Chart
shell
helm install openlit openlit/openlit
Docker
For a quick and straightforward setup, Docker Compose can be used to deploy OpenLIT.
1
Git Clone OpenLIT Repository
git clone [email protected]:openlit/openlit.git
2
Start Docker Compose
From the root directory of the OpenLIT Repo, Run the below command
docker compose up -d
Was this page helpful?