Simple GPU monitoring setup for AI workloads. Track NVIDIA and AMD GPU usage, temperature, and costs with zero code changes using OpenTelemetry.
Using the SDK
Deploy OpenLIT
Git clone OpenLIT repository
Start Docker Compose
Install OpenLIT
Initialize OpenLIT in your Application
Using the Collector
Deploy OpenLIT
Git clone OpenLIT repository
Start Docker Compose
Pull `otel-gpu-collector` Docker Image
Run `otel-gpu-collector` Docker container
Docker Compose: Add the following config under `services`
Host IP: Use the Host IP to connect to OTel Collector