Self-hosted and air-gapped.

LiteLLM OSS

Ideal for organizations trying to give LLM access to developers across multiple LLM APIs — with cost tracking, guardrails, and logging across every endpoint. No data or telemetry is sent to LiteLLM servers when you self-host.

Go to Docs Try LiteLLM Enterprise

MIT licensed · Self-host in minutes

Get your installation guide

Understand the best docker image for your environment, available LiteLLM Tooling (Helm, Terraform) and get a support channel with our team.

Thank you! Your submission has been received!

Oops! Something went wrong while submitting the form.

OpenAI-Compatible

Virtual Keys

Prometheus Metrics

Spend Tracking

Global Guardrails

Budgets & Rate Limits

Request/Response Logs

Fallbacks & Load Balancing

‍

Run it yourself. Start today.

Deploy the open-source gateway in an afternoon, with spend tracked and capped on every request. Add SSO, audit logs, and an SLA when it goes org-wide.

Start free

Talk to sales