Featured in Gartner® Report

The Enterprise AI Gateway

🚅 LiteLLM

Cost Tracking

Batches API

Guardrails

Model Access

Budgets

LLM Observability

Rate Limiting

Prompt Management

s3 Logging

Pass-Through Endpoints

User

LLMs

MCP

Agents

LLM Gateway
Budgets & Rate Limits
MCP Gateway
RBAC & Usage Tracking by Key, Team, Org
Agent Gateway
Logging to Datadog & OpenTelemetry
Built-in and 3rd Party Guardrails
OIDC, SSO, Custom Authentication

240M+

docker pulls

1B+

requests served

80%

uptime

1,005+

contributors

Deploy in any environment

Self-hosted, on-prem, or in your cloud.

On-prem

Multi-Cloud

Kubernetes

Helm

Features

All available on LiteLLM Open-Source.

Delegate access

LiteLLM Enterprise allows you to delegate access of teams and organizations to admins. Reducing the time you spend managing the proxy.

Generate tokens on the fly

With OIDC/JWT Auth and 'group-based access', developers can generate temporary tokens to call models via LiteLLM. Reducing time spent managing keys and model access.