Give Developers

  • Azure Access

  • Gemini Access

  • Bedrock Access

  • OpenAI Access

LLM Gateway to provide model access, logging and usage tracking across 100+ LLMs. All in the OpenAI format.

Trusted by

4.8M+

docker pulls

20M+

requests served

100%

uptime

200+

contributors

Features

Stay in Control

Logging + Spend Tracking

Log the request, response and usage data to s3, datadog, OTEL, langfuse, etc.

Start Here

Control Model Access

Control access to models by virtual keys, teams and model access groups

Start Here

Budgets & Rate Limits

Track spend and set budget limits across models, keys, teams and custom tags

Start Here

Move Fast

Pass-through Endpoints

Easily migrate projects to proxy via Pass-through endpoints with built in spend-tracking + logging

Start Here

OpenAI-Compatible API

Access 100+ LLMs in the OpenAI format. Supported across /chat/completion, /embedding, etc.

Start Here

Self-serve Portal

Allow teams to login via SSO and manage their own keys in production with a self-serve key management portal

Start Here

Pricing

Open Source

Free

Self-Hosted

100+ LLM Provider Integrations

Langfuse, Langsmith, OTEL Logging

Virtual Keys, Budgets, Teams

Load Balancing, RPM/TPM limits

LLM Guardrails

Enterprise Premium

Get In Touch

Cloud or Self-Hosted

Everything in OSS

Enterprise Support + Custom SLAs

JWT Auth, SSO, Audit Logs

All Enterprise Features - Docs

Get 7 day trial key

Get 7 day trial key

Get 7 day trial key

Enterprise Security