Unified API for

  • Azure OpenAI

  • Vertex AI

  • Bedrock

  • OpenAI

LLM Gateway to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.

Trusted by

90,000+

docker pulls

20M+

requests served

100%

uptime

200+

contributors

Add Model

Load Balance

Create Keys

Track Spend

Add Model

Load Balance

Create Keys

Track Spend

Pricing

Open Source

Free

100+ LLM Provider Integrations

Langfuse, Langsmith, OTEL Logging

Virtual Keys, Budgets, Teams

Load Balancing, RPM/TPM limits

Enterprise Basic

Get in Touch

Cloud or Self-Hosted

Everything in Open Source

Prometheus Metrics

LLM Guardrails

JWT Auth, SSO, Audit Logs

Get Started

Enterprise Premium

Get In Touch

Everything in Enterprise Basic

Enterprise Support + Custom SLAs

Start using for Free Today