Give Developers
LLM Gateway to provide model access, logging and usage tracking across 100+ LLMs. All in the OpenAI format.
Trusted by
Features
Stay in Control
Logging + Spend Tracking
Log the request, response and usage data to s3, datadog, OTEL, langfuse, etc.
Start Here
Control Model Access
Control access to models by virtual keys, teams and model access groups
Start Here
Budgets & Rate Limits
Track spend and set budget limits across models, keys, teams and custom tags
Start Here
Move Fast
Pass-through Endpoints
Easily migrate projects to proxy via Pass-through endpoints with built in spend-tracking + logging
Start Here
OpenAI-Compatible API
Access 100+ LLMs in the OpenAI format. Supported across /chat/completion
, /embedding
, etc.
Start Here
Self-serve Portal
Allow teams to login via SSO and manage their own keys in production with a self-serve key management portal
Start Here
Pricing
Open Source
Free
Self-Hosted
100+ LLM Provider Integrations
Langfuse, Langsmith, OTEL Logging
Virtual Keys, Budgets, Teams
Load Balancing, RPM/TPM limits
LLM Guardrails
Enterprise Premium
Get In Touch
Cloud or Self-Hosted
Everything in OSS
Enterprise Support + Custom SLAs
JWT Auth, SSO, Audit Logs
All Enterprise Features - Docs