Product · AI Gateway
One API for every LLM
200+ models. 40+ providers. Zero code changes.
Stop juggling API keys and provider dashboards. The AI Gateway routes your requests across every major provider through one OpenAI-compatible endpoint — with smart routing, automatic fallback, caching, and guardrails built in.
Migrate by changing one line
Point your existing OpenAI SDK at the gateway. Everything else stays the same.
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.llmgateway.io/v1",
apiKey: process.env.LLM_GATEWAY_API_KEY,
});
const completion = await client.chat.completions.create({
model: "openai/gpt-5", // or anthropic/claude-*, google/gemini-*, ...
messages: [{ role: "user", content: "Hello!" }],
});Project-scoped API keys
Create keys per project, set usage and spending limits, and rotate them without touching your code.
Built for production traffic
OpenAI-compatible API
Keep your existing SDK and change the base URL — chat completions, embeddings, images, video, speech, and transcription all speak the same format.
Smart routing & fallback
Route by price, latency, throughput, or uptime, and fall back to the next healthy provider automatically when one degrades.
Response caching
Serve repeated requests from Redis-backed cache and pass provider cache controls through — cutting both latency and spend.
Guardrails
Prompt-injection protection, PII detection and redaction, secrets detection, and a custom rules engine — enforced at the gateway.
Key management
Centralized, encrypted provider keys with project-scoped API keys, usage and spending limits, and full audit trails.
Cloud or self-hosted
Use the hosted gateway or deploy the AGPLv3-licensed source on your own infrastructure with Docker, Compose, or Kubernetes.
Ship with any model, today
Bring your own provider keys for free, pay as you go with a flat 5% platform fee, or self-host the open-source gateway.