Model providers
Gateway
OpenAI
Route OpenAI requests through Inference for full observability.
Route your OpenAI requests through the Inference gateway to get cost tracking, latency monitoring, and analytics. You keep your existing OpenAI API key — just point the SDK at the gateway and add a few headers.
Prefer automatic setup? Run
inf instrument to instrument your codebase in seconds. Learn moreSetup
Get your API keys
You need two keys:
- Inference project API key — from your dashboard under API Keys
- OpenAI API key — from your OpenAI account
Set environment variables
export INFERENCE_API_KEY=<your-project-api-key>
export OPENAI_API_KEY=<your-openai-api-key>Update your code
Point the SDK at the gateway. Your project API key goes in apiKey to authenticate with the gateway, and your OpenAI key goes in x-inference-provider-api-key so the gateway can forward it to OpenAI.