Secure API key management for multiple LLM providers with automatic discovery
Set your provider API keys
Configure your providers
ai-gateway-config.yaml
with your desired providers:Start the gateway
Test secret management
Environment Variables - Default
{PROVIDER_NAME}_API_KEY
environment variables for each configured provider.Best for: Most deployments, development environments, and simple production setupsHow it works:{PROVIDER_NAME}_API_KEY
for each providerConfiguration Read
Environment Variable Discovery
{PROVIDER_NAME}_API_KEY
environment variables for each configured providerRequest Arrives
API Key Validation
Secure Forwarding
Provider | Environment Variable | Required | Notes |
---|---|---|---|
OpenAI | OPENAI_API_KEY | Yes | Standard OpenAI API key |
Anthropic | ANTHROPIC_API_KEY | Yes | Claude API key |
Gemini | GEMINI_API_KEY | Yes | Google AI Studio API key |
AWS Bedrock | AWS_ACCESS_KEY , AWS_SECRET_KEY | Yes | AWS access key and secret key |
Mistral | MISTRAL_API_KEY | Yes | Mistral API key |
Ollama | N/A | No | Local deployment, no key needed |
Provider Keys Not Found
Authentication Failures
Missing Environment Variables
OPENAI_API_KEY
ANTHROPIC_API_KEY
GEMINI_API_KEY
AWS_ACCESS_KEY
+ AWS_SECRET_KEY
Router-Only Access
Environment Variable Security
{PROVIDER_NAME}_API_KEY
environment variablesClient Authentication
Optional Gateway Authentication
Feature | Description | Version |
---|---|---|
AWS Secrets Manager | Native integration with automatic rotation and cross-region replication | v2 |
Google Secret Manager | GCP-native secret management with IAM integration | v2 |
Azure Key Vault | Microsoft Azure secret management with enterprise governance | v2 |
HashiCorp Vault | Enterprise-grade secret management with dynamic secrets | v2 |