Providers
OpenAI
Python, Node, cURL, Langchain
Anthropic
Python, Node, cURL, Langchain
Azure
Python, Node, cURL, Langchain
Anyscale
OpenRouter
LiteLLM
Features
Custom Properties
Label and segment your requests
Feedback
Provide user feedback
Caching
Save cost and improve latency
Streaming
Usage statistics
Rate Limiting
Easily rate-limit power users
Retries
Smartly retry requests
Fine Tuning
Fine-tune a model on your logs
Customer Portal
Fine-tune a model on your logs
Key Vault
Remove request and responses
Jobs
Visualize chained requests
Omit Logs
Remove request and responses
User Metrics
Insights into your users