Helicone dashboard where you can monitor your AI applications.
Log your LLM requests, evaluate, and experiment with prompts, and get instant insights that helps you push changes to production with confidence. Helicone is the CI workflow designed for the entire LLM lifecycle.

​
Quick Start

Welcome to Helicone! Integrate your preferred provider with Helicone in seconds.
1

Create an account

Once you have an account, proceed to the next step.
2

Generate an API key

For more details on Helicone API keys, check out the Helicone Auth docs.
3

Integrate with AI Gateway

Helicone’s AI Gateway is an OpenAI-compatible, unified API with access to 100+ models, including OpenAI, Anthropic, Vertex, Groq, and more.Bring your own key: Go to Provider Keys to securely store API keys for the providers you want to use.
import { OpenAI } from "openai";

const openai = new OpenAI({
  baseURL: "https://ai-gateway.helicone.ai/v1",
  apiKey: process.env.HELICONE_API_KEY,
});

const response = await openai.chat.completions.create({
  model: "gpt-4o-mini/openai", // model-name/provider
  messages: [{ role: "user", content: "Hello, world!" }],
});
Why AI Gateway? Get immediate, OpenAI-compatible access to models from any major provider, alongside features like rate limiting, caching, prompt versioning, and complete observability - all with zero code changes beyond the base URL and setting up your API keys.
4

Send your first request 🎉

Once we receive your requests, you will see them in the Requests tab.You will also see that your Dashboard has been updated with your new request.

​
What’s next?

We curated a list to help you make the most of Helicone, but you’re welcome to explore the product on your own!

Add a custom property

Label your requests to segment, analyze, and visualize them.

Create your first prompt

Version your prompt and inputs as they evolve.

Track a session

Group and visualize multi-step LLM interactions (i.e. AI agents).

Cache responses

Cache and watch how much time and cost you saved.

​
Explore Features

Here are the key features to explore as you build with Helicone:

Prompts

Manage and version prompts from code or UI.

Sessions

Trace agentic workflows and visualize them.

Custom Properties

Label and segment your requests.

Caching

Save cost and improve latency.

Rate Limiting

Easily rate-limit power users.

User Metrics

Get insights into your user’s usage.

​
Alternative Integration Methods

Need a different integration approach? Here are provider-specific and alternative methods:

OpenAI

Azure

Anthropic

Llama

Ollama

AWS Bedrock

Gemini

Groq

Instructor

Vercel AI

Anyscale

Together AI

Hyperbolic

Deepinfra

OpenRouter

LiteLLM

Fireworks AI

OpenLLMetry

Log directly to Helicone without going through our proxy.

Gateway

Custom gateway configurations and legacy documentation.

​
Further Reading

Proxy or Async?

Determine when you should use a proxy or async function in Helicone.

How we calculate costs

A detailed breakdown of our process to calculate cost per request.

Understanding Helicone Headers

Every header you need to know to access Helicone features.

​
Questions?

Although we designed the docs to be as self-serving as possible, you are welcome to join our Discord or contact help@helicone.ai with any questions or feedback you have. Interested in deploying Helicone on-prem? Schedule a call with us.