Helicone

Use Cases

Sign In

Discord

Github

ETL / Data Extraction

Helicone is the observability platform purpose-built for LLM developers.

Introduction

Every header you need to know to access Helicone features and unlock advanced observability capabilities.

Header Directory

Learn how to integrate OpenAI with Helicone using Node.js.

Node.js

Learn how to integrate OpenAI with Helicone using Python

Python

Learn how to integrate OpenAI with Helicone using Langchain.

Langchain

Learn how to integrate OpenAI with Helicone using Async Logging.

Async Logging

Azure OpenAI

Anthropic

Anyscale

Together AI

OpenRouter

LiteLLM

We've teamed up with PostHog to bring your LLM analytics to PostHog, so you can view them all in one place.

PostHog

The optimal method to integrate with Helicone is through our Gateway. This API provides a seamless interface for sending requests and responses to Helicone.

Gateway Integration

Custom Model (Beta)

Effortlessly monitor prompt versions and inputs.

Prompts

Helicone allows you to tag requests with any information you choose to segment, analyze, and visualize by.

Custom Properties

Reduce latency and save costs by caching on the edge

Cache

Omit Logs

Get user metrics like number of requests, costs, and activity

User Metrics

Helicone now incorporates a feature that enables users to provide feedback on LLM responses, indicating their level of satisfaction with the provided response.

User Feedback

With the instability of some APIs and the similarity of many providers, we have developed a unified gateway. This gateway allows you to utilize any provider through a single endpoint.

Gateway Fallback (Beta)

Intelligently retry requests to overcome rate limits and overloaded servers

Retries

Enforcing custom API usage restrictions with rate limiting

Custom Rate Limits

With Helicone's Vault, manage your provider API keys securely and simplify distribution using Helicone proxy keys.

Key Vault

Integrate OpenAI moderation to safeguard your chat completions.

Moderation Integration

Secure OpenAI chat completions against prompt injections.

LLM Security

Webhooks allow you to build or set up integrations which subscribe to certain events on Helicone.ai. When one of those events is triggered, we'll send a HTTP POST payload to the webhook's configured URL. Webhooks can be used to update an external issue tracker, trigger CI builds, update a backup mirror, or even deploy to your production server.

Webhooks

Easily manage your customers and their usage. 

Customer Portal

Reselling a Model Example

Billing by usage

Determine when you should use a proxy or async function in Helicone.

Proxy vs Async

An explanation of our process for calculating cost per request

How we caclulate cost

We take the security of your OpenAI requests extremely seriously

How encryption works

We know latency of your Large-Language Model usage is important to your application's success, that's why we designed Helicone to impact latency as little as possible.

Latency Impact

A quick start guide to get you up and running with a self-hosted instance of Helicone.

Self Deploy

Self Deploy Docker Compose

Cloud Deploy

Predetermine Helicone's request ID for asynchronous utilization in other tasks

Request ID Predefinition

User requests

Easily maintain and version your prompts in Helicone. Test and compare the outputs using metrics you care about.

How to run experiments with prompts

Automate the monitoring and caching of LLM calls in your CI pipelines

Github Actions

Leverage custom segments to gain insights into costs and user behavior

Overview

Effortlessly track your environments with Helicone.

Environment Tracking

Helicone provides an efficient platform for identifying and rectifying errors in your code, offering insights into their occurrence.

Debugging

Data Autonomy signifies the empowerment of individuals and organizations to retain full control over their data. Discover how Helicone's open-source software bolsters this essential facet of digital sovereignty.

Observability

Guides

CI/CD

Custom Properties

Developer

ETL / Data Extraction

ETL Connectors (coming soon)

Observability

Guides

CI/CD

Custom Properties

Developer

​ETL Connectors (coming soon)

ETL Connectors (coming soon)