Proxy Integration

Helicone OSS LLM Observability

Use Cases

Sign In

Discord

Github

Use Anthropic's Python SDK to integrate with Helicone to log your Anthropic LLM usage.

Python

Anthropic Python SDK Integration

Anthropic Python SDK Integration - Helicone OSS LLM Observability

Get started with Helicone, the open-source LLM observability platform for developers to monitor, debug, and optimize their applications.

Introduction

Introduction to Helicone - Open Source LLM Observability

Comprehensive guide to all Helicone headers. Learn how to access and implement various Helicone features through custom request headers.

Header Directory

Helicone Header Directory

Helicone Header Directory - Open Source LLM Observability

Complete guide to Helicone authentication. Learn about API key types, permissions, regional variations, and alternative authentication methods.

Helicone Auth

Helicone Authentication

Helicone Authentication - Open Source LLM Observability

Use OpenAI's JavaScript SDK to integrate with Helicone to log your OpenAI usage.

JavaScript

OpenAI JavaScript SDK Integration

OpenAI JavaScript SDK Integration - Helicone OSS LLM Observability

Use OpenAI's Python SDK to integrate with Helicone to log your OpenAI usage.

OpenAI Python SDK Integration

OpenAI Python SDK Integration - Helicone OSS LLM Observability

Use LangChain to integrate OpenAI with Helicone to log your OpenAI usage.

LangChain

OpenAI LangChain Integration

OpenAI Langchain Integration - Helicone OSS LLM Observability

Use LlamaIndex to integrate with Helicone to log your LlamaIndex usage.

LlamaIndex

LlamaIndex Integration

LlamaIndex Integration - Helicone OSS LLM Observability

Integrate Helicone with Crew AI, a multi-agent framework for automating complex workflows. Monitor AI-driven tasks and agent interactions for real use cases.

Crew AI

Crew AI Integration

Crew AI Integration - Helicone OSS LLM Observability

Use Async Logging to integrate OpenAI with Helicone to log your OpenAI usage without using the Helicone Proxy.

Async Logging

OpenAI  with Async Logging

OpenAI Async Logging Integration - Helicone OSS LLM Observability

Use cURL to integrate OpenAI with Helicone to log your OpenAI usage.

cURL

OpenAI cURL Integration

OpenAI cURL Integration - Helicone OSS LLM Observability

Use JavaScript to integrate Azure OpenAI with Helicone to log your Azure OpenAI usage.

Azure OpenAI JavaScript Integration

Azure OpenAI JavaScript Integration - Helicone OSS LLM Observability

Use Python to integrate Azure OpenAI with Helicone to log your Azure OpenAI usage.

Azure OpenAI Python Integration

Azure OpenAI Python Integration - Helicone OSS LLM Observability

Use LangChain to integrate Azure OpenAI with Helicone to log your Azure OpenAI usage.

Azure OpenAI LangChain Integration

Azure OpenAI Langchain Integration - Helicone OSS LLM Observability

Use cURL to integrate Azure OpenAI with Helicone to log your Azure OpenAI usage.

Azure OpenAI cURL Integration

Azure-OpenAI cURL Integration - Helicone OSS LLM Observability

Use Anthropic's JavaScript SDK to integrate with Helicone to log your Anthropic LLM usage.

Anthropic JavaScript SDK Integration

Anthropic JavaScript SDK Integration - Helicone OSS LLM Observability

Use LangChain to integrate Anthropic with Helicone to log your Anthropic LLM usage.

Anthropic LangChain Integration

Anthropic LangChain Integration - Helicone OSS LLM Observability

Use cURL to integrate Anthropic with Helicone to log your Anthropic LLM usage.

cURL Integration

Anthropic cURL Integration

Anthropic cURL Integration - Helicone OSS LLM Observability

Learn how to integrate AWS Bedrock with Helicone using Javascript.

Javascript

Use Vercel AI SDK to integrate with Helicone to log your OpenAI usage.

Vercel AI

Vercel AI SDK Integration

Vercel AI SDK Integration - Helicone OSS LLM Observability

Connect Helicone with any LLM deployed on Anyscale, including Llama, Mistral, Gemma, and GPT.

Anyscale

Anyscale Integration

Anyscale Integration - Helicone OSS LLM Observability

Connect Helicone with Together AI, a platform for running open-source language models. Monitor and optimize your AI applications using Together AI's powerful models through a simple base_url configuration.

Together AI

Together AI Integration

Together AI Integration - Helicone OSS LLM Observability

Integrate Helicone with Hyperbolic, a platform for running open-source LLMs. Monitor and analyze interactions with any Hyperbolic-deployed model using a simple base_url configuration.

Hyperbolic

Hyperbolic Integration

Hyperbolic Integration - Helicone OSS LLM Observability

Use Groq's JavaScript SDK to integrate with Helicone to log your Groq usage.

Groq JavaScript SDK Integration

Groq JavaScript SDK Integration - Helicone OSS LLM Observability

Use Groq's Python SDK to integrate with Helicone to log your Groq usage.

Groq Python SDK Integration

Groq Python SDK Integration - Helicone OSS LLM Observability

Use cURL to integrate Groq with Helicone to log your Groq usage.

Groq cURL Integration

Groq cURL Integration - Helicone OSS LLM Observability

Connect Helicone with OpenAI-compatible models on Deepinfra. Simple setup process using a custom base_url for seamless integration with your Deepinfra-based AI applications.

Deepinfra

Deepinfra Integration

Deepinfra Integration - Helicone OSS LLM Observability

Integrate Helicone with OpenRouter, a unified API for accessing multiple LLM providers. Monitor and analyze AI interactions across various models through a single, streamlined interface.

OpenRouter

OpenRouter Integration

OpenRouter Integration - Helicone OSS LLM Observability

Connect Helicone with LiteLLM, a unified interface for multiple LLM providers. Standardize logging and monitoring across various AI models with simple callback or proxy setup.

LiteLLM

LiteLLM Integration

LiteLLM Integration - Helicone OSS LLM Observability

Connect Helicone with Fireworks AI, a platform that provides a fast, affordable, and customizable solution for generative artificial intelligence that helps product developers run, fine-tune, and share large language models.

Fireworks AI

Fireworks AI Integration

Fireworks AI Integration - Helicone OSS LLM Observability

Combine Helicone's LLM analytics with PostHog, a comprehensive product analytics platform. View LLM insights alongside other application data for holistic performance analysis.

PostHog

PostHog Integration

PostHog Integration - Helicone OSS LLM Observability

The optimal method to integrate with Helicone is through our Gateway. This API provides a seamless interface for sending requests and responses to Helicone.

Gateway Integration

Integrate any custom LLM, including open-source models like Llama and GPT-Neo, with Helicone. Step-by-step guide for both NodeJS and Curl implementations to connect your proprietary or open-source models.

Custom Model

Custom Model Integration

Custom Model Integration - Helicone OSS LLM Observability

Log LLM traces directly to Helicone, bypassing our proxy, with OpenLLMetry. Supports OpenAI, Anthropic, Azure OpenAI, Cohere, Bedrock, Google AI Platform, and more.

OpenLLMetry

OpenLLMetry Async Integration

OpenLLMetry Async Integration - Helicone OSS LLM Observability

Integrate Helicone with Open WebUI, an extensible, offline-capable interface for various LLM runners. Monitor interactions across Ollama, OpenAI-compatible APIs, and custom LLM setups.

Open WebUI

Open WebUI Integration

Open WebUI Integration - Helicone OSS LLM Observability

Integrate Helicone with MetaGPT, a multi-agent framework that simulates a software company workflow. Monitor AI-driven software development processes and agent interactions.

MetaGPT

MetaGPT Integration

MetaGPT Integration - Helicone OSS LLM Observability

Integrate Helicone with Open Devin, an AI-powered platform for autonomous software engineering. Monitor interactions between AI agents and human developers in your projects.

Open Devin

Open Devin Integration

Open Devin Integration - Helicone OSS LLM Observability

Integrate Helicone with Embedchain, an Open Source Framework for personalizing LLM responses. Monitor interactions across different LLMs in AI applications.

Mem0 Embedchain

Mem0 Embedchain Integration

Mem0 Embedchain Integration - Helicone OSS LLM Observability

Dify is an open-source LLM app development platform. Its intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production. Here is how to get Observability and logs for your dify instance.

Dify LLM Observability and Logs

Dify

Group and visualize multi-step LLM interactions. Track request flows across multiple traces and gain insights into complex AI workflows by adding only 2 simple headers.

Sessions

Sessions - Helicone OSS LLM Observability

Automatically version prompts from your codebase via our proxy, without changing your workflow. Run experiments using historical datasets to test, evaluate, and improve prompts over time while preventing regressions in production systems.

Prompts & Experiments

Prompts and Experiments - Helicone OSS LLM Observability

Add custom metadata to LLM requests for advanced segmentation and analysis. Tag requests with session IDs, conversation context, or application data to gain deeper insights into your AI application performance.

Custom Properties

Custom Properties - Helicone OSS LLM Observability

Reduce latency and save costs on LLM calls by caching responses on the edge. Configure cache duration, bucket sizes, and use cache seeds for consistent results across requests.

Caching

LLM Caching

LLM Cache - Helicone OSS LLM Observability

Configure Helicone to selectively exclude sensitive request and response data from your LLM application logs for privacy and compliance needs.

Omit Logs

Omit Logs - Helicone OSS LLM Observability

Monitor individual user interactions with your LLM applications. Track per-user request volumes, costs, and usage patterns across your AI services.

User Metrics

User Metrics - Helicone OSS LLM Observability

Collect and analyze user feedback on LLM responses. Evaluate output quality, identify trends, and optimize your AI application's performance based on user satisfaction.

User Feedback

User Feedback - Helicone OSS LLM Observability

Add custom scoring metrics to your LLM requests and experiments. Evaluate prompt performance, compare results across datasets, and quantify model outputs for continuous improvement.

Scores

Scores - Helicone OSS LLM Observability

Access multiple LLM providers through Helicone's unified gateway. Ensure high availability with automatic fallback options across OpenAI, Anthropic, and other AI services.

Gateway Fallbacks

Gateway Fallbacks for LLM Providers

Gateway Fallbacks for LLM Providers - Helicone OSS LLM Observability

Configure Helicone to automatically retry failed LLM requests, overcoming rate limits and server issues using intelligent exponential backoff.

Retries

Retries - Helicone OSS LLM Observability

Enforcing custom API usage restrictions with rate limiting

Custom Rate Limits

Centralize and secure provider API key management. Distribute Helicone proxy keys for simplified access control and enhanced security of your LLM applications.

Key Vault

Key Vault - Helicone OSS LLM Observability

Enable OpenAI's moderation feature in your LLM applications to automatically detect and filter harmful content in user messages.

Moderations

Moderations - Helicone OSS LLM Observability

Enable robust security measures in your LLM applications to protect against prompt injections, detect anomalies, and prevent data exfiltration.

LLM Security

LLM Security - Helicone OSS LLM Observability

Provide customers with a dedicated portal to view and manage their LLM usage. Oversee customer access, set rate limits, and monitor usage while allowing customers to track their own metrics.

Customer Portal

Customer Portal - Helicone OSS LLM Observability

Compare Helicone's Proxy and Async integration methods. Understand the features, benefits, and use cases for each approach to choose the best fit for your LLM application.

Proxy vs Async

Proxy vs Async Integration

Proxy vs Async Integration - Helicone OSS LLM Observability

Learn how Helicone calculates the cost per request for nearly all models, including both streamed and non-streamed requests. Detailed explanations and examples provided.

Cost Calculation

How We Calculate Cost

How We Calculate Cost - Helicone OSS LLM Observability

Helicone minimizes latency for your LLM applications using Cloudflare's global network. Detailed benchmarking results and performance metrics included.

Welcome

Dev Integrations

Other Integrations

Features

Resources

Anthropic Python SDK Integration

Proxy Integration

Welcome

Dev Integrations

Other Integrations

Features

Resources

​Proxy Integration

Proxy Integration