Get Requests - Helicone OSS LLM Observability

POST

/

v1

/

request

/

query

The following API lets you get all of the requests that would be visible in the request table at helicone.ai/requests.

Premade examples 👇

Filter	Description
Get Request by User	Get all the requests made by a user

Filter

A filter is either a FilterLeaf or a FilterBranch, and can be composed of multiple filters generating an AST of ANDs/ORs.

Here is how it is represented in typescript:

export interface FilterBranch {
  left: FilterNode;
  operator: "or" | "and"; // Can add more later
  right: FilterNode;
}

export type FilterNode = FilterLeaf | FilterBranch | "all";

This allows us to build complex filters like this:

{
  "filter": {
    "operator": "and",
    "right": {
      "request": {
        "model": {
          "contains": "gpt-4"
        }
      }
    },
    "left": {
      "request": {
        "user_id": {
          "equals": "abc@email.com"
        }
      }
    }
  }
}

Authorizations

authorization

string

header

required

Body

application/json

Request query filters

filter

required

From T, pick a set of properties whose keys are in the union K

filter.cache_hits

object

Make all properties in T optional

filter.cache_hits.completion_tokens

object

Make all properties in T optional

filter.cache_hits.created_at

object

Make all properties in T optional

filter.cache_hits.latency

object

Make all properties in T optional

filter.cache_hits.organization_id

object

Make all properties in T optional

filter.cache_hits.prompt_tokens

object

Make all properties in T optional

filter.cache_hits.request_id

object

Make all properties in T optional

filter.feedback

object

Make all properties in T optional

filter.properties

object

filter.request

object

Make all properties in T optional

filter.request.auth_hash

object

Make all properties in T optional

filter.request.created_at

object

Make all properties in T optional

filter.request.id

object

Make all properties in T optional

filter.request.model

object

Make all properties in T optional

filter.request.modelOverride

object

Make all properties in T optional

filter.request.node_id

object

Make all properties in T optional

filter.request.org_id

object

Make all properties in T optional

filter.request.path

object

Make all properties in T optional

filter.request.prompt

object

Make all properties in T optional

filter.request.prompt_id

object

Make all properties in T optional

filter.request.user_id

object

Make all properties in T optional

filter.request_response_rmt

object

Make all properties in T optional

filter.request_response_rmt.completion_tokens

object

Make all properties in T optional

filter.request_response_rmt.job_id

object

Make all properties in T optional

filter.request_response_rmt.latency

object

Make all properties in T optional

filter.request_response_rmt.model

object

Make all properties in T optional

filter.request_response_rmt.node_id

object

Make all properties in T optional

filter.request_response_rmt.organization_id

object

Make all properties in T optional

filter.request_response_rmt.prompt_tokens

object

Make all properties in T optional

filter.request_response_rmt.properties

object

filter.request_response_rmt.request_body

object

Make all properties in T optional

filter.request_response_rmt.request_created_at

object

Make all properties in T optional

filter.request_response_rmt.request_id

object

Make all properties in T optional

filter.request_response_rmt.response_body

object

Make all properties in T optional

filter.request_response_rmt.response_created_at

object

Make all properties in T optional

filter.request_response_rmt.scores

object

filter.request_response_rmt.scores_column

object

Make all properties in T optional

filter.request_response_rmt.search_properties

object

filter.request_response_rmt.status

object

Make all properties in T optional

filter.request_response_rmt.target_url

object

Make all properties in T optional

filter.request_response_rmt.threat

object

Make all properties in T optional

filter.request_response_rmt.total_tokens

object

Make all properties in T optional

filter.request_response_rmt.user_id

object

Make all properties in T optional

filter.request_response_search

object

Make all properties in T optional

filter.response

object

Make all properties in T optional

filter.sessions_request_response_rmt

object

Make all properties in T optional

filter.values

object

includeInputs

boolean

isCached

boolean

isPartOfExperiment

boolean

isScored

boolean

limit

number

offset

number

sort

object

Response

200 - application/json

data

object[]

required

data.asset_ids

string[] | null

required

data.asset_urls

object

required

Construct a type with a set of properties K of type T

data.assets

string[]

required

data.completion_tokens

number | null

required

data.country_code

string | null

required

data.delay_ms

number | null

required

data.helicone_user

string | null

required

data.llmSchema

object

required

data.model_override

string | null

required

data.prompt_id

string | null

required

data.prompt_tokens

number | null

required

data.properties

object

required

Construct a type with a set of properties K of type T

data.provider

required

Available options:

OPENAI,

ANTHROPIC,

AZURE,

LOCAL,

HELICONE,

AMDBARTEK,

ANYSCALE,

CLOUDFLARE,

2YFV,

TOGETHER,

LEMONFOX,

FIREWORKS,

PERPLEXITY,

GOOGLE,

OPENROUTER,

WISDOMINANUTSHELL,

GROQ,

COHERE,

MISTRAL,

DEEPINFRA,

QSTASH,

FIRECRAWL,

AWS,

DEEPSEEK,

X,

AVIAN

data.request_body

any

required

data.request_created_at

string

required

data.request_id

string

required

data.request_model

string | null

required

data.request_path

string

required

data.request_properties

object

required

Construct a type with a set of properties K of type T

data.request_user_id

string | null

required

data.response_created_at

string | null

required

data.response_id

string | null

required

data.response_model

string | null

required

data.response_status

number

required

data.scores

object

required

Construct a type with a set of properties K of type T

data.target_url

string

required

data.time_to_first_token

number | null

required

data.total_tokens

number | null

required

data.costUSD

number | null

data.feedback_created_at

string | null

data.feedback_id

string | null

data.feedback_rating

boolean | null

data.model

string

data.response_body

any

data.signed_body_url

string | null

error

enum<number> | null

required

Was this page helpful?

Suggest edits Raise issue

Get Requests (faster)