Get Requests (faster) - Helicone OSS LLM Observability

POST

/

v1

/

request

/

query-clickhouse

The following API is the same as the Get Requests API, but it is optimized for speed when querying large amount of data. This endpoint will timeout for point queries and is really slow when querying just a few requests.

The following API lets you get all of the requests that would be visible in the request table at helicone.ai/requests.

Premade examples 👇

Filter	Description
Get Request by User	Get all the requests made by a user

Filter

A filter is either a FilterLeaf or a FilterBranch, and can be composed of multiple filters generating an AST of ANDs/ORs.

Here is how it is represented in typescript:

export interface FilterBranch {
  left: FilterNode;
  operator: "or" | "and"; // Can add more later
  right: FilterNode;
}

export type FilterNode = FilterLeaf | FilterBranch | "all";

This allows us to build complex filters like this:

{
  "filter": {
    "operator": "and",
    "right": {
      "request_response_rmt": {
        "model": {
          "contains": "gpt-4"
        }
      }
    },
    "left": {
      "request_response_rmt": {
        "user_id": {
          "equals": "abc@email.com"
        }
      }
    }
  }
}

Authorizations

authorization

string

header

required

Body

application/json

Request query filters

filter

required

From T, pick a set of properties whose keys are in the union K

filter.cache_hits

object

Make all properties in T optional

filter.cache_hits.completion_tokens

object

Make all properties in T optional

filter.cache_hits.created_at

object

Make all properties in T optional

filter.cache_hits.latency

object

Make all properties in T optional

filter.cache_hits.organization_id

object

Make all properties in T optional

filter.cache_hits.prompt_tokens

object

Make all properties in T optional

filter.cache_hits.request_id

object

Make all properties in T optional

filter.feedback

object

Make all properties in T optional

filter.properties

object

filter.request

object

Make all properties in T optional

filter.request.auth_hash

object

Make all properties in T optional

filter.request.created_at

object

Make all properties in T optional

filter.request.id

object

Make all properties in T optional

filter.request.model

object

Make all properties in T optional

filter.request.modelOverride

object

Make all properties in T optional

filter.request.node_id

object

Make all properties in T optional

filter.request.org_id

object

Make all properties in T optional

filter.request.path

object

Make all properties in T optional

filter.request.prompt

object

Make all properties in T optional

filter.request.prompt_id

object

Make all properties in T optional

filter.request.user_id

object

Make all properties in T optional

filter.request_response_rmt

object

Make all properties in T optional

filter.request_response_rmt.completion_tokens

object

Make all properties in T optional

filter.request_response_rmt.job_id

object

Make all properties in T optional

filter.request_response_rmt.latency

object

Make all properties in T optional

filter.request_response_rmt.model

object

Make all properties in T optional

filter.request_response_rmt.node_id

object

Make all properties in T optional

filter.request_response_rmt.organization_id

object

Make all properties in T optional

filter.request_response_rmt.prompt_tokens

object

Make all properties in T optional

filter.request_response_rmt.properties

object

filter.request_response_rmt.request_body

object

Make all properties in T optional

filter.request_response_rmt.request_created_at

object

Make all properties in T optional

filter.request_response_rmt.request_id

object

Make all properties in T optional

filter.request_response_rmt.response_body

object

Make all properties in T optional

filter.request_response_rmt.response_created_at

object

Make all properties in T optional

filter.request_response_rmt.scores

object

filter.request_response_rmt.scores_column

object

Make all properties in T optional

filter.request_response_rmt.search_properties

object

filter.request_response_rmt.status

object

Make all properties in T optional

filter.request_response_rmt.target_url

object

Make all properties in T optional

filter.request_response_rmt.threat

object

Make all properties in T optional

filter.request_response_rmt.total_tokens

object

Make all properties in T optional

filter.request_response_rmt.user_id

object

Make all properties in T optional

filter.request_response_search

object

Make all properties in T optional

filter.response

object

Make all properties in T optional

filter.sessions_request_response_rmt

object

Make all properties in T optional

filter.values

object

includeInputs

boolean

isCached

boolean

isPartOfExperiment

boolean

isScored

boolean

limit

number

offset

number

sort

object

Response

200 - application/json

data

object[]

required

data.asset_ids

string[] | null

required

data.asset_urls

object

required

Construct a type with a set of properties K of type T

data.assets

string[]

required

data.completion_tokens

number | null

required

data.country_code

string | null

required

data.delay_ms

number | null

required

data.helicone_user

string | null

required

data.llmSchema

object

required

data.model_override

string | null

required

data.prompt_id

string | null

required

data.prompt_tokens

number | null

required

data.properties

object

required

Construct a type with a set of properties K of type T

data.provider

required

Available options:

OPENAI,

ANTHROPIC,

AZURE,

LOCAL,

HELICONE,

AMDBARTEK,

ANYSCALE,

CLOUDFLARE,

2YFV,

TOGETHER,

LEMONFOX,

FIREWORKS,

PERPLEXITY,

GOOGLE,

OPENROUTER,

WISDOMINANUTSHELL,

GROQ,

COHERE,

MISTRAL,

DEEPINFRA,

QSTASH,

FIRECRAWL,

AWS

data.request_body

any

required

data.request_created_at

string

required

data.request_id

string

required

data.request_model

string | null

required

data.request_path

string

required

data.request_properties

object

required

Construct a type with a set of properties K of type T

data.request_user_id

string | null

required

data.response_created_at

string | null

required

data.response_id

string | null

required

data.response_model

string | null

required

data.response_status

number

required

data.scores

object

required

Construct a type with a set of properties K of type T

data.target_url

string

required

data.time_to_first_token

number | null

required

data.total_tokens

number | null

required

data.costUSD

number | null

data.feedback_created_at

string | null

data.feedback_id

string | null

data.feedback_rating

boolean | null

data.response_body

any

data.signed_body_url

string | null

error

enum<number> | null

required

Was this page helpful?

Suggest edits Raise issue

Get Requests Get Single Request