Compare Models
Request
Prompt
- POSTQuery Prompts
- POSTQuery Prompt
- DELDelete Prompt
- POSTCreate Prompt
- POSTEdit Prompt Version Label
- POSTEdit Prompt Version Template
- POSTGet Prompt Version Subversion
- POSTPromote Prompt Version
- POSTQuery Prompt Version Inputs
- GETGet Prompt Experiments
- POSTQuery Prompt Versions
- GETGet Prompt Version
- DELDelete Prompt Version
- POSTCompile Prompt
- POSTQuery Prompt Template
Evals
Evaluator
Experiment
- POSTCreate Empty Experiment (v2)
- POSTCreate from Request (v2)
- POSTCreate New Experiment (v2)
- GETList Experiments
- GETGet Experiment Details
- POSTAdd Prompt Version
- GETGet Experiment Prompt Versions
- GETGet Experiment Input Keys
- POSTAdd Manual Row (v2)
- POSTBatch Insert Rows (v2)
- POSTPost v2experiment rowupdate
- POSTPost v2experiment run hypothesis
- GETGet Experiment Evaluators (v2)
- POSTAdd Evaluators (v2)
- DELDelete Experiment Evaluator (v2)
- POSTRun Evaluators (v2)
- GETCheck Evaluator Run Status
- GETGet Experiment Scores
- GETGet Experiment Score
- POSTCreate Empty Experiment
- POSTCreate New Table
- POSTQuery Experiment Table
- POSTQuery Table Metadata
- POSTQuery Tables
- POSTCreate Table Cell
- PATCHUpdate Experiment Table Cell
- POSTCreate Table Column
- POSTCreate New Table Row
- DELDelete Experiment Table Row
- POSTBatch Insert Table Rows
- POSTUpdate Metadata
- POSTCreate Experiment
- POSTCreate Experiment Hypothesis
- POSTQuery Hypothesis Scores
- GETGet Experiment Evaluators
- POSTAdd Experiment Evaluators
- POSTRun Experiment Evaluators
- DELDelete Experiment Evaluator
- POSTQuery Experiments
Property
Dataset
Dashboard
Settings
Compare Models
Compare performance metrics between different models
POST
/
v1
/
public
/
compare
/
models
curl --request POST \
--url https://api.helicone.ai/v1/public/compare/models \
--header 'Content-Type: application/json' \
--header 'authorization: <api-key>' \
--data '[
{
"provider": "<string>",
"names": [
"<string>"
],
"parent": "<string>"
}
]'
{
"data": [
{
"timeSeriesData": {
"errorRate": [
{
"value": 123,
"timestamp": "<string>"
}
],
"successRate": [
{
"value": 123,
"timestamp": "<string>"
}
],
"ttft": [
{
"value": 123,
"timestamp": "<string>"
}
],
"latency": [
{
"value": 123,
"timestamp": "<string>"
}
]
},
"requestStatus": {
"errorRate": 123,
"successRate": 123
},
"geographicTtft": [
{
"median": 123,
"countryCode": "<string>"
}
],
"geographicLatency": [
{
"median": 123,
"countryCode": "<string>"
}
],
"feedback": {
"negativePercentage": 123,
"positivePercentage": 123
},
"costs": {
"completion_token": 123,
"prompt_token": 123
},
"ttft": {
"p99": 123,
"p95": 123,
"p90": 123,
"max": 123,
"min": 123,
"median": 123,
"average": 123
},
"latency": {
"p99": 123,
"p95": 123,
"p90": 123,
"max": 123,
"min": 123,
"median": 123,
"average": 123,
"medianPer1000Tokens": 123
},
"provider": "<string>",
"model": "<string>"
}
]
}
Authorizations
Body
application/json · object[]
Response
200 - application/json
Ok
Was this page helpful?
curl --request POST \
--url https://api.helicone.ai/v1/public/compare/models \
--header 'Content-Type: application/json' \
--header 'authorization: <api-key>' \
--data '[
{
"provider": "<string>",
"names": [
"<string>"
],
"parent": "<string>"
}
]'
{
"data": [
{
"timeSeriesData": {
"errorRate": [
{
"value": 123,
"timestamp": "<string>"
}
],
"successRate": [
{
"value": 123,
"timestamp": "<string>"
}
],
"ttft": [
{
"value": 123,
"timestamp": "<string>"
}
],
"latency": [
{
"value": 123,
"timestamp": "<string>"
}
]
},
"requestStatus": {
"errorRate": 123,
"successRate": 123
},
"geographicTtft": [
{
"median": 123,
"countryCode": "<string>"
}
],
"geographicLatency": [
{
"median": 123,
"countryCode": "<string>"
}
],
"feedback": {
"negativePercentage": 123,
"positivePercentage": 123
},
"costs": {
"completion_token": 123,
"prompt_token": 123
},
"ttft": {
"p99": 123,
"p95": 123,
"p90": 123,
"max": 123,
"min": 123,
"median": 123,
"average": 123
},
"latency": {
"p99": 123,
"p95": 123,
"p90": 123,
"max": 123,
"min": 123,
"median": 123,
"average": 123,
"medianPer1000Tokens": 123
},
"provider": "<string>",
"model": "<string>"
}
]
}