EvalModelResultV1
Defined in: core/src/types/eval.ts:604
Result of one model entry of a suite.
Properties
apiId
apiId:
string
Defined in: core/src/types/eval.ts:610
Provider API model identifier
cases
cases:
EvalCaseResultV1[]
Defined in: core/src/types/eval.ts:629
Case results sorted by id
costUsd?
optionalcostUsd?:number
Defined in: core/src/types/eval.ts:623
Cost of the entry in USD.
Minimum
0
judgeAgreement?
optionaljudgeAgreement?:EvalJudgeAgreementV1[]
Defined in: core/src/types/eval.ts:627
Agreement with human labels per judge assertion, in assertion order
latencyMs
latencyMs:
EvalLatencyV1
Defined in: core/src/types/eval.ts:625
Latency percentiles of the entry
passRate
passRate:
number
Defined in: core/src/types/eval.ts:616
Passed cases over all cases.
Minimum
0
Maximum
1
provider
provider:
string
Defined in: core/src/types/eval.ts:608
Provider name
ref
ref:
string
Defined in: core/src/types/eval.ts:606
Model reference as written
usage
usage:
EvalUsageV1
Defined in: core/src/types/eval.ts:618
Calls and tokens of the entry