EvalCaseResultV1
Defined in: core/src/types/eval.ts:539
Result of one case on one model entry.
Properties
assertions
assertions:
EvalAssertionResultV1[]
Defined in: core/src/types/eval.ts:547
Assertion results in suite order
cache
cache:
EvalCacheUseV1
Defined in: core/src/types/eval.ts:562
Cache use of the case
cacheKeys
cacheKeys:
string[]
Defined in: core/src/types/eval.ts:564
Cache keys of every call or hit the case consumed, judge runs included, in call order
costUsd?
optionalcostUsd?:number
Defined in: core/src/types/eval.ts:554
Cost of the case in USD.
Minimum
0
error?
optionalerror?:EvalCaseErrorV1
Defined in: core/src/types/eval.ts:566
Error that stopped the case
id
id:
string
Defined in: core/src/types/eval.ts:541
Dataset row id
latencyMs
latencyMs:
number
Defined in: core/src/types/eval.ts:560
Latency of the case call in milliseconds.
As Type
integer
Minimum
0
status
status:
EvalCaseStatus
Defined in: core/src/types/eval.ts:545
Case status
tags?
optionaltags?:string[]
Defined in: core/src/types/eval.ts:543
Row tags
usage
usage:
EvalUsageV1
Defined in: core/src/types/eval.ts:549
Calls and tokens of the case, judge runs included