EvalThresholds
Defined in: core/src/types/eval.ts:211
Limits a run must meet for the suite to pass.
Properties
latencyMs?
optionallatencyMs?:EvalLatencyThresholds
Defined in: core/src/types/eval.ts:229
Latency limits
maxCostPerCaseUsd?
optionalmaxCostPerCaseUsd?:number
Defined in: core/src/types/eval.ts:227
Cost limit of one case in USD.
Minimum
0
maxCostUsd?
optionalmaxCostUsd?:number
Defined in: core/src/types/eval.ts:222
Cost limit of the whole suite run in USD.
Minimum
0
passRate?
optionalpassRate?:number
Defined in: core/src/types/eval.ts:217
Minimum share of passed cases per model entry, 0 to 1; default 1.
Minimum
0
Maximum
1