Skip to content

EvalThresholds

PromptScript API


Defined in: core/src/types/eval.ts:211

Limits a run must meet for the suite to pass.

Properties

latencyMs?

optional latencyMs?: EvalLatencyThresholds

Defined in: core/src/types/eval.ts:229

Latency limits


maxCostPerCaseUsd?

optional maxCostPerCaseUsd?: number

Defined in: core/src/types/eval.ts:227

Cost limit of one case in USD.

Minimum

0


maxCostUsd?

optional maxCostUsd?: number

Defined in: core/src/types/eval.ts:222

Cost limit of the whole suite run in USD.

Minimum

0


passRate?

optional passRate?: number

Defined in: core/src/types/eval.ts:217

Minimum share of passed cases per model entry, 0 to 1; default 1.

Minimum

0

Maximum

1