Skip to content

EvalCaseResultV1

PromptScript API


Defined in: core/src/types/eval.ts:539

Result of one case on one model entry.

Properties

assertions

assertions: EvalAssertionResultV1[]

Defined in: core/src/types/eval.ts:547

Assertion results in suite order


cache

cache: EvalCacheUseV1

Defined in: core/src/types/eval.ts:562

Cache use of the case


cacheKeys

cacheKeys: string[]

Defined in: core/src/types/eval.ts:564

Cache keys of every call or hit the case consumed, judge runs included, in call order


costUsd?

optional costUsd?: number

Defined in: core/src/types/eval.ts:554

Cost of the case in USD.

Minimum

0


error?

optional error?: EvalCaseErrorV1

Defined in: core/src/types/eval.ts:566

Error that stopped the case


id

id: string

Defined in: core/src/types/eval.ts:541

Dataset row id


latencyMs

latencyMs: number

Defined in: core/src/types/eval.ts:560

Latency of the case call in milliseconds.

As Type

integer

Minimum

0


status

status: EvalCaseStatus

Defined in: core/src/types/eval.ts:545

Case status


tags?

optional tags?: string[]

Defined in: core/src/types/eval.ts:543

Row tags


usage

usage: EvalUsageV1

Defined in: core/src/types/eval.ts:549

Calls and tokens of the case, judge runs included