Skip to content

EvalModelResultV1

PromptScript API


Defined in: core/src/types/eval.ts:604

Result of one model entry of a suite.

Properties

apiId

apiId: string

Defined in: core/src/types/eval.ts:610

Provider API model identifier


cases

cases: EvalCaseResultV1[]

Defined in: core/src/types/eval.ts:629

Case results sorted by id


costUsd?

optional costUsd?: number

Defined in: core/src/types/eval.ts:623

Cost of the entry in USD.

Minimum

0


judgeAgreement?

optional judgeAgreement?: EvalJudgeAgreementV1[]

Defined in: core/src/types/eval.ts:627

Agreement with human labels per judge assertion, in assertion order


latencyMs

latencyMs: EvalLatencyV1

Defined in: core/src/types/eval.ts:625

Latency percentiles of the entry


passRate

passRate: number

Defined in: core/src/types/eval.ts:616

Passed cases over all cases.

Minimum

0

Maximum

1


provider

provider: string

Defined in: core/src/types/eval.ts:608

Provider name


ref

ref: string

Defined in: core/src/types/eval.ts:606

Model reference as written


usage

usage: EvalUsageV1

Defined in: core/src/types/eval.ts:618

Calls and tokens of the entry