Skip to content

EvalReportV1

PromptScript API


Defined in: core/src/types/eval.ts:821

Report of one eval run, version 1. Deterministic: no timestamps, no wall-clock durations, no absolute paths, arrays sorted by suite name, model order and case id.

Properties

$schema

$schema: "https://getpromptscript.dev/schema/eval-report/v1.json"

Defined in: core/src/types/eval.ts:826

Schema URL, the version tag of the report.

Example

"https://getpromptscript.dev/schema/eval-report/v1.json"

budget?

optional budget?: EvalBudgetV1

Defined in: core/src/types/eval.ts:846

Budget of the run, when one applied


cache

cache: EvalReportCacheV1

Defined in: core/src/types/eval.ts:837

Cache summary


comparison?

optional comparison?: EvalComparisonV1

Defined in: core/src/types/eval.ts:850

Comparison against a baseline report


costUsd?

optional costUsd?: number

Defined in: core/src/types/eval.ts:844

Cost of the run in USD, when every model used has a price.

Minimum

0


errors

errors: EvalReportErrorV1[]

Defined in: core/src/types/eval.ts:852

Errors not tied to one case


outcome

outcome: EvalOutcome

Defined in: core/src/types/eval.ts:833

Outcome of the run


passed

passed: boolean

Defined in: core/src/types/eval.ts:835

Whether every suite passed and nothing else went wrong


suites

suites: EvalSuiteResultV1[]

Defined in: core/src/types/eval.ts:848

Suite results sorted by name


usage

usage: EvalUsageV1

Defined in: core/src/types/eval.ts:839

Calls and tokens of the run


version?

optional version?: 1

Defined in: core/src/types/eval.ts:831

Format version, always 1 in reports this CLI writes. Older reports lack it; read a missing value as 1.