EvalReportV1
Defined in: core/src/types/eval.ts:821
Report of one eval run, version 1. Deterministic: no timestamps, no wall-clock durations, no absolute paths, arrays sorted by suite name, model order and case id.
Properties
$schema
$schema:
"https://getpromptscript.dev/schema/eval-report/v1.json"
Defined in: core/src/types/eval.ts:826
Schema URL, the version tag of the report.
Example
"https://getpromptscript.dev/schema/eval-report/v1.json"budget?
optionalbudget?:EvalBudgetV1
Defined in: core/src/types/eval.ts:846
Budget of the run, when one applied
cache
cache:
EvalReportCacheV1
Defined in: core/src/types/eval.ts:837
Cache summary
comparison?
optionalcomparison?:EvalComparisonV1
Defined in: core/src/types/eval.ts:850
Comparison against a baseline report
costUsd?
optionalcostUsd?:number
Defined in: core/src/types/eval.ts:844
Cost of the run in USD, when every model used has a price.
Minimum
0
errors
errors:
EvalReportErrorV1[]
Defined in: core/src/types/eval.ts:852
Errors not tied to one case
outcome
outcome:
EvalOutcome
Defined in: core/src/types/eval.ts:833
Outcome of the run
passed
passed:
boolean
Defined in: core/src/types/eval.ts:835
Whether every suite passed and nothing else went wrong
suites
suites:
EvalSuiteResultV1[]
Defined in: core/src/types/eval.ts:848
Suite results sorted by name
usage
usage:
EvalUsageV1
Defined in: core/src/types/eval.ts:839
Calls and tokens of the run
version?
optionalversion?:1
Defined in: core/src/types/eval.ts:831
Format version, always 1 in reports this CLI writes. Older reports lack it; read a missing value as 1.