EvalImportSummaryV1
Defined in: core/src/types/eval-import.ts:109
Summary of prs eval import --format json: counts only, never sample values.
Properties
$schema
$schema:
"https://getpromptscript.dev/schema/eval-import-summary/v1.json"
Defined in: core/src/types/eval-import.ts:111
Schema URL, the version tag of the summary
dryRun
dryRun:
boolean
Defined in: core/src/types/eval-import.ts:119
True when nothing was written because of --dry-run
findings
findings:
EvalFindingV1[]
Defined in: core/src/types/eval-import.ts:129
Findings of the dataset security scan; they do not stop the import
out
out:
string
Defined in: core/src/types/eval-import.ts:117
Dataset path, relative to the project root
prompt
prompt:
string
Defined in: core/src/types/eval-import.ts:115
Prompt id of the suite
replacements
replacements:
EvalImportReplacementsV1
Defined in: core/src/types/eval-import.ts:127
Values replaced, by kind
skipped
skipped:
EvalImportSkippedV1
Defined in: core/src/types/eval-import.ts:125
Samples dropped, by reason
steps
steps:
EvalImportStepsV1
Defined in: core/src/types/eval-import.ts:123
Counts per step
suite
suite:
string
Defined in: core/src/types/eval-import.ts:113
Suite name
warnings
warnings:
string[]
Defined in: core/src/types/eval-import.ts:131
Warnings, such as a sample file under the project root
written
written:
boolean
Defined in: core/src/types/eval-import.ts:121
True when the dataset file was written