Skip to content

EvalImportSummaryV1

PromptScript API


Defined in: core/src/types/eval-import.ts:109

Summary of prs eval import --format json: counts only, never sample values.

Properties

$schema

$schema: "https://getpromptscript.dev/schema/eval-import-summary/v1.json"

Defined in: core/src/types/eval-import.ts:111

Schema URL, the version tag of the summary


dryRun

dryRun: boolean

Defined in: core/src/types/eval-import.ts:119

True when nothing was written because of --dry-run


findings

findings: EvalFindingV1[]

Defined in: core/src/types/eval-import.ts:129

Findings of the dataset security scan; they do not stop the import


out

out: string

Defined in: core/src/types/eval-import.ts:117

Dataset path, relative to the project root


prompt

prompt: string

Defined in: core/src/types/eval-import.ts:115

Prompt id of the suite


replacements

replacements: EvalImportReplacementsV1

Defined in: core/src/types/eval-import.ts:127

Values replaced, by kind


skipped

skipped: EvalImportSkippedV1

Defined in: core/src/types/eval-import.ts:125

Samples dropped, by reason


steps

steps: EvalImportStepsV1

Defined in: core/src/types/eval-import.ts:123

Counts per step


suite

suite: string

Defined in: core/src/types/eval-import.ts:113

Suite name


warnings

warnings: string[]

Defined in: core/src/types/eval-import.ts:131

Warnings, such as a sample file under the project root


written

written: boolean

Defined in: core/src/types/eval-import.ts:121

True when the dataset file was written