Skip to content

checkDatasetRow()

PromptScript API


checkDatasetRow(record, context): EvalFinding[]

Defined in: eval/src/dataset/check.ts:73

Check one dataset row against the prompt contract and the suite: no undeclared inputs, an expected value that fits the output contract, and an expected value for every equals assertion without its own value. Messages name the row id and keys, never values.

Parameters

record

DatasetRecord

Row read by readDataset

context

DatasetCheckContext

Dataset path, prompt contract and suite assertions

Returns

EvalFinding[]

Error findings; empty when the row is fine