EvalDatasetRowV1
Defined in: core/src/types/eval.ts:13
One row of an eval dataset, version 1: a JSONL line, a YAML item or a CSV row.
Properties
expected?
optionalexpected?:string|Record<string,EvalExpectedValue>
Defined in: core/src/types/eval.ts:28
Golden answer: the whole response text, or the expected output properties when the prompt has an output contract. A partial object is allowed.
id?
optionalid?:string
Defined in: core/src/types/eval.ts:20
Row id, unique in the dataset. Absent ids default to row-<n>,
counted from 1 in file order.
Pattern
^[A-Za-z0-9][A-Za-z0-9_.-]{0,63}$
Example
"late-delivery"inputs
inputs:
Record<string,EvalInputValue>
Defined in: core/src/types/eval.ts:22
Prompt input values by input name
tags?
optionaltags?:string[]
Defined in: core/src/types/eval.ts:30
Free-form tags, for filtering and reporting