EvalImportSkippedV1
Defined in: core/src/types/eval-import.ts:72
Samples dropped, by reason.
Properties
duplicate
duplicate:
number
Defined in: core/src/types/eval-import.ts:94
Same scrubbed inputs as an earlier sample
filteredLabel
filteredLabel:
number
Defined in: core/src/types/eval-import.ts:82
The feedback label is not one of --label or absent
filteredScore
filteredScore:
number
Defined in: core/src/types/eval-import.ts:80
The feedback score is above --max-score or absent
inputMismatch
inputMismatch:
number
Defined in: core/src/types/eval-import.ts:86
An input has another type, or a required input is missing
invalidJson
invalidJson:
number
Defined in: core/src/types/eval-import.ts:74
The line is not JSON
invalidSample
invalidSample:
number
Defined in: core/src/types/eval-import.ts:76
The line breaks the sample schema or a size limit, before or after the scrub
numericPii
numericPii:
number
Defined in: core/src/types/eval-import.ts:90
A number input has 13 or more digits, so it could be a card number, and it cannot be replaced without changing its type
obfuscatedPii
obfuscatedPii:
number
Defined in: core/src/types/eval-import.ts:92
A value hides personal data with zero-width characters, fullwidth forms or dots
otherPrompt
otherPrompt:
number
Defined in: core/src/types/eval-import.ts:78
The sample is of another prompt
sampledOut
sampledOut:
number
Defined in: core/src/types/eval-import.ts:96
Left out by sampling down to --max-rows
staleContract
staleContract:
number
Defined in: core/src/types/eval-import.ts:88
The sample fits the bundle of its hash but not the current prompt, so a run would refuse the row
undeclaredInput
undeclaredInput:
number
Defined in: core/src/types/eval-import.ts:84
An input the prompt does not declare