EvalJudgeAgreementV1
Defined in: core/src/types/eval.ts:586
Agreement between a judge assertion and the human labels.
Properties
agreed
agreed:
number
Defined in: core/src/types/eval.ts:600
Labelled cases where the judge agreed with the label.
As Type
integer
Minimum
0
assertion
assertion:
string
Defined in: core/src/types/eval.ts:588
Judge assertion id
labelled
labelled:
number
Defined in: core/src/types/eval.ts:594
Cases with a human label.
As Type
integer
Minimum
0