EvalRequest
Defined in: eval/src/provider.ts:10
One model call a provider makes.
Properties
apiId
apiId:
string
Defined in: eval/src/provider.ts:16
Provider API model identifier
maxOutputTokens
maxOutputTokens:
number
Defined in: eval/src/provider.ts:26
Output token cap, always set
messages
messages: readonly
PromptBundleMessage[]
Defined in: eval/src/provider.ts:20
Rendered messages, system first
modelRef
modelRef:
string
Defined in: eval/src/provider.ts:18
Model reference as written in the suite or the prompt
output?
optionaloutput?:PromptBundleOutput
Defined in: eval/src/provider.ts:24
Output contract to request as structured output
params
params:
ModelParams
Defined in: eval/src/provider.ts:22
Effective parameters
promptId
promptId:
string
Defined in: eval/src/provider.ts:12
Id of the prompt under test
provider
provider:
string
Defined in: eval/src/provider.ts:14
Provider name, such as anthropic