ModelParams
Defined in: core/src/types/prompts.ts:36
Invocation parameters of a model.
Properties
maxTokens?
optionalmaxTokens?:number
Defined in: core/src/types/prompts.ts:52
Maximum number of tokens to generate.
As Type
integer
Minimum
1
seed?
optionalseed?:number
Defined in: core/src/types/prompts.ts:61
Sampling seed, at most 2^53-1.
As Type
integer
Minimum
0
Maximum
9007199254740991
stop?
optionalstop?:string[]
Defined in: core/src/types/prompts.ts:54
Stop sequences, in authored order
temperature?
optionaltemperature?:number
Defined in: core/src/types/prompts.ts:38
Sampling temperature
topK?
optionaltopK?:number
Defined in: core/src/types/prompts.ts:46
Top-k sampling cutoff.
As Type
integer
Minimum
1
topP?
optionaltopP?:number
Defined in: core/src/types/prompts.ts:40
Nucleus sampling threshold