Skip to content

ModelParams

PromptScript API


Defined in: core/src/types/prompts.ts:36

Invocation parameters of a model.

Properties

maxTokens?

optional maxTokens?: number

Defined in: core/src/types/prompts.ts:52

Maximum number of tokens to generate.

As Type

integer

Minimum

1


seed?

optional seed?: number

Defined in: core/src/types/prompts.ts:61

Sampling seed, at most 2^53-1.

As Type

integer

Minimum

0

Maximum

9007199254740991


stop?

optional stop?: string[]

Defined in: core/src/types/prompts.ts:54

Stop sequences, in authored order


temperature?

optional temperature?: number

Defined in: core/src/types/prompts.ts:38

Sampling temperature


topK?

optional topK?: number

Defined in: core/src/types/prompts.ts:46

Top-k sampling cutoff.

As Type

integer

Minimum

1


topP?

optional topP?: number

Defined in: core/src/types/prompts.ts:40

Nucleus sampling threshold