Skip to content

planEval()

PromptScript API


planEval(options): Promise<EvalPlan>

Defined in: eval/src/run.ts:1120

Plan a run without calling anything: the same checks as runEval, the cache lookups, and the worst-case cost of every miss. It creates no provider, so it needs no key and announces no host. It needs no budget: without one the worst case is still estimated, from the prices, and checked against nothing.

Parameters

options

RunEvalOptions

The options a run would get

Returns

Promise<EvalPlan>

Hits, misses, calls and worst-case cost per suite and model entry