Class StreamingRunner

A Runner encapsulates one strategy for the LLM call → parse → execute loop.

Implements

common.apis.cortex.Runner

Index

Constructors

Properties

history id verbose

Methods

getOutputModule getPromptFormat run

Constructors

constructor

new StreamingRunner(options): common.apis.cortex.StreamingRunner
Parameters
- options: common.apis.cortex.StreamingRunnerOptions
Returns common.apis.cortex.StreamingRunner
- Defined in packages/ts_common/src/apis/cortex/runner/streaming_v2.ts:291

Properties

history

history: StreamingLLMRecord[] = []

`Readonly`id

id: "streaming_v2" = 'streaming_v2'

verbose

verbose: boolean

Methods

getOutputModule

getOutputModule(): common.apis.cortex.ContextModule
Returns common.apis.cortex.ContextModule
Implementation of Runner.getOutputModule
- Defined in packages/ts_common/src/apis/cortex/runner/streaming_v2.ts:304

getPromptFormat

getPromptFormat(): common.apis.cortex.RunnerPromptFormat
Returns common.apis.cortex.RunnerPromptFormat
Implementation of Runner.getPromptFormat
- Defined in packages/ts_common/src/apis/cortex/runner/streaming_v2.ts:296

run

run(ctx, maxLoops): Promise<string>
Parameters
- ctx: common.apis.cortex.RunnerContext
- maxLoops: number
Returns Promise<string>
Implementation of Runner.run
- Defined in packages/ts_common/src/apis/cortex/runner/streaming_v2.ts:318