Class StreamingRunner

A Runner encapsulates one strategy for the LLM call → parse → execute loop.

Implements

node.common.apis.cortex.Runner

Index

Constructors

Properties

history id verbose

Methods

getOutputModule getPromptFormat run

Constructors

constructor

new StreamingRunner(options): node.common.apis.cortex.StreamingRunner
Parameters
- options: node.common.apis.cortex.StreamingRunnerOptions
Returns node.common.apis.cortex.StreamingRunner
- Defined in packages/ts_common/dist/apis/cortex/runner/streaming_v2.d.ts:79

Properties

history

history: StreamingLLMRecord[]

`Readonly`id

id: "streaming_v2" = "streaming_v2"

verbose

verbose: boolean

Methods

getOutputModule

getOutputModule(): node.common.apis.cortex.ContextModule
Returns node.common.apis.cortex.ContextModule
Implementation of Runner.getOutputModule
- Defined in packages/ts_common/dist/apis/cortex/runner/streaming_v2.d.ts:81

getPromptFormat

getPromptFormat(): node.common.apis.cortex.RunnerPromptFormat
Returns node.common.apis.cortex.RunnerPromptFormat
Implementation of Runner.getPromptFormat
- Defined in packages/ts_common/dist/apis/cortex/runner/streaming_v2.d.ts:80

run

run(ctx, maxLoops): Promise<string>
Parameters
- ctx: node.common.apis.cortex.RunnerContext
- maxLoops: number
Returns Promise<string>
Implementation of Runner.run
- Defined in packages/ts_common/dist/apis/cortex/runner/streaming_v2.d.ts:83