Interface CompletionOptions

interface CompletionOptions {
    abortSignal?: AbortSignal;
    skipLogits?: boolean;
    stream?: boolean;
}

abortSignal?: AbortSignal

Optional abort signal to stop the generation. This can also be used to stop during prompt processing. In this case, it will throw WllamaAbortError.

skipLogits?: boolean

When processing input prompt, we don't need to get output tokens. Only used by llama_decode() Default: false

stream?: boolean

If true, return an AsyncIterable instead of a string

Properties