Interface for the indices of a new token produced by an LLM or Chat Model in streaming mode.

interface NewTokenIndices {
    completion: number;
    prompt: number;
}

Properties

Properties

completion: number
prompt: number