Gaunt Sloth Assistant - v1.0.5
    Preparing search index...

    Interface SummarizationConfig

    Configuration for summarization middleware.

    interface SummarizationConfig {
        keep?: { fraction?: number; messages?: number; tokens?: number };
        model?: BaseChatModel<
            BaseChatModelCallOptions,
            AIMessageChunk<MessageStructure>,
        >;
        summaryPrompt?: string;
        trigger?: { fraction?: number; messages?: number; tokens?: number };
    }
    Index

    Properties

    keep?: { fraction?: number; messages?: number; tokens?: number }

    How many tokens, messages, or a fraction of context to keep. Set one of:

    model?: BaseChatModel<
        BaseChatModelCallOptions,
        AIMessageChunk<MessageStructure>,
    >

    Model to use for summarization. If not provided, uses the main LLM from config.

    summaryPrompt?: string

    Custom prompt template for summarization.

    trigger?: { fraction?: number; messages?: number; tokens?: number }

    Maximum tokens before triggering summarization. Set one of: