Chat Memory Strategy
Evicts old messages or tokens based on the strategy.
MAX MESSAGES : Evicts old messages when reaching limit
MAX TOKENS : Evicts old messages when reaching limit
To define MAX MESSAGES value (default to 10), add this Retrieval Augmentor setting key :
historyMaxMessages
To define MAX TOKENS value (default to 3000), add this Retrieval Augmentor setting key :
historyMaxTokens
Last updated