Hi! Currently the number of tokens increases with each message since the whole conversation history adds up to the prompt of command generator. I think making it possible to somehow control how many messages actually will be sent is crucial to control tokens. Or maybe I did not see something in docs and it is already possible? Currently this value is hardcoded to 20, as far as I understood the source code.
Nope, you did not miss anything in the docs. It isn’t possible without creating your own custom command generator and modifying the method that transforms the tracker into the conversation: tracker_as_readable_transcript