My stories are in variable lengths and scaling the bot is now starting to result in wrong action predictions. I suspect it is because of the max history parameter of my MemoizationPolicy and TEDPolicy. I have two questions:
- When to use FullDialogueTrackerFeaturizer and when to use MaxHistoryTrackerFeaturizer (I have been using the latter and was happy with it until I started to come up with stories of variable lengths)
- How to decide what max_history to set when your stories are of variable lengths? I would usually set it to the length of my lengthiest story but that seems to be causing issues in predictions for shorter stories.
I hope this makes sense. Any help/insight on this would be highly appreciated please. Thanks.