FullDialogueTrackerFeaturizer vs MaxHistoryTrackerFeaturizer: When to use which?


My stories are in variable lengths and scaling the bot is now starting to result in wrong action predictions. I suspect it is because of the max history parameter of my MemoizationPolicy and TEDPolicy. I have two questions:

  1. When to use FullDialogueTrackerFeaturizer and when to use MaxHistoryTrackerFeaturizer (I have been using the latter and was happy with it until I started to come up with stories of variable lengths)
  2. How to decide what max_history to set when your stories are of variable lengths? I would usually set it to the length of my lengthiest story but that seems to be causing issues in predictions for shorter stories.

I hope this makes sense. Any help/insight on this would be highly appreciated please. Thanks.