I currently have a Rasa bot that has a lot of categorical slots set automatically throughout conversation. For example, I have a
topic categorical slot that captures the user’s currently selected topic, or more straightforward
user_profile_update_needed boolean slot.
There’s a large number of these kinds of slots and I’m starting to run into issues where the bot loses accuracy in responses, I’m guessing in large part because it’s starting to encounter conversations that didn’t have those slots set. I’m currently using the
AugmentedMemoizationPolicy to leverage the “forgetting” mechanism to help handle longer form conversations, but I feel as though the slots are starting to take a larger role as the reason for the bot losing accuracy over time chatting with the bot.
That being said, I’m still on rasa 1.10.7 and on the KerasPolicy, so it could simply be a matter of using a difference ML policy or increasing data augmentation.
Any general tips/thoughts?