Anyone have experience with cutting down on fails of repeated intents confusing Rasa Core a lot?
For example, I have an intent, /find_services_gbv, that in my stories is only ever followed by two actions, an utter_confirm and then an utter_menu. We have half a dozen variants, in all of them, only ever this sequence, the intent never leads to anything else.
Then we run the model, and for some reason if the user repeats this phrase, by the third repetition, Core starts doing all sorts of strange things, like setting slots it shouldn’t be setting (often with spurious values), or uttering from wholly different stories.
Memorization is set at 8 or 10, augmentation at 20, on the train cross-val accuracy is 99%.
Any experience for how to basically enforce that if an intent is only ever followed by a certain action, that’s all that ever happens, not strange guessing / confusion.
Oh, Rasa core version is 0.11.12.