In this example, the user affirms the rephrased intent but rasa keeps on asking for affirmation even when the user says “yes”. I expected the conversation to continue because as per the documentation:
If the user affirms the intent, the story continues as if the user had this intent from the beginning.
This is what the logs look like if I enabled debugging:
@Juste Testing just the NLU model, the performance is acceptable when inputs are similar to the training data.
So, I should add more stories like ## happy path no relevant audience so that the Core model knows to predict -utter_ask_relevant_audience if the intent is recommend_session with confidence higher than 0.30 (the default for core_threshold when TwoStageFallbackPolicy is used)?
I would suggest first improving the NLU model so that it learns to generalise better. So try adding more NLU examples first, test the performance and once it gets better in predicting inputs that are not in your training data, focus on stories.
Hey @hsm207. To really tell I should see the files of your project and try to reproduce. Also, I can see that your NLU threshold is 0.8 which is very high for a fallback. Did you test it on a lower number for example 0.3?
Setting the NLU threshold to 0.30 also works most of the time.
This project isn’t something for production. It’s actually for a talk about rasa I plan to give so the data is deliberately kept small, like in the strata workshop you gave recently. I’m planning to go through the main features that make it easy to develop chatbots using rasa and just want to be sure if a feature does not work as intended, it really is due to lack of training data and not a bug in the code.