I upgraded from the rasa 1.10.14 NLU library to 2.6.3 and ran model training on the same training data as well as using the same configuration, however the predictions I get are different (along with confidence levels).
Since we have a lot of downstream applications built on these intent predictions, we need the performance of the intent models to be similar to the rasa 1.x version.
I looked around for any documentation but could not find one. So the following questions arise:
- How has the intent model been changed across rasa 1 and rasa 2?
- How can we get the similar confidence levels from both rasa 1 and rasa 2 intent models?
- Why are these difference in confidence occurring?