I want to evaluate my stories against an already trained model, without evaluating the NLU part.
For this, I am using the HTTP API, with e2e=false. My test stories contains only intents that are in the domain file (actually, I am using exactly one of the stories that was used to train the model).
My test story looks like:
When I evaluate the story against the trained model I get low accurracy and the following warning:
WARNING rasa_core.training.dsl - Found unknown intent ‘None’ on line 3. Please, make sure that all intents are listed in your domain yaml.
WARNING rasa_core.training.dsl - Found unknown intent ‘None’ on line 5. Please, make sure that all intents are listed in your domain yaml.
However, if I perform and end to end evaluation (e2e=true), using a story that looks like this:
I get 1 of accuracy and no warnings.
It seems like in e2e=false mode, RASA is trying to perform NLU evaluation too.
Could anyone help me with this issue? Thank you in advance.
I am using RASA CORE 0.14.5