How to test slot-setting with rasa test?

[alexyuwen]

I am trying to set up an automated testing pipeline using the rasa test functionality. However, I noticed that the command fails to generate errors or warnings when the predicted and expected slot value differ. Is this a feature offered by Rasa?

Here is a screenshot to show how I included slot-setting in my test stories. Changing the vehicleCount slot from 1 to 999 did not trigger any warnings/errors after running rasa test.

[desmarchris (Chris Desmarais)]

hey @alexyuwen, I just tested this and indeed it seems like we are just checking for the event of setting a slot and not matching the value. I would open a feature request in our GitHub repo if this is something you think you need!