How to define which test set to use in Rasa?

Rasa Open Source Feedback on Rasa Open Source
1

Hello,

I would like to test my trained model on a specific test set. How can I choose which test set to use? I’ve tried substituting the test_stories.yml and test_data.yml files, but when running rasa test the results don’t change.

What is the correct procedure of doing it?

Thank you, Tiziano

2

@stephens can you help?

3

Hi, you can run the test on the modified files with the following commands,

For nlu,

rasa test nlu --nlu test_data.yml

For stories,

rasa test core --stories test_stories.yml --out results

4

Hi @rasa_learner , thank you for the reply. I have tried, but the results don’t change if I change the test-set

5

@tiziano can you explain how you are approaching this?

Also, can you provide the results between two different test_data.yml files (even if it provides the same results)?

6

@rasa_learner I just change the test_data.yml and test_stories.yml files that are inside the folder tests and then run the command rasa test.

Also, can you provide the results between two different test_data.yml files (even if it provides the same results)?

Sure, I uploaded the results here, you can find the 2 folders inside results: CE and CE_test_PE.

Thank you for the help, Tiziano

7

Hi @tiziano, I can find two results folders but only one test set in the repository. Can you provide the second test set as well so that the respective results can be checked upon?