How interpret the test results

Rasa Open Source
1

Dear,

I’ve executed the following command:

rasa test nlu --nlu data/nlu.yml -c data/config.yml --cross-validation -f 10 --out results-nlu-runs-2

And the final result is this:

2022-04-05 15:10:08 INFO rasa.nlu.test - train Accuracy: 0.345 (0.034) 2022-04-05 15:10:08 INFO rasa.nlu.test - train F1-score: 0.311 (0.060) 2022-04-05 15:10:08 INFO rasa.nlu.test - train Precision: 0.716 (0.258) 2022-04-05 15:10:08 INFO rasa.nlu.test - test Accuracy: 0.302 (0.043) 2022-04-05 15:10:08 INFO rasa.nlu.test - test F1-score: 0.271 (0.063) 2022-04-05 15:10:08 INFO rasa.nlu.test - test Precision: 0.553 (0.294)

Is the value in the parenthesis the confidence interval? Or with value is it?

2

I’ve already discovered that the parenthesis values are the standard deviation.

1 Like