I am using rasa test core --stories
to test the stories and make sure that rasa core model picks the correct response. I get the corresponding results in the form of confusion matrix and failed_stories.md. However, to test the stories in CI/CD I need to get the results in json format which includes the precision, accuracy, and f1_score. Could you please advise me how to do that?
Hi @amineshghi. Right now, that is not possible. However, there is an open issue for someone to contribute this to Rasa Open Source that you could take on
@amineshghi Awesome! From what I understand, it would not be too difficult to make it output the json. If you need any help, let me know in the issue