How to get the json report when stories are tested?

I am using rasa test core --stories to test the stories and make sure that rasa core model picks the correct response. I get the corresponding results in the form of confusion matrix and failed_stories.md. However, to test the stories in CI/CD I need to get the results in json format which includes the precision, accuracy, and f1_score. Could you please advise me how to do that?

Hi @amineshghi. Right now, that is not possible. However, there is an open issue for someone to contribute this to Rasa Open Source that you could take on :rasasuperhero:

Hi @tyd . Thanks for your response! Would love to contribute :slight_smile:

@amineshghi Awesome! From what I understand, it would not be too difficult to make it output the json. If you need any help, let me know in the issue :slight_smile: