End-to-end testing that calls custom actions

Rasa Open Source
1

Hello.

I would like to be able to run “rasa test”, but in such a way that it calls my custom actions. So far, it seems that these tests simply ignore these actions / never make the RPC calls to the actions server.

I saw this thread: How do I test my custom actions? - #11 by stephens, but the solution given in it is worthless for me, as I’m not interested in testing the action in isolation, I want to see it used in the conversation it’s designed to work with.

Thank you.

2

As you pointed out, this isn’t supported via rasa test. I wrote a recent blog post on an approach to end to end testing including actions using Postman.

1 Like
3

Hello Greg! Is there a way to combine these postman tests with a custom tracker json?

4

Since I wrote that post, I’ve switched testing to use pytest. There’s a good example in the financial-demo here and it includes loading the tracker in various states.