@MStanwood In terms of setting up the benchmark, here is some information about how I did that: turn-rasa-connector/benchmark at develop · praekeltfoundation/turn-rasa-connector · GitHub . It will differ depending on the connector you use. You can probably simplify it by using the REST connector, if you don’t want to benchmark the performance of your connector.
In terms of profiling, I used python’s cProfile. So I ran my bot using something like:
python -m cProfile -o out.profile /path/to/venv/lib/python3.6/site-packages/rasa/__main__.py run
And then I used SnakeViz to plot the resulting profile, and investigate the results.
snakeviz out.profile