I’ve got a Rasa bot using 1.10.2, source here: GitHub - praekeltfoundation/healthcheckbot , that I’m having some difficulties scaling.
We’re using PostgreSQL for our tracker store, and Redis for our lock store, and a custom connector (GitHub - praekeltfoundation/turn-rasa-connector: A Rasa Connector for https://www.turn.io/), although we get the same performance using the Rest connector, so I don’t think that’s where the performance issue is.
While doing some benchmarking, with our bot we are only able to process 10msgs/s per instance, with that instance at 100% CPU usage. The actions server, postgresql, and redis usage remains low during the benchmarking.
Is this the kind of performance to expect, or are there ways that we can improve the performance of the bot? It seems very slow, and it will be very expensive to scale up this bot to production levels if we’re only getting 10msgs/s per cpu.