I run into scaling issue recently with my chatbot which uses Rasa stack. I found out that Rasa-core started to slow down during my load test. I tested against it by spawning 100 users constantly interact with my chatbot through a socketio channel. I noticed it spent a lot of time on saving and retrieving data from the Redis tracker store. Most of the transactions took more than 500ms to be completed during my test. I understand that I can get a better result by scaling up more chatbot instances but 100 users seem like a fairly low traffic to me. I had also gevent monkey-patch my rasa-core instance to allow non-blocking calls but it still takes a long time to process those Redis calls. I am not sure if Rasa-core or Redis is the bottleneck here. If someone has some ideas on optimizing it, that would be helpful for me. Thanks in advance!

Rasa core performance issues

ricwo (ricwo) May 14, 2019, 10:05am 2

@ggbond when you spawned your 100 users, at what rate do these users send messages?

I am not sure if Rasa-core or Redis is the bottleneck here.

Can you try switching to the in-memory tracker store and compare performance?

Is there any suggestion for optimize socket response time

Topic		Replies	Views
Rasa performance for increasingly large trackers Rasa Open Source	4	1980	July 18, 2019
Tracker Store slows down the bot processing Rasa Open Source	7	949	March 17, 2021
RASAperformance for increasingly large trackers Rasa Open Source	1	645	June 19, 2019
Rasa response time degradation Rasa Open Source	5	772	September 17, 2019
Share tracker between two servers Rasa Open Source	6	911	October 23, 2018