I run into scaling issue recently with my chatbot which uses Rasa stack. I found out that Rasa-core started to slow down during my load test. I tested against it by spawning 100 users constantly interact with my chatbot through a socketio channel. I noticed it spent a lot of time on saving and retrieving data from the Redis tracker store. Most of the transactions took more than 500ms to be completed during my test. I understand that I can get a better result by scaling up more chatbot instances but 100 users seem like a fairly low traffic to me. I had also gevent monkey-patch my rasa-core instance to allow non-blocking calls but it still takes a long time to process those Redis calls. I am not sure if Rasa-core or Redis is the bottleneck here. If someone has some ideas on optimizing it, that would be helpful for me. Thanks in advance!

Rasa core performance issues

ricwo (ricwo) May 14, 2019, 10:05am 2

@ggbond when you spawned your 100 users, at what rate do these users send messages?

I am not sure if Rasa-core or Redis is the bottleneck here.

Can you try switching to the in-memory tracker store and compare performance?

Is there any suggestion for optimize socket response time

Topic		Replies	Views
Rasa performance for increasingly large trackers Rasa Open Source	4	2054	July 18, 2019
Are RedisTrackerStore and RedisLockStore helpful? Rasa Open Source	5	907	August 2, 2022
Tracker Store slows down the bot processing Rasa Open Source	7	1027	March 17, 2021
RASAperformance for increasingly large trackers Rasa Open Source	1	673	June 19, 2019
Is there any suggestion for optimize socket response time Rasa Open Source	6	823	May 17, 2022