I am currently deploying one Rasa instance in a productive environment. But how many concurrent users can be handled by a single Rasa instance? and I am expecting more then 1000 concurrent users

Rasa Open Source
1

I am currently deploying one Rasa instance in a productive environment. But how many concurrent users can be handled by a single Rasa instance? and I am expecting more then 1000 concurrent users.

1 Like
2

A single rasa OSS node can handle up to 20 transactions per second, which equates to ~250 concurrent users, if you assume each user sends a message every 12 seconds or so. If your users don’t behave that way, your case could be different.

What do you mean by “concurrent users” in this case? 1000 is quite high in general.

1 Like
3

May I know what are the probable OSS envs parameters ( to get the 20 TPS per rasa node)?