I am currently deploying one Rasa instance in a productive environment. But how many concurrent users can be handled by a single Rasa instance? and I am expecting more then 1000 concurrent users

[skydheere (imran sky)]

I am currently deploying one Rasa instance in a productive environment. But how many concurrent users can be handled by a single Rasa instance? and I am expecting more then 1000 concurrent users.

[mloubser (Melinda Loubser)]

A single rasa OSS node can handle up to 20 transactions per second, which equates to ~250 concurrent users, if you assume each user sends a message every 12 seconds or so. If your users don’t behave that way, your case could be different.

What do you mean by “concurrent users” in this case? 1000 is quite high in general.

[chensaics]

@mloubser

A single rasa OSS node can handle up to 20 transactions per second

May I know what are the probable OSS envs parameters ( to get the 20 TPS per rasa node)?