Hi @YoungXu06, are you testing 400 requests per second? one rasa server can typically handle up to 20 requests per second, if you need more than that, you need to increase the number of rasa servers running. I can’t imagine you need to be able to handle 400 requests per second though.
1 Like