Running multiple models concurrently

[Deprecated] Rasa X Community Edition
1

Hi,

Is it possible to run multiple models per instance of rasa X? If not, what are the suggested possible alternatives am I able to do if I wish to run multiple models with multiple traffic through lets say AWS?

Thank you.

2

Hi @jklion, it’s not possible to run multiple models at the same time in Rasa X. You could run multiple Rasa servers that serve different models in AWS, but you won’t be able to integrate that with Rasa X. If that’s an option for you, you would have to route traffic to the different servers based on some rules: one option would be NGINX as a reverse proxy, or the AWS listener rules.

3

Thanks for the suggestions. AWS load balancing seems to be a viable option for my case to handle multiple EC2 instances to handle each model. Excited to make progress from here!