I have a company and I want to run 10 chatbots which have different models(say one for a hotel, other for a gym and another a weather bot, and so on) at a time which interacts using Rasa using REST APIs, after searching for a lot I was able to find these docs Using Rasa NLU as a HTTP server — Rasa NLU 0.12.0 documentation which solves my problem very well but after further research, I came to know that projects have been removed from RASA and was able to find two solutions,
- Run each bot on a separate port which I think can slow down the server
- Load and unload model each time a request is made which will make the responses very slow
I wanted to have a solution where I could run my server on one port and route my requests to various models somehow, there are many questions asking the same problem but nowhere I could find a straight forward answer to the problem so please let me know if it is possible or not? Thanks in advance and please let me know if any more info is required.