Long response time

Hello. I create small bot with some intents, rules and actions. I decide to test API, so I started rasa server with command rasa run. But bot response very slow. Average time response is 3 second. What could be the problem?

  • OS: Windows 10
  • CPU: i5 10400f
  • RAM: 16 GB
  • Bot language: Russian

Hi @ivan.dmi could you please share a few more details with me:

  • are you using a tracker store other than default? if so which one?
  • if you’re using custom actions, double-checking you’ve ran rasa run actions in a separate terminal window before rasa run command?
  • could you share a screenshot of your memory/CPU usage?

Hi @ivan.dmi I can’t read Russian, but I deduced the memory usage is quite high - is that owed to rasa? Maybe if you could troubleshoot further using Resource Monitor or looking at processes? Another suggestion is to try to train a bot in English to see if the responses still take as long, in case the initial bot language impacted prediction time.

Have you tried to use the debug mode (–debug parameter)? If you use this, you will be able to see what exactly takes so much time.

I found what the problem.

First, in endpoints.yml I used url: "http://localhost:5055/webhook" for actions endpoint, I replace to url: "http://127.0.0.1:5055/webhook". The response time become faster.

Second, I used custom NER component with pymystem3, that works not so fast. So without that component bot response faster. Thanks for help!