Long response time

Rasa Open Source
1

Hello. I create small bot with some intents, rules and actions. I decide to test API, so I started rasa server with command rasa run. But bot response very slow. Average time response is 3 second. What could be the problem?

  • OS: Windows 10
  • CPU: i5 10400f
  • RAM: 16 GB
  • Bot language: Russian
2

Hi @ivan.dmi could you please share a few more details with me:

  • are you using a tracker store other than default? if so which one?
  • if you’re using custom actions, double-checking you’ve ran rasa run actions in a separate terminal window before rasa run command?
  • could you share a screenshot of your memory/CPU usage?
3
4

Hi @ivan.dmi I can’t read Russian, but I deduced the memory usage is quite high - is that owed to rasa? Maybe if you could troubleshoot further using Resource Monitor or looking at processes? Another suggestion is to try to train a bot in English to see if the responses still take as long, in case the initial bot language impacted prediction time.

5

Have you tried to use the debug mode (–debug parameter)? If you use this, you will be able to see what exactly takes so much time.

6

I found what the problem.

First, in endpoints.yml I used url: "http://localhost:5055/webhook" for actions endpoint, I replace to url: "http://127.0.0.1:5055/webhook". The response time become faster.

Second, I used custom NER component with pymystem3, that works not so fast. So without that component bot response faster. Thanks for help!

7

not working i am using rasa v3.1