# How rasa handle concurrent request

**URL:** <https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802>\
**Category:** Feedback on Rasa Open Source\
**Created:** [August 12, 2021, 11:03am UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802 "2021-08-12T11:03:44Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![Richa](https://avatars.discourse-cdn.com/v4/letter/r/4bbf92/32.png) [@Richa](https://forum.rasa.com/u/Richa)\
**Post date:** [August 12, 2021, 11:03am UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802/1 "2021-08-12T11:03:44Z")

</div>

Hi All,

Please assist me in understanding about the process i.e. how rasa handle concurrent request. I have one observation wrt rasa processing speed, if we are trying to send a single request then it is taking x sec and if we are trying the same query with 50 request at same time, then ideally it should take 50x sec but it is taking much more than that.

Please find the jMeter Observation Example below :

msg : ‘hi’: Response time single request = 0.4 sec For 50 req /sec avg time = 5.5 sec max time = 10 sec

Kindly help me in gaining better understanding on how rasa actually handles concurrent request .

---

<div class="post-metadata">

**Author:** ![ChrisRahme](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/chrisrahme/32/15572_2.png) [@ChrisRahme](https://forum.rasa.com/u/ChrisRahme)\
**Post date:** [August 12, 2021, 11:08am UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802/2 "2021-08-12T11:08:58Z")

</div>

Are you using Rasa [locally](https://rasa.com/docs/rasa-x/installation-and-setup/install/local-mode) or is it deployed on a [server](https://rasa.com/docs/rasa-x/installation-and-setup/install/quick-install-script)?

---

<div class="post-metadata">

**Author:** ![Richa](https://avatars.discourse-cdn.com/v4/letter/r/4bbf92/32.png) [@Richa](https://forum.rasa.com/u/Richa)\
**Post date:** [August 12, 2021, 11:30am UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802/3 "2021-08-12T11:30:59Z")

</div>

It is deployed in a server

---

<div class="post-metadata">

**Author:** ![ChrisRahme](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/chrisrahme/32/15572_2.png) [@ChrisRahme](https://forum.rasa.com/u/ChrisRahme)\
**Post date:** [August 12, 2021, 12:00pm UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802/4 "2021-08-12T12:00:26Z")

</div>

You can increase the number of replicas for your pods, like the `rasa-x` and `rasa-production` pods.

| Service | Role |
| --- | --- |
| `rasa-x` | Running the HTTP API |
| `rasa-production` | Running a trained model, parsing intents, predicting actions |
| `rasa-worker` | Training and evaluating models |

You can learn more in the [Rasa Advanced Deployment Workshop](https://www.udemy.com/course/rasa-advanced-deployment-workshop/).

---

<div class="post-metadata">

**Author:** ![Richa](https://avatars.discourse-cdn.com/v4/letter/r/4bbf92/32.png) [@Richa](https://forum.rasa.com/u/Richa)\
**Post date:** [August 13, 2021, 3:24am UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802/5 "2021-08-13T03:24:01Z")

</div>

Please may I know how exactly rasa is processing (backend processing) the request in open source rasa framework.

---

<div class="post-metadata">

**Author:** ![Richa](https://avatars.discourse-cdn.com/v4/letter/r/4bbf92/32.png) [@Richa](https://forum.rasa.com/u/Richa)\
**Post date:** [August 18, 2021, 4:26am UTC](https://forum.rasa.com/t/how-rasa-handle-concurrent-request/46802/6 "2021-08-18T04:26:11Z")

</div>

Any updates ? Please guide me with the better understanding.