# Retrieval Actions and closed Doman QA

**URL:** <https://forum.rasa.com/t/retrieval-actions-and-closed-doman-qa/20417>\
**Category:** Rasa Open Source\
**Created:** [October 25, 2019, 3:22am UTC](https://forum.rasa.com/t/retrieval-actions-and-closed-doman-qa/20417 "2019-10-25T03:22:11Z")\
**Posts on this page:** 1\
**Showing post:** 11

<div class="post-metadata">

**Author:** ![maoun](https://avatars.discourse-cdn.com/v4/letter/m/f05b48/32.png) [@maoun](https://forum.rasa.com/u/maoun)\
**Post date:** [October 30, 2019, 2:42am UTC](https://forum.rasa.com/t/retrieval-actions-and-closed-doman-qa/20417/11 "2019-10-30T02:42:13Z")

</div>

Thanks Vladimir,

It is good practice to setup out\_of\_scope however, my dataset for this BERT model is really big and constantly changing so I cannot keep up.

What I ended up on doing is modifying the embedding\_response\_selector.py and adding this logic on the process function: if (rs[“ask\_faq”][‘response’][“confidence”] \< 0.7 and intent[“name”]==‘ask\_faq’): message.set(“intent”, {“name”: “ask\_faq”,“confidence”: 0.0}, add\_to\_output=False) else: ##Default Behavior self.\_set\_message\_property(message, prediction\_dict, selector\_key)

The thing is about the Response Selector if a question from the BERT model is getting asked, it is choosing always one of the questions in the Response Selector eventhough the confidence of this chosen answer is really low 0.2 but it ends up being returned as an answer because the parent intent ask\_faq is being detected with a high confidence (0.9) so that is why it is not going through the FallBack action.

Now, I did my workaround but is there a possibility in the future to add a nlu\_threshold parameter specifically for the Response Selector Component ?

Many Thanks,

---

_[View the full topic](https://forum.rasa.com/t/retrieval-actions-and-closed-doman-qa/20417)._