# Response Selector Fallback Mechanism

**URL:** <https://forum.rasa.com/t/response-selector-fallback-mechanism/57793>\
**Category:** Rasa Open Source\
**Created:** [March 30, 2023, 6:06pm UTC](https://forum.rasa.com/t/response-selector-fallback-mechanism/57793 "2023-03-30T18:06:11Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![aLoneStrider](https://avatars.discourse-cdn.com/v4/letter/a/2bfe46/32.png) [@aLoneStrider](https://forum.rasa.com/u/aLoneStrider)\
**Post date:** [March 30, 2023, 6:06pm UTC](https://forum.rasa.com/t/response-selector-fallback-mechanism/57793/1 "2023-03-30T18:06:11Z")

</div>

I’ve used the response selector for handling my FAQs. There are a couple of issues with that, one is about not being able to trigger the Fallback classifier or policy for the response selector and also there is no way to consider any threshold for the retrieval intent class to trigger any fallback.

The intent classifier finds FAQ with quite very high confidence even for distinctive queries.

---

<div class="post-metadata">

**Author:** ![sanjaradylov](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sanjaradylov/32/21532_2.png) [@sanjaradylov](https://forum.rasa.com/u/sanjaradylov)\
**Post date:** [April 2, 2023, 7:04am UTC](https://forum.rasa.com/t/response-selector-fallback-mechanism/57793/2 "2023-04-02T07:04:30Z")

</div>

@aLoneStrider First, I believe your [`ResponseSelector`](https://rasa.com/docs/rasa/components#responseselector) overfits if it misclassifies w/ high confidence. Therefore, you should probably tweak such hyperparameters as `drop_rate`, `connection_density`, and maybe couple of others to control model complexity. If it doesn’t help, it makes sense to double-check your NLU data for mislabeling and/or intent confusion. Also, you might want to save model checkpoints and evaluate response accuracy on validation set to further select the best model via `checkpoint_model`, `evaluate_every_number_of_epochs`, `evaluate_on_number_of_examples`, and `tensorboard_log_directory`.

* * *

As for fallback for retrieval intents, if reimplementing `ResponseSelector` is not an option, one (but possibly not idiomatic) way to monitor responses is to implement a custom action for FAQ and replace `utter_faq` w/ this action in the corresponding rule. This action should retrieve response metadata from user events and follow up a fallback action if fallback conditions are met.

P.S. Maybe a [custom meta-learner](https://rasa.com/docs/rasa/custom-graph-components#nlu-meta-learners) can help as well? 🤔

---

<div class="post-metadata">

**Author:** ![stevediaz](https://avatars.discourse-cdn.com/v4/letter/s/eada6e/32.png) [@stevediaz](https://forum.rasa.com/u/stevediaz)\
**Post date:** [October 6, 2023, 3:54pm UTC](https://forum.rasa.com/t/response-selector-fallback-mechanism/57793/3 "2023-10-06T15:54:38Z")

</div>

The response selector has limitations, including the inability to trigger the Fallback classifier and the lack of a threshold for retrieval intent class confidence. These limitations can lead to high-confidence matches for queries. Consider exploring alternatives and reaching out to platform support for possible solutions.