Everyone above seems to be facing this issue in different versions of Rasa. Can you post what was your version etc…
I’m Using RASA 1.4.3 , I removed and re added the intent (also in story) I was getting fallback response for and it’s working now.
I’m using Rasa 1.10.1 and i have the same problem. I also tried different rasa versions and policy orders, but nothing changes.
I have a simple story like this;
greet
- greet
- utter_greet
When i trigger the greet story for the first time, it predicts the right action. However, when i trigger it for the second time, it predicts it as fallback action.
policies:
- name: MemoizationPolicy
- name: TEDPolicy
- name: MappingPolicy
- name: FallbackPolicy
nlu_threshold: 0.3
core_threshold: 0.3
fallback_action_name: "action_default_fallback"
- name: "FormPolicy"
First trigger;
2020-06-16 15:37:12 DEBUG rasa.core.processor - Received user message 'merhaba' with intent '{'name': 'greet', 'confidence': 0.9376274943351746}'
and entities '[]'
2020-06-16 15:37:12 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 4 events.
2020-06-16 15:37:12 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, None, {}, {'intent_greet': 1.0, 'prev_action_listen'
: 1.0}]
2020-06-16 15:37:12 DEBUG rasa.core.policies.memoization - There is a memorised next action 'utter_greet'
2020-06-16 15:37:12 DEBUG rasa.core.policies.fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3).
2020-06-16 15:37:12 DEBUG rasa.core.policies.form_policy - There is no active form
2020-06-16 15:37:12 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_0_MemoizationPolicy
2020-06-16 15:37:12 DEBUG rasa.core.processor - Predicted next action 'utter_greet' with confidence 1.00.
2020-06-16 15:37:12 DEBUG rasa.core.processor - Action 'utter_greet' ended with events '[BotUttered('Merhaba, nasıl yardımcı olabilirim ?', {"elem
ents": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {}, 1592311032.2198653)]'.
2020-06-16 15:37:12 DEBUG rasa.core.policies.memoization - Current tracker state [None, None, {}, {'intent_greet': 1.0, 'prev_action_listen': 1.0}
, {'intent_greet': 1.0, 'prev_utter_greet': 1.0}]
2020-06-16 15:37:12 DEBUG rasa.core.policies.memoization - There is a memorised next action 'action_listen'
2020-06-16 15:37:12 DEBUG rasa.core.policies.mapping_policy - There is no mapped action for the predicted intent, 'greet'.
2020-06-16 15:37:12 DEBUG rasa.core.policies.fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3).
2020-06-16 15:37:12 DEBUG rasa.core.policies.form_policy - There is no active form
2020-06-16 15:37:12 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_0_MemoizationPolicy
2020-06-16 15:37:12 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-06-16 15:37:12 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-06-16 15:37:12 DEBUG rasa.core.lock_store - Deleted lock for conversation 'f5384482316c4a898808fe940815ef09'.
Second trigger;
2020-06-16 15:37:14 DEBUG rasa.core.tracker_store - Recreating tracker for id 'f5384482316c4a898808fe940815ef09'
2020-06-16 15:37:14 DEBUG rasa.core.processor - Received user message 'merhaba' with intent '{'name': 'greet', 'confidence': 0.9376274943351746}'
and entities '[]'
2020-06-16 15:37:14 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 8 events.
2020-06-16 15:37:14 DEBUG rasa.core.policies.memoization - Current tracker state [None, {}, {'intent_greet': 1.0, 'prev_action_listen': 1.0}, {'in
tent_greet': 1.0, 'prev_utter_greet': 1.0}, {'intent_greet': 1.0, 'prev_action_listen': 1.0}]
2020-06-16 15:37:14 DEBUG rasa.core.policies.memoization - There is no memorised next action
2020-06-16 15:37:14 DEBUG rasa.core.policies.fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3).
2020-06-16 15:37:14 DEBUG rasa.core.policies.form_policy - There is no active form
2020-06-16 15:37:14 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_3_FallbackPolicy
2020-06-16 15:37:14 DEBUG rasa.core.processor - Predicted next action 'action_default_fallback' with confidence 0.30.
2020-06-16 15:37:14 DEBUG rasa.core.actions.action - Calling action endpoint to run action 'action_default_fallback'.
2020-06-16 15:37:14 DEBUG rasa.core.processor - Action 'action_default_fallback' ended with events '[BotUttered('Dediğinizi anlamadım...', {"eleme
nts": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {}, 1592311034.8577676), <rasa.core.events.Use
rUtteranceReverted object at 0x7ff097251438>]'.
1 Like
I found out that this only happens in interactive mode. Shell mode works fine and predicts action_listen as it should after the bot uttered what it had to say, instead of action_default_fallback.
I’m using Rasa v1.10.14
I have the same problem as well with Rasa v1.10.10
My policies: policies:
- name: MemoizationPolicy max_history: 6
- name: TEDPolicy max_history: 6 epochs: 300
- name: MappingPolicy
- name: TwoStageFallbackPolicy nlu_threshold: 0.6 core_threshold: 0.3 fallback_core_action_name: “action_default_ask_affirmation” fallback_nlu_action_name: “action_default_ask_rephrase” deny_suggestion_intent_name: “out_of_scope”
It works well and respond correctly to the intent and right after, it throws the action_default_ask_affirmation for no reason
some logs:
2020-10-05 23:09:21 DEBUG rasa.core.processor - Predicted next action ‘action_when_temple’ with confidence 0.88. 2020-10-05 23:09:21 DEBUG rasa.core.actions.action - Calling action endpoint to run action ‘action_when_temple’. 2020-10-05 23:09:22 DEBUG rasa.core.processor - Action ‘action_when_temple’ ended with events ‘[BotUttered(‘Les horaire de l’office de l’eglise sont: …’, {“elements”: nul l, “quick_replies”: null, “buttons”: null, “attachment”: null, “image”: null, “custom”: null}, {}, 1601939362.0052254)]’.
so far so good but then…
out of the blue:
2020-10-05 23:09:22 DEBUG rasa.core.policies.memoization - There is no memorised next action 2020-10-05 23:09:22 DEBUG rasa.core.policies.mapping_policy - There is no mapped action for the predicted intent, ‘ask_when_temple’. 2020-10-05 23:09:22 DEBUG rasa.core.policies.two_stage_fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3). 2020-10-05 23:09:22 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_3_TwoStageFallbackPolicy 2020-10-05 23:09:22 DEBUG rasa.core.processor - Predicted next action ‘action_default_ask_affirmation’ with confidence 0.30. 2020-10-05 23:09:22 DEBUG rasa.core.actions.action - Calling action endpoint to run action ‘action_default_ask_affirmation’.
It is very frustrating as there is no way to put the bot in production without resolving this and I realised that people have had this problem since November 2018.
Can anyone help? from Rasa Team? or has anyone been able to identify the cause?
I am testing it using the facebook webhook
Thank you
If it still happens to anyone, I got it to work after retraining the model and changing one slot that was captured via an entity from text to unfeaturized. I am not sure if the slot change was necessary. Anyway, happy to see it working properly