Action_default_fallback always prompted when threshold is high

Rasa Open Source
1 
  name: RulePolicy
  # Confidence threshold for the `core_fallback_action_name` to apply.
  # The action will apply if no other action was predicted with
  # a confidence >= core_fallback_threshold
  core_fallback_threshold: 0.4
  core_fallback_action_name: "action_default_fallback"
  enable_fallback_prediction: True

this code is added on config.yml and also added utter_default on domain but when input ‘hi’ and it will utter_default

Bot loaded. Type a message and press enter (use '/stop' to exit): 
Your input ->  hi                                                                                                                                                                         
2021-02-26 18:48:23 DEBUG    rasa.core.lock_store  - Issuing ticket for conversation '6a25f96bb4454c55931325435d60e81a'.
2021-02-26 18:48:23 DEBUG    rasa.core.lock_store  - Acquiring lock for conversation '6a25f96bb4454c55931325435d60e81a'.
2021-02-26 18:48:23 DEBUG    rasa.core.lock_store  - Acquired lock for conversation '6a25f96bb4454c55931325435d60e81a'.
2021-02-26 18:48:23 DEBUG    rasa.core.tracker_store  - Could not find tracker for conversation ID '6a25f96bb4454c55931325435d60e81a'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Starting a new session for conversation ID '6a25f96bb4454c55931325435d60e81a'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Policy prediction ended with events '[]'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Action 'action_session_start' ended with events '[<rasa.shared.core.events.SessionStarted object at 0x000001EB8B320040>, ActionExecuted
(action: action_listen, policy: None, confidence: None)]'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Current slot values:
    session_started_metadata: None
2021-02-26 18:48:23 DEBUG    rasa.nlu.classifiers.diet_classifier  - There is no trained model for 'ResponseSelector': The component is either not trained or didn't receive enough trainin
g data.
2021-02-26 18:48:23 DEBUG    rasa.nlu.selectors.response_selector  - Adding following selector key to message property: default
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Received user message 'hi' with intent '{'id': 995633633340863135, 'name': 'greet', 'confidence': 0.8928335905075073}' and entities '[]
'
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Logged UserUtterance - tracker now has 4 events.
2021-02-26 18:48:23 DEBUG    rasa.core.policies.rule_policy  - Current tracker state:
[state 1] user text: hi | previous action name: action_listen
2021-02-26 18:48:23 DEBUG    rasa.core.policies.rule_policy  - There is no applicable rule.
2021-02-26 18:48:23 DEBUG    rasa.core.policies.rule_policy  - Current tracker state:
[state 1] user intent: greet | previous action name: action_listen
2021-02-26 18:48:23 DEBUG    rasa.core.policies.rule_policy  - There is no applicable rule.
2021-02-26 18:48:23 DEBUG    rasa.core.policies.ensemble  - Made prediction using user intent.
2021-02-26 18:48:23 DEBUG    rasa.core.policies.ensemble  - Added `DefinePrevUserUtteredFeaturization(False)` event.
2021-02-26 18:48:23 DEBUG    rasa.core.policies.ensemble  - Predicted next action using policy_0_RulePolicy.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Predicted next action 'action_default_fallback' with confidence 0.40.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Policy prediction ended with events '[<rasa.shared.core.events.DefinePrevUserUtteredFeaturization object at 0x000001EB8B15D2B0>]'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Action 'action_default_fallback' ended with events '[BotUttered('Sorry I didn't get that. Can you rephrase?', {"elements": null, "quick
_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {"template_name": "utter_default"}, 1614336503.4973545), <rasa.shared.core.events.UserUtteranceRevert
ed object at 0x000001EB8B312670>]'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Current slot values:
    session_started_metadata: None
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Predicted next action 'action_listen' with confidence 1.00.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Policy prediction ended with events '[]'.
2021-02-26 18:48:23 DEBUG    rasa.core.processor  - Action 'action_listen' ended with events '[]'.
2021-02-26 18:48:23 DEBUG    rasa.core.lock_store  - Deleted lock for conversation '6a25f96bb4454c55931325435d60e81a'.
Sorry I didn't get that. Can you rephrase?
2

Is there any reason for this to occur ? as before this it works fine

3
  • name: TEDPolicy max_history: 5 epochs: 100 constrain_similarities: true model_confidence : linear_norm

added this on policy solve the issue

4

its not working for me

5

I have the same problem.

policies:
  - name: MemoizationPolicy
    max_history: 5
    priority: 3
  - name: TEDPolicy
    model_confidence: linear_norm
    constrain_similarities: True
    max_history: 5
    epochs: 100
    batch_size:
    - 32
    - 64
  - name: RulePolicy
    core_fallback_threshold: 0.3
    core_fallback_action_name: "action_default_fallback"
    enable_fallback_prediction: True

action_default_fallback almost always triggered for conversations for which it should not be triggered (have stories for them in the training data).

6

@ftarlaci Delete all the older versions and re-train and try.

7

thank you. Have already done that and having the same issue.

8

@ftarlaci Any example if you can share? I mean bot/user conversation.