Action_default_fallback often predicted as next action after correct action was predicted

Rasa Open Source
4

@souvikg10 ran into this situation again right now, which should be this very obvious story:

  • smalltalk.greetings.hello
    • utter_smalltalk.greetings.hello

But again, after the utter action, the bot also executed the default_fallback_action. Here’s the log:

rasa-core_1      | 2018-11-18 19:03:00 DEBUG    rasa_core.processor  - Received user message 'Hi' with intent '{u'confidence': 0.9146153926849365, u'name': u'smalltalk.greetings.hello'}' and entities '[]'
rasa-core_1      | 2018-11-18 19:03:00 DEBUG    rasa_core.processor  - Logged UserUtterance - tracker now has 2 events
rasa-core_1      | 2018-11-18 19:03:00 DEBUG    rasa_core.processor  - Current slot values: 
...
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.memoization  - Current tracker state [None, None, None, {u'slot_auth.authenticated_0': 1.0}, {u'intent_smalltalk.greetings.hello': 1.0, u'prev_action_listen': 1.0, u'slot_auth.authenticated_0': 1.0}]
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.memoization  - There is a memorised next action '38'
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.form_policy  - There is no active form
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_MemoizationPolicy
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.processor  - Predicted next action 'utter_smalltalk.greetings.hello' with prob 1.00.
rasa-core_1      | 2018-11-18 19:03:01 INFO     rasa_core.channels.facebook  - Sending message: Hallo!
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.processor  - Action 'utter_smalltalk.greetings.hello' ended with events '[]'
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: Hallo!, data: {
rasa-core_1      |   "buttons": null, 
rasa-core_1      |   "elements": null, 
rasa-core_1      |   "attachment": null
rasa-core_1      | })'
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.memoization  - Current tracker state [None, None, {u'slot_auth.authenticated_0': 1.0}, {u'intent_smalltalk.greetings.hello': 1.0, u'prev_action_listen': 1.0, u'slot_auth.authenticated_0': 1.0}, {u'intent_smalltalk.greetings.hello': 1.0, u'prev_utter_smalltalk.greetings.hello': 1.0, u'slot_auth.authenticated_0': 1.0}]
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.form_policy  - There is no active form
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_2_FallbackPolicy
rasa-core_1      | 2018-11-18 19:03:01 DEBUG    rasa_core.processor  - Predicted next action 'action_default_fallback' with prob 1.00.

My policies.yml looks like this:

policies:
  - name: "KerasPolicy"
    featurizer:
    - name: MaxHistoryTrackerFeaturizer
      max_history: 5
      state_featurizer:
      - name: BinarySingleStateFeaturizer
    epochs: 50
  - name: "MemoizationPolicy"
    max_history: 5
  - name: "FallbackPolicy"
    nlu_threshold: 0.7
    core_threshold: 0.7
    fallback_action_name: "action_default_fallback"
  - name: "FormPolicy"

What I just realized is that the KerasPolicy doesn’t show up anymore (in the log). Is that normal? I think since I added the FormPolicy, I don’t get the Keras predictions for the ensemble. Does that make any sense?

1 Like