Hi, when testing chatbot, we found tracker states failed to update properly, which resulted in incorrect action prediction. We set the max_history as 3 so that it has 3 items in tracker states. However, as the highlighted text shows, the first 2 items are the same as the first 2 items in the previous states. Details as below:
2020-07-27 12:31:05 DEBUG rasa.core.processor - Received user message '加急付款如何处理？' with intent '{'name': 'faq_reimbursement_payment_schedule', 'confidence': 0.9998854398727417}' and entities '[]'
2020-07-27 12:31:05 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 366 events.
2020-07-27 12:31:05 DEBUG rasa.core.policies.memoization - Current tracker state [{'slot_matches_0': 1.0, 'intent_faq_expense_type': 1.0, 'prev_action_listen': 1.0, 'slot_faq_intent_0': 1.0}, {'slot_matches_0': 1.0, 'intent_faq_expense_type': 1.0, 'prev_action_confirm_question': 1.0, 'slot_faq_intent_0': 1.0}, {'intent_faq_reimbursement_payment_schedule': 1.0, 'prev_action_listen': 1.0, 'slot_faq_intent_0': 1.0, 'slot_matches_0': 1.0}]
2020-07-27 12:31:05 DEBUG rasa.core.policies.memoization - There is a memorised next action 'action_confirm_question'
2020-07-27 12:31:05 DEBUG rasa.core.policies.mapping_policy - The predicted intent 'faq_reimbursement_payment_schedule' is mapped to action 'action_confirm_question' in the domain.
2020-07-27 12:31:05 DEBUG rasa.core.policies.fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3).
2020-07-27 12:31:05 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_1_AugmentedMemoizationPolicy
2020-07-27 12:31:05 DEBUG rasa.core.processor - Predicted next action 'action_confirm_question' with confidence 1.00.
2020-07-27 12:31:05 DEBUG rasa.core.actions.action - Calling action endpoint to run action 'action_confirm_question'.
2020-07-27 12:31:05 DEBUG rasa.core.processor - Action 'action_confirm_question' ended with events '[BotUttered('1. 加急付款如何处理？
2. 外币付款单据何时付款？
3. 什么时候可以收到报销付款', {"elements": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {}, 1595824265.5157053), BotUttered('以上有没有你想询问的呢？请直接回复序号吧~ 若没有可以尝试换一种方式问我哦。', {"elements": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {}, 1595824265.5157123), <rasa.core.events.SlotSet object at 0x7f920b0914a8>, <rasa.core.events.SlotSet object at 0x7f920b091f60>]'.
2020-07-27 12:31:05 DEBUG rasa.core.processor - Current slot values:
bu: None
faq_intent: faq_reimbursement_payment_schedule
feedback_value: None
matches: [1, 2, 0]
2020-07-27 12:31:05 DEBUG rasa.core.policies.memoization - Current tracker state **[{'slot_matches_0': 1.0, 'intent_faq_expense_type': 1.0, 'prev_action_confirm_question': 1.0, 'slot_faq_intent_0': 1.0}, {'intent_faq_reimbursement_payment_schedule': 1.0, 'prev_action_listen': 1.0, 'slot_faq_intent_0': 1.0, 'slot_matches_0': 1.0}, {'intent_faq_reimbursement_payment_schedule': 1.0, 'prev_action_confirm_question': 1.0, 'slot_faq_intent_0': 1.0, 'slot_matches_0': 1.0}]**
2020-07-27 12:31:05 DEBUG rasa.core.policies.memoization - There is a memorised next action 'action_listen'
2020-07-27 12:31:05 DEBUG rasa.core.policies.mapping_policy - The mapped action, 'action_confirm_question', for the intent, 'faq_reimbursement_payment_schedule', was executed last, but it was predicted by another policy, 'policy_1_AugmentedMemoizationPolicy', so MappingPolicy is not predicting any action.
2020-07-27 12:31:05 DEBUG rasa.core.policies.fallback - NLU confidence threshold met, confidence of fallback action set to core threshold (0.3).
2020-07-27 12:31:05 DEBUG rasa.core.policies.ensemble - Predicted next action using policy_1_AugmentedMemoizationPolicy
2020-07-27 12:31:05 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 1.00.
2020-07-27 12:31:05 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2020-07-27 12:31:05 DEBUG rasa.core.tracker_store - Tracker with sender_id 'test232' stored to database
2020-07-27 12:31:05 DEBUG rasa.core.lock_store - Deleted lock for conversation 'test232'.
2020-07-27 12:31:06 DEBUG rasa.core.tracker_store - Recreating tracker from sender id 'test232'
2020-07-27 12:31:06 DEBUG rasa.core.processor - Received user message '加急付款如何处理？' with intent '{'name': 'faq_reimbursement_payment_schedule', 'confidence': 0.9998854398727417}' and entities '[]'
2020-07-27 12:31:06 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 373 events.
2020-07-27 12:31:06 DEBUG rasa.core.policies.memoization - Current tracker state **[{'slot_matches_0': 1.0, 'intent_faq_expense_type': 1.0, 'prev_action_confirm_question': 1.0, 'slot_faq_intent_0': 1.0}, {'intent_faq_reimbursement_payment_schedule': 1.0, 'prev_action_listen': 1.0, 'slot_faq_intent_0': 1.0, 'slot_matches_0': 1.0}, {'intent_faq_reimbursement_payment_schedule': 1.0, 'prev_action_confirm_question': 1.0, 'slot_faq_intent_0': 1.0, 'slot_matches_0': 1.0}]**
2020-07-27 12:31:06 DEBUG rasa.core.policies.memoization - There is a memorised next action 'action_listen'
Please let me know if you have any solutions on that.