Following your last suggestion, I added stories without the “greet” part. (I commited them to this branch).
I ran only the second step:
- User: I’d like to pay with card
- Bot: So you will pay in card. Forwarding you to our agent. Bye
But this is predicted with TED, not memoization policy. Here are the logs of the conversation.
2023-01-30 14:07:28 DEBUG rasa.core.lock_store - Issuing ticket for conversation '9832666c-a096-11ed-ac79-90b11ca66549'.
2023-01-30 14:07:28 DEBUG rasa.core.lock_store - Acquiring lock for conversation '9832666c-a096-11ed-ac79-90b11ca66549'.
2023-01-30 14:07:28 DEBUG rasa.core.lock_store - Acquired lock for conversation '9832666c-a096-11ed-ac79-90b11ca66549'.
2023-01-30 14:07:28 DEBUG rasa.core.tracker_store - Could not find tracker for conversation ID '9832666c-a096-11ed-ac79-90b11ca66549'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Starting a new session for conversation ID '9832666c-a096-11ed-ac79-90b11ca66549'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Policy prediction ended with events '[]'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Action 'action_session_start' ended with events '[<rasa.shared.core.events.SessionStarted object at 0x7f4b3cc0dee0>, ActionExecuted(action: action_listen, policy: None, confidence: None)]'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Current slot values:
payment_type: empty
session_started_metadata: None
2023-01-30 14:07:28 DEBUG rasa.engine.runner.dask - Running graph with inputs: {'__message__': [<rasa.core.channels.channel.UserMessage object at 0x7f4bc9f67400>]}, targets: ['run_RegexMessageHandler'] and ExecutionContext(model_id='d0c555d7fba54006b0e1f0d8209dcc21', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'nlu_message_converter' running 'NLUMessageConverter.convert_user_message'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_WhitespaceTokenizer0' running 'WhitespaceTokenizer.process'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_RegexFeaturizer1' running 'RegexFeaturizer.process'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_LexicalSyntacticFeaturizer2' running 'LexicalSyntacticFeaturizer.process'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_CountVectorsFeaturizer3' running 'CountVectorsFeaturizer.process'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_DIETClassifier4' running 'DIETClassifier.process'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_EntitySynonymMapper5' running 'EntitySynonymMapper.process'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_RegexMessageHandler' running 'RegexMessageHandler.process'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Received user message 'Pay with card' with intent '{'name': 'declare_payment_type', 'confidence': 0.9999959468841553}' and entities '[{'entity': 'payment_type', 'start': 9, 'end': 13, 'confidence_entity': 0.9969891905784607, 'value': 'card', 'extractor': 'DIETClassifier'}]'
2023-01-30 14:07:28 DEBUG rasa.core.processor - Current slot values:
payment_type: empty
session_started_metadata: None
2023-01-30 14:07:28 DEBUG rasa.core.processor - Logged UserUtterance - tracker now has 4 events.
2023-01-30 14:07:28 DEBUG rasa.core.actions.action - Validating extracted slots: payment_type
2023-01-30 14:07:28 DEBUG rasa.core.processor - Default action 'action_extract_slots' was executed, resulting in 1 events: SlotSet()
2023-01-30 14:07:28 DEBUG rasa.engine.runner.dask - Running graph with inputs: {'__tracker__': <rasa.shared.core.trackers.DialogueStateTracker object at 0x7f4b3c2ba6d0>}, targets: ['select_prediction'] and ExecutionContext(model_id='d0c555d7fba54006b0e1f0d8209dcc21', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'rule_only_data_provider' running 'RuleOnlyDataProvider.provide'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_MemoizationPolicy0' running 'MemoizationPolicy.predict_action_probabilities'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.memoization - Current tracker state:
[state 0] slots: {'payment_type': (1.0, 0.0, 0.0, 0.0)}
[state 1] user intent: declare_payment_type | user entities: ('payment_type',) | previous action name: action_listen | slots: {'payment_type': (0.0, 1.0, 0.0, 0.0)}
2023-01-30 14:07:28 DEBUG rasa.core.policies.memoization - There is no memorised next action
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_TEDPolicy1' running 'TEDPolicy.predict_action_probabilities'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ted_policy - TED predicted 'utter_repeat_payment_method' based on user intent.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'select_prediction' running 'DefaultPolicyPredictionEnsemble.combine_predictions_from_kwargs'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ensemble - Made prediction using user intent.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ensemble - Added `DefinePrevUserUtteredFeaturization(False)` event.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ensemble - Predicted next action using TEDPolicy.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Predicted next action 'utter_repeat_payment_method' with confidence 0.06.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Policy prediction ended with events '[<rasa.shared.core.events.DefinePrevUserUtteredFeaturization object at 0x7f4b604446d0>]'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Action 'utter_repeat_payment_method' ended with events '[BotUttered('So you will pay in card. Forwarding you to our agent.', {"elements": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {"utter_action": "utter_repeat_payment_method"}, 1675080448.56062)]'.
2023-01-30 14:07:28 DEBUG rasa.engine.runner.dask - Running graph with inputs: {'__tracker__': <rasa.shared.core.trackers.DialogueStateTracker object at 0x7f4b3c2ba6d0>}, targets: ['select_prediction'] and ExecutionContext(model_id='d0c555d7fba54006b0e1f0d8209dcc21', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'rule_only_data_provider' running 'RuleOnlyDataProvider.provide'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_MemoizationPolicy0' running 'MemoizationPolicy.predict_action_probabilities'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.memoization - Current tracker state:
[state 0] slots: {'payment_type': (1.0, 0.0, 0.0, 0.0)}
[state 1] user intent: declare_payment_type | user entities: ('payment_type',) | previous action name: action_listen | slots: {'payment_type': (0.0, 1.0, 0.0, 0.0)}
[state 2] user intent: declare_payment_type | user entities: ('payment_type',) | previous action name: utter_repeat_payment_method | slots: {'payment_type': (0.0, 1.0, 0.0, 0.0)}
2023-01-30 14:07:28 DEBUG rasa.core.policies.memoization - There is no memorised next action
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_TEDPolicy1' running 'TEDPolicy.predict_action_probabilities'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ted_policy - TED predicted 'utter_goodbye' based on user intent.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'select_prediction' running 'DefaultPolicyPredictionEnsemble.combine_predictions_from_kwargs'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ensemble - Predicted next action using TEDPolicy.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Predicted next action 'utter_goodbye' with confidence 0.07.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Policy prediction ended with events '[]'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Action 'utter_goodbye' ended with events '[BotUttered('Bye', {"elements": null, "quick_replies": null, "buttons": null, "attachment": null, "image": null, "custom": null}, {"utter_action": "utter_goodbye"}, 1675080448.5682297)]'.
2023-01-30 14:07:28 DEBUG rasa.engine.runner.dask - Running graph with inputs: {'__tracker__': <rasa.shared.core.trackers.DialogueStateTracker object at 0x7f4b3c2ba6d0>}, targets: ['select_prediction'] and ExecutionContext(model_id='d0c555d7fba54006b0e1f0d8209dcc21', should_add_diagnostic_data=False, is_finetuning=False, node_name=None).
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'rule_only_data_provider' running 'RuleOnlyDataProvider.provide'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'domain_provider' running 'DomainProvider.provide_inference'.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_MemoizationPolicy0' running 'MemoizationPolicy.predict_action_probabilities'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.memoization - Current tracker state:
[state 0] slots: {'payment_type': (1.0, 0.0, 0.0, 0.0)}
[state 1] user intent: declare_payment_type | user entities: ('payment_type',) | previous action name: action_listen | slots: {'payment_type': (0.0, 1.0, 0.0, 0.0)}
[state 2] user intent: declare_payment_type | user entities: ('payment_type',) | previous action name: utter_repeat_payment_method | slots: {'payment_type': (0.0, 1.0, 0.0, 0.0)}
[state 3] user intent: declare_payment_type | user entities: ('payment_type',) | previous action name: utter_goodbye | slots: {'payment_type': (0.0, 1.0, 0.0, 0.0)}
2023-01-30 14:07:28 DEBUG rasa.core.policies.memoization - There is no memorised next action
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'run_TEDPolicy1' running 'TEDPolicy.predict_action_probabilities'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ted_policy - TED predicted 'action_listen' based on user intent.
2023-01-30 14:07:28 DEBUG rasa.engine.graph - Node 'select_prediction' running 'DefaultPolicyPredictionEnsemble.combine_predictions_from_kwargs'.
2023-01-30 14:07:28 DEBUG rasa.core.policies.ensemble - Predicted next action using TEDPolicy.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Predicted next action 'action_listen' with confidence 0.07.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Policy prediction ended with events '[]'.
2023-01-30 14:07:28 DEBUG rasa.core.processor - Action 'action_listen' ended with events '[]'.
2023-01-30 14:07:28 DEBUG rasa.core.lock_store - Deleted lock for conversation '9832666c-a096-11ed-ac79-90b11ca66549'.