Restaurant bot ask for update but doesn't stop to listen to user message until 10 actions predicted

I run the restaurant bot(unmodified from git) in pyCharm(2018.3.2) with command: python -m rasa_core.run --nlu models/nlu/default/current --core models/dialogue --endpoints endpoints.yml --debug

After bot asked for location and the user replied to it, the bot entered a loop and didn’t give a chance to let user reply, Here is the debug log:

/home/al/rasa_env/lib/python3.4/importlib/_bootstrap.py:321: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  return f(*args, **kwds)
2019-01-01 16:25:18 INFO     root  - Rasa process starting
2019-01-01 16:25:20 INFO     rasa_nlu.components  - Added 'nlp_spacy' to component cache. Key 'nlp_spacy-en'.
2019-01-01 16:25:20 WARNING  py.warnings  - /home/al/rasa_env/lib/python3.4/site-packages/pykwalify/core.py:99: UnsafeLoaderWarning: 
The default 'Loader' for 'load(stream)' without further arguments can be unsafe.
Use 'load(stream, Loader=ruamel.yaml.Loader)' explicitly if that is OK.
Alternatively include the following in your code:

  import warnings
  warnings.simplefilter('ignore', ruamel.yaml.error.UnsafeLoaderWarning)

In most other cases you should consider using 'safe_load(stream)'
  data = yaml.load(stream)

2019-01-01 16:25:28 DEBUG    rasa_core.utils  - Available web server routes: 
Bot loaded. Type a message and press enter (use '/stop' to exit): 
static                                             OPTIONS, GET, HEAD             /static/[filename]
custom_webhook_CmdlineInput.health                 OPTIONS, GET, HEAD             /webhooks/rest/
custom_webhook_CmdlineInput.receive                OPTIONS, POST                  /webhooks/rest/webhook
2019-01-01 16:25:28 INFO     root  - Rasa Core server is up and running on http://localhost:5005
hi
2019-01-01 16:25:49 DEBUG    rasa_core.tracker_store  - Creating a new tracker for id 'default'.
2019-01-01 16:25:49 WARNING  py.warnings  - /home/al/rasa_env/lib/python3.4/site-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
  if diff:

2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Received user message 'hi' with intent '{'name': 'greet', 'confidence': 0.8131641218280545}' and entities '[]'
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Logged UserUtterance - tracker now has 2 events
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Current slot values: 
	info: None
	price: None
	location: None
	people: None
	cuisine: None
	matches: None
2019-01-01 16:25:49 DEBUG    rasa_core.policies.memoization  - Current tracker state [None, {}, {'prev_action_listen': 1.0, 'intent_greet': 1.0}]
2019-01-01 16:25:49 DEBUG    rasa_core.policies.memoization  - There is a memorised next action '14'
2019-01-01 16:25:49 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_0_MemoizationPolicy
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_howcanhelp' with prob 1.00.
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Action 'utter_ask_howcanhelp' ended with events '[]'
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: how can I help you?, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:25:49 DEBUG    rasa_core.policies.memoization  - Current tracker state [{}, {'prev_action_listen': 1.0, 'intent_greet': 1.0}, {'prev_utter_ask_howcanhelp': 1.0, 'intent_greet': 1.0}]
2019-01-01 16:25:49 DEBUG    rasa_core.policies.memoization  - There is a memorised next action '0'
how can I help you?
2019-01-01 16:25:49 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_0_MemoizationPolicy
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Predicted next action 'action_listen' with prob 1.00.
2019-01-01 16:25:49 DEBUG    rasa_core.processor  - Action 'action_listen' ended with events '[]'
127.0.0.1 - - [2019-01-01 16:25:49] "POST /webhooks/rest/webhook?stream=true&token= HTTP/1.1" 200 187 0.204728
Im looking for a chinese restaurant
2019-01-01 16:27:18 DEBUG    rasa_core.tracker_store  - Recreating tracker for id 'default'
2019-01-01 16:27:18 WARNING  py.warnings  - /home/al/rasa_env/lib/python3.4/site-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
  if diff:

2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Received user message 'Im looking for a chinese restaurant' with intent '{'name': 'inform', 'confidence': 0.9927574737139633}' and entities '[{'confidence': 0.9103368686831511, 'value': 'chinese', 'start': 17, 'entity': 'cuisine', 'end': 24, 'extractor': 'ner_crf'}]'
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Logged UserUtterance - tracker now has 7 events
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Current slot values: 
	info: None
	price: None
	location: None
	people: None
	cuisine: chinese
	matches: None
2019-01-01 16:27:18 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_action_listen': 1.0, 'intent_greet': 1.0}, {'prev_utter_ask_howcanhelp': 1.0, 'intent_greet': 1.0}, {'entity_cuisine': 1.0, 'prev_action_listen': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:27:18 DEBUG    rasa_core.policies.memoization  - There is a memorised next action '19'
2019-01-01 16:27:18 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_0_MemoizationPolicy
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Predicted next action 'utter_on_it' with prob 1.00.
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Action 'utter_on_it' ended with events '[]'
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: I'm on it, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:27:18 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ask_howcanhelp': 1.0, 'intent_greet': 1.0}, {'entity_cuisine': 1.0, 'prev_action_listen': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'entity_cuisine': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0, 'prev_utter_on_it': 1.0}]
2019-01-01 16:27:18 DEBUG    rasa_core.policies.memoization  - There is a memorised next action '15'
I'm on it
where?
2019-01-01 16:27:18 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_0_MemoizationPolicy
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_location' with prob 1.00.
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Action 'utter_ask_location' ended with events '[]'
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: where?, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:27:18 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'entity_cuisine': 1.0, 'prev_action_listen': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'entity_cuisine': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0, 'prev_utter_on_it': 1.0}, {'entity_cuisine': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0, 'prev_utter_ask_location': 1.0}]
2019-01-01 16:27:18 DEBUG    rasa_core.policies.memoization  - There is a memorised next action '0'
2019-01-01 16:27:18 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_0_MemoizationPolicy
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Predicted next action 'action_listen' with prob 1.00.
2019-01-01 16:27:18 DEBUG    rasa_core.processor  - Action 'action_listen' ended with events '[]'
127.0.0.1 - - [2019-01-01 16:27:18] "POST /webhooks/rest/webhook?stream=true&token= HTTP/1.1" 200 229 0.029450
central part of the town
2019-01-01 16:31:36 DEBUG    rasa_core.tracker_store  - Recreating tracker for id 'default'
2019-01-01 16:31:36 WARNING  py.warnings  - /home/al/rasa_env/lib/python3.4/site-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty.
  if diff:

2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Received user message 'central part of the town' with intent '{'name': 'inform', 'confidence': 0.9635581259937558}' and entities '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Logged UserUtterance - tracker now has 13 events
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Current slot values: 
	info: None
	price: None
	location: None
	people: None
	cuisine: chinese
	matches: None
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'entity_cuisine': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0, 'prev_utter_on_it': 1.0}, {'entity_cuisine': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0, 'prev_utter_ask_location': 1.0}, {'prev_action_listen': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_moreupdates' with prob 0.07.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ask_moreupdates' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people., data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'entity_cuisine': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0, 'prev_utter_ask_location': 1.0}, {'prev_action_listen': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_moreupdates' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ask_moreupdates' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people., data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_action_listen': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people.
if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people.
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_moreupdates' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ask_moreupdates' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people., data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ack_dosearch' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ack_dosearch' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: ok let me see what I can find, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}]
if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people.
ok let me see what I can find
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ack_dosearch' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ack_dosearch' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: ok let me see what I can find, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
ok let me see what I can find
if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people.
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_moreupdates' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ask_moreupdates' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people., data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ack_dosearch' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ack_dosearch' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: ok let me see what I can find, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
ok let me see what I can find
if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people.
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_moreupdates' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ask_moreupdates' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people., data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ack_dosearch' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ack_dosearch' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: ok let me see what I can find, data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - Current tracker state [{'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}, {'prev_utter_ask_moreupdates': 1.0, 'intent_inform': 1.0, 'slot_cuisine_0': 1.0}, {'prev_utter_ack_dosearch': 1.0, 'slot_cuisine_0': 1.0, 'intent_inform': 1.0}]
2019-01-01 16:31:36 DEBUG    rasa_core.policies.memoization  - There is no memorised next action
2019-01-01 16:31:36 DEBUG    rasa_core.policies.ensemble  - Predicted next action using policy_1_RestaurantPolicy
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Predicted next action 'utter_ask_moreupdates' with prob 0.06.
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Action 'utter_ask_moreupdates' ended with events '[]'
2019-01-01 16:31:36 DEBUG    rasa_core.processor  - Bot utterance 'BotUttered(text: if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people., data: {
  "elements": null,
  "buttons": null,
  "attachment": null
})'
2019-01-01 16:31:36 WARNING  rasa_core.processor  - Circuit breaker tripped. Stopped predicting more actions for sender 'default'
ok let me see what I can find
127.0.0.1 - - [2019-01-01 16:31:36] "POST /webhooks/rest/webhook?stream=true&token= HTTP/1.1" 200 1562 0.053860
if you'd like to modify anything else, please tell me what. This is what I currently have: None (price: None, cuisine: chinese) for None people.```

Hey @AnDongLi. I am unable to reproduce the issue. My guess is that the bot made a mistake classifying your response to the question ‘Would you like to modify anything else?’ If you answered ‘no’ to this questions, the conversation should continue. One more questions, do you have a custom actions server running?

Yes, I do have a action server running.

A question about MemoizationPolicy, when I removed this policy for restaurant bot training and then trained the bot, the test result is really bad. So to only depends on the KerasPolicy I’d have to use much more data in story.md to train the model?

Could you tell me what IDE, Python version RASA team is using? I’m more in Java and new to Python. I’m having lots of trouble with package dependencies. Thanks.

hello