Long story is not going as planned with checkpoints

Rasa Open Source
1

Hello,

I’m trying to do a “long” story with checkpoints as this :

    ## story_destination
    * destination
    - utter_confirm_destination
    > check_destination

    ## story_destination_confirm
    > check_destination
    * affirm
    - utter_today_departure
    > check_today_departure

    ## story_destination_deny
    > check_destination
    * deny
    - utter_goodbye

    ## story_destination_today_affirm
    > check_today_departure
    * affirm
    - utter_today_departure_hour

    ## story_destination_today_deny
    > check_today_departure
    * deny
    - utter_goodbye

So first intent is working :

User : - I’m going to Paris

Bot : - Are you going to Paris ?

User : - Yes

Bot : - Do you want to leave today ?

User : - Yes

And here the bot displayes utter_default instead of utter_today_departure_hour and I don’t get why ?

Previous checkpoints are working but not the last one

What can I check to understand why ?

Thanks a lot,I can provide more information if needed !

2

Can you show the logs while running the bot in debug mode?

And I’m not sure if it helps, but maybe you can try to add a story

## story_destination_today
> check_today_departure
 * deny
3

172.19.0.3 - - [2019-06-13 13:00:16] “POST /webhooks/rest/webhook HTTP/1.1” 200 351 0.077839 2019-06-13 13:00:19 DEBUG rasa_core.processor - Received user message ‘/affirm’ with intent ‘{‘name’: ‘affirm’, ‘confidence’: 1.0}’ and entities ‘’ 2019-06-13 13:00:19 DEBUG rasa_core.processor - Logged UserUtterance - tracker now has 218 events 2019-06-13 13:00:19 DEBUG rasa_core.processor - Current slot values: checkin_destination: Paris checkin_time: 14h40 departure_hour: 10h00 destination: Paris errorId: None error_message: None location: None project_type: None search_tools_criteria: None solutionId: None subject: None 2019-06-13 13:00:19 DEBUG rasa_core.policies.memoization - Current tracker state [{‘slot_destination_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘entity_destination’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘intent_destination’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘entity_destination’: 1.0, ‘prev_utter_confirm_destination’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘intent_destination’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘prev_utter_today_departure’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}] 2019-06-13 13:00:19 DEBUG rasa_core.policies.memoization - There is no memorised next action 2019-06-13 13:00:19 DEBUG rasa_core.policies.form_policy - There is no active form 2019-06-13 13:00:19 DEBUG rasa_core.policies.ensemble - Predicted next action using policy_1_FallbackPolicy 2019-06-13 13:00:19 DEBUG rasa_core.processor - Predicted next action ‘action_missed_intent’ with prob 1.00. 2019-06-13 13:00:19 DEBUG rasa_core.actions.action - Calling action endpoint to run action ‘action_missed_intent’. 2019-06-13 13:00:19 DEBUG rasa_core.processor - Action ‘action_missed_intent’ ended with events ‘’ 2019-06-13 13:00:19 DEBUG rasa_core.processor - Bot utterance ‘BotUttered(text: Veuillez répéter la question je n’ai pas compris., data: { “elements”: null, “buttons”: null, “attachment”: null })’ 2019-06-13 13:00:19 DEBUG rasa_core.policies.memoization - Current tracker state [{‘slot_destination_0’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘entity_destination’: 1.0, ‘prev_utter_confirm_destination’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘intent_destination’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘prev_utter_today_departure’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘slot_destination_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}, {‘prev_action_missed_intent’: 1.0, ‘slot_destination_0’: 1.0, ‘slot_checkin_time_0’: 1.0, ‘intent_affirm’: 1.0, ‘slot_checkin_destination_0’: 1.0, ‘slot_departure_hour_0’: 1.0}] 2019-06-13 13:00:19 DEBUG rasa_core.policies.memoization - There is no memorised next action 2019-06-13 13:00:19 DEBUG rasa_core.policies.form_policy - There is no active form 2019-06-13 13:00:19 DEBUG rasa_core.policies.ensemble - Predicted next action using policy_1_FallbackPolicy 2019-06-13 13:00:19 DEBUG rasa_core.processor - Predicted next action ‘action_listen’ with prob 1.00. 2019-06-13 13:00:19 DEBUG rasa_core.processor - Action ‘action_listen’ ended with events ‘’

I already got the other intents for deny in my story didn’t paste it :confused:

4

Can’t seem to find anything shocking in the logs, except there seems to be no memorised next action.

What does your policy file look like?

5 
policies:
  - name: KerasPolicy
    epochs: 100
    max_history: 5
  - name: FallbackPolicy
    fallback_action_name: 'action_missed_intent'
    nlu_threshold: 0.55
  - name: MemoizationPolicy
    max_history: 5
  - name: FormPolicy

Yes the next action should be my utter right ? :thinking:

6

Yes it should.

Your policies are looking fine, do you get the same fallback response when you try the deny intent?

7

Sadly yes

e: If I reply No to the first question same issue… what is going on ahah

8

You mean the ‘are you going to Paris’ question?

I never worked with the checkpoints myself, so I hope maybe someone else can give some insight.

9

Yes, when I answer “No” to “are you going to Paris”, I got utter_default message, instead of utter_goodbye

Really really strange I need this feature to work ahah

10

In the story on top you didn’t define utter_goodbye after the ‘deny’ intent. So if you didn’t define it in your current story it can be explained. Otherwise I’m running out of solutions :pensive:

11

I did it now to test if it’s changing something or not, I will update my code in first message :slight_smile:

12

Maybe my deny intent is not working ?

E: The deny intent is working in other case …

13

Still stuck on this :sneezing_face:

14

Hm the stories look okay, and your debug logs look okay too. Can you show me your slot types in your domain? I think these are influencing your tracker history when they shouldn’t, which is affecting action prediction. Also, are you trying to pick up entities with your destination intent?