Two Stage Fallback unexpected behaviour

Rasa Open Source
1

I am trying to use the two stage fallback policy as mentioned in the rasa-demo but it doesn’t behave as expected. I used interactive learning to see the action sequence and here is what I found after an input with low nlu confidence,

  • action_default_ask_affirmation
  • action_listen
  • user input: yes
  • classified as affirm
  • action_revert_fallback_events
  • action_default_fallback

which is not the flow mentioned in docs as it should continue after yes as it was originally well classified, same happens with “deny” it runs the action_default_fallback from the first time instead of running action_default_ask_rephrase

here is my policy:

  - name: KerasPolicy
    epochs: 50
    max_history: 6
  - name: AugmentedMemoizationPolicy
    max_history: 6
  - name: TwoStageFallbackPolicy
    nlu_threshold: 0.8
    core_threshold: 0.3
  - name: FormPolicy

I am using core 0.13.2, also I am not overriding any actions from the default action classes for fallback

2

@juste Help needed here

3

can you share your stories and actions ?

4

i didn’t write any custom actions or stories for the two satge fall back policy … i just wanted to run it with the default messages … should I write stories or actions to make it work??

i followed the example in rasa-demo … they didn’t write stories for it… do you have any example or steps in how to make it work?

5

here is my stories:

##happy path 1
* greet
    - action_greet
* carSearch
    - carSearch_form
    - form{"name": "carSearch_form"}
    - form{"name": "null"}
    - action_carSearch
* bookAppointment
    - bookAppointment_form
    - form{"name": "bookAppointment_form"}
    - form{"name": "null"}
    - action_bookAppointment
* goodbye
    - action_goodbye

## happy path 2
* greet
    - action_greet
* bookAppointment
    - bookAppointment_form
    - form{"name": "bookAppointment_form"}
    - form{"name": "null"}
    - action_bookAppointment
* carSearch
    - carSearch_form
    - form{"name": "carSearch_form"}
    - form{"name": "null"}
    - action_carSearch
* goodbye
    - action_goodbye

## only bookAppointment
* bookAppointment
    - bookAppointment_form
    - form{"name": "bookAppointment_form"}
    - form{"name": "null"}
    - action_bookAppointment

## only greet
* greet
    - action_greet

## only carSearch
* carSearch
    - carSearch_form
    - form{"name": "carSearch_form"}
    - form{"name": "null"}
    - action_carSearch

## only goodbye
* goodbye
    - action_goodbye
6

I just wanted to on your setup. If you possibly share the actions and some data. so I can try and test.

7

@hossa95 Have you adjusted domain.yml: utter_ask_rephrase:

  • text: “Could you rephrase this please blabla some message?”

Not sure what’s happened to your yes answer path though