Hi everyone, I run into an issue where Rasa is not stick with the storyline. Here are two stories I wrote: [%E5%9B%BE%E7%89%87] I have been testing this with a happy path along storyline 2, it starts to behave unexpectedly when it reaches ‘deny’. The ‘deny’ intent was recognized but rasa did not execute the corresponding action, which is ‘utter_ask_wo’ in this case. Instead, it returned ‘action_ask_recent_wo’ followed by ‘action_default_fallback’. Here is the log: No 2018-12-06 17:17:07 DEBUG rasa_core.tracker_store - Recreating tracker for id ‘default’ 2018-12-06 17:17:07 WARNING py.warnings - /home/neilx/Develop/venv_fu/lib/python3.6/site-packages/sklearn/preprocessing/label.py:151: DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use array.size > 0 to check that an array is not empty. if diff: 2018-12-06 17:17:07 DEBUG rasa_core.processor - Received user message ‘No’ with intent ‘{‘name’: ‘deny’, ‘confidence’: 0.7905183810527504}’ and entities ‘’ 2018-12-06 17:17:07 DEBUG rasa_core.processor - Logged UserUtterance - tracker now has 66 events 2018-12-06 17:17:07 DEBUG rasa_core.processor - Current slot values: _id: 1234 _name: neil _position: Assistant _wonum: B2345678 2018-12-06 17:17:07 DEBUG rasa_core.policies.memoization - Current tracker state [{‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘entity_name’: 1.0, ‘prev_action_get_name’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘prev_utter_ask_position’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘entity_name’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘prev_action_get_position’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘slot__position_0’: 1.0, ‘prev_utter_confirm_all’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘prev_utter_thanks’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘prev_utter_thanks’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘slot__position_0’: 1.0, ‘prev_utter_confirm_all’: 1.0, ‘slot__id_0’: 1.0}, {‘entity_wonum’: 1.0, ‘intent_enter_name’: 1.0, ‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘prev_action_ask_recent_wo’: 1.0, ‘slot__position_0’: 1.0, ‘slot__id_0’: 1.0}, {‘slot__wonum_0’: 1.0, ‘slot__name_0’: 1.0, ‘prev_action_listen’: 1.0, ‘slot__position_0’: 1.0, ‘intent_deny’: 1.0, ‘slot__id_0’…

you can evaluate your bot just follow the below link their you can find evaluation matrix + failed stories too [image] Testing Your Assistant

I m also facing the same issue and I believe it is because Ur next action is being predicted by keras policy. How about memorization policy? Import memorization policy,set max_history to 5, Set augmentation factor to 0. And give it a try. It may work.

Thanks for the reply. I did try the evaluation and got 100% correct rate, but the problem stil occurs somehow.

I have been experimenting with different combinations of policies including memorization and keras. I have also tried different value for max_history, but the problem still remains.

Try with max history for memorization= 30 And for keras keep it 10. Actually I changed my max history parameters and it is working now.

I have provided a detailed solution.Kindly have a look. [image] [Solved]Predicted Action not following the story Rasa Open Source I have two stories which shares some of the intents. The action is not being executed as per both stories. The story is getting stuck at following point story 1(with intent 1) Inform -slot{‘id’=100} -action_validate story 2 (with intent2) *Inform -slot{‘id’=100} -action_register It is executing action_validate in place of action_execute. I have set max_history in memoization policy to 10, augmentation factor to 0. But the prediction for next action is not coming correct. I checked in deb…

Rasa not following story

Rasa Open Source

ashukrishna100 (Ashukrishna100) December 12, 2018, 6:49am 7

I have provided a detailed solution.Kindly have a look.

Topic		Replies	Views
Predicted next action is always 'action_listen' Rasa Open Source	12	4627	November 29, 2022
[Solved]Predicted Action not following the story Rasa Open Source	18	9653	April 4, 2022
Trouble with 'There is no memorized next action' message Rasa Open Source	10	5964	March 19, 2021
Can RASA CORE follow exactly the stories defined in the stories.md file? Getting Started with Rasa rasa-stories	5	410	December 12, 2018
[SOLVED]RASA story misbehaving Rasa Open Source	23	4118	May 22, 2019

Rasa not following story

Related topics