The bot is not predicting correct action as per stories

[joy (Harshit Tripathi)]

Hi Everyone.

My chatbot is about storing details for purchase order and invoice. Intents are getting correctly classified but the action is getting wrong predicted. How can I make sure to let rasa core do predict correct action. For intent query_po_invoice, it is predicting action utter_tell_new_po_status

This is the stories.yml file.

• story: greeting

  steps:

  • intent: greet

  • action: utter_greet

• story: query invoice po

  steps:

  • intent: query_po_invoice

  • action: action_show_details

• story: update invoice status

  steps:

  • intent: change_status

    entities:

    • invoice: invoice

  • action: utter_tell_new_invoice_status

  • checkpoint: check_status

• story: update purchase order status

  steps:

  • intent: change_status

  • action: utter_tell_new_po_status

  • checkpoint: check_status

• story: final step

  steps:

  • checkpoint: check_status

  • intent: affirm

  • action: action_update_status

this is nlu.yml file

• intent: add_purchase_order

  examples: |

  • I want to add a purchase order

  • Can I add a buyer’s purchase order ?

  • I want to have added a po

  • Please add a [purchase order] (po)

  • A purchase order needs to be included.

  • Add one purchase order

  • Add a single po

  • Record one purchase order

  • Register one po

  • Enter a purchase order

  • List down a purchase order

• intent: add_invoice

  examples: |

  • I want to add an invoice details for the purchase order

  • Please add the invoice

  • Get the invoice added for a purchase order

  • Add one invoice

  • Add a single invoice

  • Record one invoice for a purchase order

  • Register one invoice for a po

  • Enter an invoice

  • Take one invoice for a purchase order

• synonym: po

  examples: |

  • purchase order

  • po

• regex: date

  examples: |

  • \d{2}-\d{2}-\d{4}

• regex: invoice_date

  examples: |

  • \d{2}-\d{2}-\d{4}

• regex: order_id

  examples: |

  • (PO[0-9]{2}.*)

• intent: affirm

  examples: |

  • The order id is PO01

  • order id is PO02

  • PO03

  • PO10 is the order id.

  • PO13 is the order number.

  • The customer name is ICICI

  • [HSBC] (customer_name)

  • Bank of America

  • American Express is customer

  • The order has been shipped via road

  • Shipping method is rail

  • air

  • The date is 02-01-2005

  • 10-02-2021

  • The status is received

  • cancelled

  • closed

  • change order

  • new

  • The status is cancelled

  • 15-08-1999

  • Invoice Date is 17-12-2020

  • The status of invoice is disputed

  • activated

  • partial

  • overdue

  • draft

  • void

  • paid

  • The customer name is ICICI

  • Bank of America

• lookup: customer_name

  examples: |

  • HDFC

  • Bank of America

  • HSBC

  • American Express

  • SBI

  • ICICI

• lookup: invoice_customer_name

  examples: |

  • HDFC

  • Bank of America

  • HSBC

  • American Express

  • SBI

  • ICICI

• lookup: po_status

  examples: |

  • new

  • released

  • received

  • change order

  • cancelled

  • closed

• lookup: invoice_status

  examples: |

  • disputed

  • partial

  • activated

  • overdue

  • draft

  • paid

  • void

• intent: query_po_invoice

  examples: |

  • I want to know about purchase order PO04

  • I want to have details of po PO08

  • Provide details of purchase order PO15

  • Get me info about po PO19

  • Help me with info about purchase order PO20

  • Provide the information on purchase order PO10

  • Get me invoice details of PO12

  • Avail me info about invoice for PO16

  • I want to know invoice details about PO08

  • Provide the information for invoice of [PO10])(order_id)

  • I want to have details for invoice of PO15

  • Can you give me details for invoice of PO12

• intent: change_status

  examples: |

  • Please change status of purchase order PO05

  • Update status of purchase order PO11

  • Modify status of po PO13

  • I want to change status of purchase order PO12

  • Make changes for status of po PO12

  • Get the purchase order PO25 (status) changed

  • Update status of invoice for PO03

  • Please change status of invoice for PO04

  • Modify invoice (status)(status) for PO17

  • Get the invoice (status)(status) of PO29 changed

  • I want to alter invoice (status)(status) of PO25

[anupam20sep]

Please share your config.yml as well. What policies you are using?

[joy (Harshit Tripathi)]

Please find below config.yml file

Configuration for Rasa NLU.

https://rasa.com/docs/rasa/nlu/components/

language: en

pipeline:

No configuration for the NLU pipeline was provided. The following default pipeline was used to train your model.

If you’d like to customize it, uncomment and adjust the pipeline.

See Tuning Your NLU Model for more information.

• name: WhitespaceTokenizer

• name: RegexFeaturizer

• name: LexicalSyntacticFeaturizer

• name: CountVectorsFeaturizer

• name: CountVectorsFeaturizer

  analyzer: char_wb

  min_ngram: 1

  max_ngram: 4

• name: DIETClassifier

  epochs: 100

• name: RegexEntityExtractor

  case_sensitive: False

  use_lookup_tables: True

  use_regexes: True

• name: EntitySynonymMapper

• name: ResponseSelector

  epochs: 100

• name: FallbackClassifier

  threshold: 0.7

  ambiguity_threshold: 0.1

Configuration for Rasa Core.

https://rasa.com/docs/rasa/core/policies/

policies:

No configuration for policies was provided. The following default policies were used to train your model.

If you’d like to customize them, uncomment and adjust the policies.

See Policies for more information.

• name: MemoizationPolicy

  max_history: 0

• name: TEDPolicy

  max_history: 0

  epochs: 100

• name: RulePolicy

  core_fallback_action_name: “action_default_ask_affirmation”