EntitySynonymMapper is not working

Rasa Open Source
1

Added the Synonyms for required entities but bot is not picking up the entity

Config:

language: en
pipeline:
  - name: WhitespaceTokenizer
  - name: RegexFeaturizer
  - name: LexicalSyntacticFeaturizer
  - name: CountVectorsFeaturizer
  - name: CountVectorsFeaturizer
    analyzer: "char_wb"
    min_ngram: 1
    max_ngram: 4
  - name: CRFEntityExtractor
  - name: DIETClassifier
    epochs: 100
    entity_recognition: false
  - name: EntitySynonymMapper
  - name: ResponseSelector
    epochs: 100
policies:
  - name: MemoizationPolicy
  - name: TEDPolicy
    max_history: 5
    epochs: 100
  - name: MappingPolicy.
2

Hi Yuvaraj,

Can you send an example of some of your training data showing how the synonyms are defined and then a log with --debug so we can see what’s happening during a dialog where you test out the synonyms?

Greg

3

Hi Grey,

Here is sample project.I list my entities

domain.yml

entities:

  • delivery_status

lookup_tables

Not Started

In Progress

Out for Delivery

Shipped

In my case ,I have added shipped as synonyms for Shipped entity

synonyms
synonyms1919×960 34.8 KB

Rasa is not extracting entity when synonyms is in lower case

lowercasesynoymn
lowercasesynoymn1917×1008 46.5 KB

In other case ,i have trained Shipped with shipped, carried, Dispatched synonyms.If i use some synonyms for Shipped other than trained synonyms ,rasa is not extracting the entity as well.

synonyms2
synonyms21919×884 36.5 KB

4

Make sure you have NLU training examples with the synonyms:

what are the [shipped]{"entity": "delivery_status", "value": "Shipped"} order counts
how many [carried]{"entity": "delivery_status", "value": "Shipped"} orders are there
number of [Dispatched]{"entity": "delivery_status", "value": "Shipped"} orders

Greg

5

Thanks for the response.

I have more one doubt if I have more entity and add synonyms for those entities whether I need to have NLU examples for all data.