Lookup Table didn't work for RegexEntityExtractor

Rasa Open Source
6

Hey, I am trying to extract the name of insurance companies from the user’s message.

This is the config file…

# Configuration for Rasa NLU.
# https://rasa.com/docs/rasa/nlu/components/
language: en

pipeline:
  - name: custom_nlu_components.CustomTranslator.CustomTranslator
    #    Required: translate_url
    translate_url: <translate_url>
    "source_language": auto
    "target_language": en
  - name: ConveRTTokenizer
  - name: ConveRTFeaturizer
    model_url: <model_url>
  - name: RegexFeaturizer
    case_sensitive: False
  - name: LexicalSyntacticFeaturizer
  - name: DucklingEntityExtractor
    url: "http://localhost:8000"
    dimensions: [ "time", "duration", "number" ]
    timeout: 5
    timezone: "Asia/Kolkata"
    locale: "en_IN"
  - name: CountVectorsFeaturizer
  - name: CountVectorsFeaturizer
    analyzer: char_wb
    min_ngram: 1
    max_ngram: 4
  - name: DIETClassifier
    epochs: 100
    random_seed: 73
    model_confidence: linear_norm
    constrain_similarities: True
  - name: EntitySynonymMapper
  - name: ResponseSelector
    epochs: 100
    random_seed: 73
    model_confidence: linear_norm
    constrain_similarities: True
  - name: FallbackClassifier
    threshold: 0.45

# Configuration for Rasa Core.
# https://rasa.com/docs/rasa/core/policies/
policies:
  - name: MemoizationPolicy
  - name: TEDPolicy
    max_history: 5
    epochs: 100
    random_seed: 73
    model_confidence: linear_norm
    constrain_similarities: True
  - name: RulePolicy

These are some of the training examples:

- intent: in_share_vendor_details
    examples: |
      - Insurance agent from [ICICI](insurance_provider) had called me
      - its from [LIC](insurance_provider)
      - i can't recall , probably through [icici](insurance_provider)
      - I bought a policy from [Tata](insurance_provider)
      - [HDFC Ergo](insurance_provider)

These are test examples:

  - intent: in_share_vendor_details
    examples: |
      - from [Tata AIG](insurance_provider)
      - I have renewed from [hdfc](insurance_provider) life insurance
      - I think it was [ICICI](insurance_provider)
      - i bought it from [tata aig](insurance_provider)
      - Umm from [Tata](insurance_provider)

Now these examples are present in lookup table as well. When i run rasa test, entity extraction is failing for a lot of examples. Let me know if you need any other files.