Hello, I’m building a test bot using rasa nlu and core capabilities where in it captures two entities and summarize the entity values that were captured. For this, I had around 2000 examples for 9 intents and 2 entities and tried with both ‘spacy_sklearn’ and ‘tensorflow_embedding’ pipelines. There is a problem while detecting entities for a value that is not present in the training dataset. For example, Below is the intent where I detect ‘name’ as the entity. ## intent:name - My name is Alice , - I am Josh , - I’m Lucy , - People call me Greg , - It’s David , - name is Johny , - John is my name, - lucy is my name Entities aren’t getting detected if I give any other name apart from the above trained sample. Failed utterances: ‘Kumar is my name’, ‘I am Rocky’ etc. This suggests that entity detection is merely a string check or rule based check on the trained examples. Could you please suggest any way to extract entities accurately. Regards, Swamy

Issue with entity detection - fails to detect outside of the training set

lgrinberg (Leo@Vocinity) February 6, 2019, 9:14pm 5

For names try a combination of a lookup table, some minimal training data and what we suggest here:

That should work well. Please don’t hesitate to ask if you need any more help with this. We were fighting this problem for a while but think we found the solution.

Topic		Replies	Views
Name entity not extracting Rasa Open Source	22	4805	September 17, 2020
Not detected entity Rasa Open Source	3	867	February 25, 2021
NLU only detecting entities explicitly present in training data Rasa Open Source	17	2603	August 8, 2021
Cannot get entity extraction to work with Rasa NLU Rasa Open Source	4	2069	October 15, 2019
Why can only the entities in the intent be recognized? Rasa Open Source	6	764	February 4, 2022

Issue with entity detection - fails to detect outside of the training set

Related Topics