what if have different values of hundreds ?
There is alot of variations ?
There are not same length ?
Somethinglike these ??
view and view
cruiser 1300 custom line
cruiser goldwing f6b
cruiser shadow line
dual sport crf250l
trailblazer (lite) by komfort
@akelad what do i have to do ? if have hurdreds of data kike this data ? bcz loopup data is not working, do I have to train on each of these ??
I have very domain specific entities that are not well recognized in my model. So, I am trying to improve the accuracy of entity recognition by adding lookup tables. But I don’t see any improvement. Currently, I’m using DIET classifier and based on this post “Entity lookup in DIET Classifier” we can use lookup tables with DIET model as long as “RegexFeaturizer” is provided in the pipeline. I also added more training data with the same entity in my nlu data. But still I don’t see any changes. The other thing that I tried was adding “CRFEntityExtractor” which I’m not sure if it is a good idea or not, but still it didn’t help. Can you share your experience that what possibly could be the solution?
Just want to chime in that it’s Feb 2022 and this still does not seem to work. I have a lookup table that shares the same name as the entity I am extracting. The table contains 14 elements. My training data uses 4-5 of those elements in a good number of different sentence structures. When entering the same EXACT phrasing as in my training data, but only changing the entity that the lookup table should provide, it does not detect any entity at all.
In my NLU:
Tell me about the rockwell.
In my lookup table:
Train, start, ask:
Tell me about the destin
I get no matches on the entity.
Its just flat out not working at all. And yes I have more training data than the 1 example and a larger lookup table than the one listed.
use RegexEntityExtractor, it must resolve your problem.
- name: RegexEntityExtractor
# text will be processed with case insensitive as default
# use lookup tables to extract entities
# use regexes to extract entities
# use match word boundaries for lookup table
I am also unable to understand how is lookup table helpful if I have to add every single element of lookup table into examples because I have a list of all countries and was building a tell time bot and in lookup table I have added around 150 country names now do I also have to add 150 examples mentioning all of the countries?