Entity lookup in DIET Classifier

Similar discussion here: Lookup table is not working - #13 by azizullah2017

Adding a lookup table feature might be harder to debug because its influence is not deterministic: the feature should be highly correlated with the named entity class it is designed to indicate, but there is no guarantee that DIET will extract it with 100% consistency. I have found that these lookup table feature help extract some examples but not others. I’m still looking into this to see if I can improve its accuracy. Let me know if anyone has clear evidence that lookup table features are broken or any hints and tips on how to improve their applicability or how to debug DIET. A suggestion for Rasa is to make the pipeline more transparent and debuggable such as showing intermediate internal representations (such as featurized text) and perhaps providing feature-importance plots (easier to do with tree-based classifiers, but still probably possible to do with neural-based classifiers).