April 13, 2020, 8:04pm
Is there an option to convert a user’s message to lowercase before the NLU processing starts?
For instance, if a user sends
What a Beautiful DAY I would like it to be converted to
what a beautiful day and then allow my components to identify intents and extract entities.
Also, is there any way to map special characters to something else? e.g
ι. Does anyone know which file(s) should I edit to achieve this special character mapping?
April 15, 2020, 9:41am
convert a user’s message to lowercase
if you’re using
whitespace tokenizer, then you can set the
map special characters to something else
for that specific case with umlauts you can configure CountVectorFeaturizer, and set
unicode. More info
I hope that helps!
April 15, 2020, 10:07am
I actually managed to achieve the special character mapping by defining a custom method in
facebook.py file which detects any special characters in user’s text and replaces them with predefined values inside a dictionary. It seems to work fine so far.
Thank you for replying and providing your solution!