Hello, i have entities in my training date with uppercase but when i parse with lowercase they are not recognized
{ “intent”: “B_Test-Entity - Food&Parser_Test-Flow-3&V24.0”,
"entities": [
{
"start": 0,
"end": 5,
"value": "Restaurante",
"entity": "B_food"
}
],
"text": "Sushi"
},
My pipeline-> language: “pt”
pipeline:
-
name: “tokenizer_whitespace”
-
name: “intent_featurizer_count_vectors”
“lowercase”: true
“OOV_token”: None
-
name: “ner_crf”
features: [ [“low”,“upper”], [“bias”, “low”, “prefix5”, “prefix2”, “suffix5”, “suffix3”, “suffix2”, “upper”, “digit”, “pattern”], [“low”,“upper”] ]
-
name: “intent_classifier_tensorflow_embedding”
“random_seed”: 1
-
name: “ner_duckling_http”
url: “http://localhost:8000” locale: “pt_PT” timezone: “Europe/London” dimensions: [“amount-of-money”,“distance”,“duration”,“email”,“phone-number”,“quantity”,“temperature”,“time”,“url”,“volume”]
for exemple:
(works fine) I want Sushi restaurants
(not working) I want sushi restaurants
I want recognize the entity in both cases