I have some training data in my nlu.md as follows
## lookup:stock
lookup/stocklist.txt
## intent:affirm
...
## intent:deny
...
## intent:inform
- I want to query [today](askdate) [300117](stock) sotck information #1st line
- I want to query [today](askdate) [603996](stock) sotck information #2nd line
- I want to query [today](askdate) [002952](stock) sotck information #3rd line
- I want to query [today](askdate) [招商银行](stock) sotck information #4th line
etc...
, I used config as follows:
language: "zh"
pipeline:
- name: "MitieNLP"
model: "data/total_word_feature_extractor_zh.dat"
- name: "JiebaTokenizer"
- name: "RegexFeaturizer"
- name: "MitieFeaturizer"
- name: "MitieEntityExtractor"
- name: "CRFEntityExtractor"
- name: "EntitySynonymMapper"
- name: "SklearnIntentClassifier"
I found the train results:
for 1st line & 2nd line: The intent name is not correct, it should be inform.But I put it in “## intent:inform”:
{
"intent": {
"name": "affirm",
"confidence": 0.8148419632687408
},
"entities": [
{
"entity": "stock",
"value": "300117",
"start": 0,
"end": 6,
"confidence": null,
"extractor": "MitieEntityExtractor"
}
],
"intent_ranking": [
{
"name": "affirm",
"confidence": 0.8148419632687408
},
{
"name": "inform",
"confidence": 0.17077687113249335
},
{
"name": "greet",
"confidence": 0.00908073180864047
},
{
"name": "thankyou",
"confidence": 0.003933947925961819
},
{
"name": "goodbye",
"confidence": 0.0007488763620641342
},
{
"name": "deny",
"confidence": 0.00028931341943498086
},
{
"name": "querystock",
"confidence": 0.00020890600580861414
},
{
"name": "queryweather",
"confidence": 0.00011939007685569278
}
],
"text": "300117"
For 3rd line:intent name is not correct(it should be inform), entities is empty(in should be stock).
{
"intent": {
"name": "affirm",
"confidence": 0.8148419632687408
},
"entities": [],
"intent_ranking": [
{
"name": "affirm",
"confidence": 0.8148419632687408
},
{
"name": "inform",
"confidence": 0.17077687113249335
},
{
"name": "greet",
"confidence": 0.00908073180864047
},
{
"name": "thankyou",
"confidence": 0.003933947925961819
},
{
"name": "goodbye",
"confidence": 0.0007488763620641342
},
{
"name": "deny",
"confidence": 0.00028931341943498086
},
{
"name": "querystock",
"confidence": 0.00020890600580861414
},
{
"name": "queryweather",
"confidence": 0.00011939007685569278
}
],
"text": "002952"
}
For 4th line: The code is Chinese stock name, Intent name is correct, but entity name is not correct(it should be stock):
{
"intent": {
"name": "inform",
"confidence": 0.9999998106515122
},
"entities": [
{
"entity": "location",
"value": "\u62db\u5546\u94f6\u884c",
"start": 0,
"end": 4,
"confidence": null,
"extractor": "MitieEntityExtractor"
}
],
"intent_ranking": [
{
"name": "inform",
"confidence": 0.9999998106515122
},
{
"name": "querystock",
"confidence": 9.117450701498296e-08
},
{
"name": "queryweather",
"confidence": 8.095710862221923e-08
},
{
"name": "thankyou",
"confidence": 1.7216779567279607e-08
},
{
"name": "deny",
"confidence": 3.1071286630581476e-14
},
{
"name": "goodbye",
"confidence": 2.779787405774476e-14
},
{
"name": "affirm",
"confidence": 2.0609377719723408e-14
},
{
"name": "greet",
"confidence": 1.3010239856800354e-14
}
],
"text": "\u62db\u5546\u94f6\u884c"
}
I wonder why it happened? How can I solve it? Maybe I used non-suitable commennts?
Anyone, could you give me your advice?It will be appreciated/
My rasa version is:
The trainning proces is :
Juven