Prediction of nlu is very high on irrelevant data. NLU Pipeline-
pipeline:
-
name: ConveRTTokenizer
“model_url”: https://github.com/connorbrinton/polyai-models/releases/download/v1.0/model.tar.gz
-
name: ConveRTFeaturizer
“model_url”: https://github.com/connorbrinton/polyai-models/releases/download/v1.0/model.tar.gz
-
name: CRFEntityExtractor
-
name: DIETClassifier entity_recognition: False epochs: 300
Before the PolyAI team has decided to take down the ConveRT models from the public domain, I was using the same pipeline
- name: ConveRTTokenizer
- name: ConveRTFeaturizer
- name: CRFEntityExtractor
- name: DIETClassifier entity_recognition: False epochs: 300
but it was behaving good. After changing model_url to https://github.com/connorbrinton/polyai-models/releases/download/v1.0/model.tar.gz model start behaving badly.
Is there any change or difference in between model files which are hosted on given url (https://github.com/connorbrinton/polyai-models/releases/download/v1.0/model.tar.gz) and original convert model files