Hi, I am trying to use mitie tokenizer in my config file… While installation using pip install rasa[mitie] command, I am getting a warning with rasa 2.8.1 does not provide the extra ‘mitie’ I had downloaded the model and got the features dat file as well. And when I use the tokenizer in config file. It is giving the following error :
My Config File:
# Configuration for Rasa NLU.
# https://rasa.com/docs/rasa/nlu/components/
language: en
pipeline:
# # No configuration for the NLU pipeline was provided. The following default pipeline was used to train your model.
# # If you'd like to customize it, uncomment and adjust the pipeline.
# # See https://rasa.com/docs/rasa/tuning-your-model for more information.
- name: "MitieNLP"
model: "data/total_word_feature_extractor.dat"
- name: "MitieTokenizer"
- name: RegexFeaturizer
- name: LexicalSyntacticFeaturizer
- name: CountVectorsFeaturizer
- name: CountVectorsFeaturizer
analyzer: char_wb
min_ngram: 1
max_ngram: 4
- name: DIETClassifier
epochs: 100
- name: EntitySynonymMapper
- name: RegexEntityExtractor
- name: ResponseSelector
epochs: 100
- name: FallbackClassifier
threshold: 0.65
# Configuration for Rasa Core.
# https://rasa.com/docs/rasa/core/policies/
policies:
- name: MemoizationPolicy
- name: TEDPolicy
max_history: 5
epochs: 100
- name: RulePolicy
# - name: TwoStageFallbackPolicy
# nlu_threshold: 0.6
# core_threshold: 0.6
# fallback_core_action_name: "action_default_fallback"
# fallback_nlu_action_name: "action_default_fallback"
# deny_suggestion_intent_name: "out_of_scope"
Did you run the following?
pip install git+https://github.com/mit-nlp/MITIE.git
You have a problem with your Python. Try the following:
pip install -U wheel nes-py
python setup.py bdist_wheel