Hello, I am trying to implement an entity extraction model using the CRF extractor. To do so, I have made 2 configurations: one with only sparse features and another one that takes dense features (BERT) as well. Here are the configurations : With sparse features only: pipeline: name: WhitespaceTokenizer name: LexicalSyntacticFeaturizer name: CountVectorsFeaturizer analyzer: char_wb min_ngram: 1 max_ngram: 4 name: CRFEntityExtractor With pre-trained embedding: pipeline: name: HFTransformersNLP model_weights: “bert-base-multilingual-uncased” model_name: “bert” name: LanguageModelTokenizer name: LanguageModelFeaturizer name: CRFEntityExtractor The problem is that I have the exact same results as if the dense features are not being considered at all while I can see it training in the train phase. The same happens when I train it on a different dataset. The rasa version that I’m using is 2.5.1.

CRF with dense features

liaeh (linschen) June 23, 2021, 1:43pm 4

Topic		Replies	Views
No Difference in Performance when Using or Changing Language Model Featurizers Rasa Open Source	3	1285	January 17, 2022
Difference between CRF_entity_extractor and DIET Tutorials, Resources & Videos entity	0	680	June 17, 2021
Using NER as a Feature for CRFEntityExtractor Rasa Open Source	6	1763	June 28, 2021
ValueError: Sequence dimensions for sparse and dense features don't coincide Rasa Open Source	23	2081	February 11, 2020
How does the CRF for entity extraction work? Best practices? Rasa Open Source	13	2753	June 3, 2022