Hi everyone ! I wanted to know if there was a way to implement the french version of BERT (camembert). It seems how were implemented the other bert version (rasa.nlu.utils.hugging_face) and wanted to know if anyone tried to play with these files to add a version of BERT ! Thank you very much !

Solved ! I heard there was some tries on camemBERT here and looked for these traces There is no need to modify the rasa[transformers] modules from the pip installations, only rasa source code Monkeypatch the dictionary from the modeling_tf_camembert to provide the link to the camemBERT model : add the following lines at the beggining of the hf_transformers.py file (rasa/nlu/utils/hugging_face) from transformers import modeling_tf_camembert modeling_tf_camembert.TF_CAMEMBERT_PRETRAINED_MODEL_ARCHIVE_MAP[“camembert-base”]=“ https://s3.amazonaws.com/models.huggingface.co/bert/jplu/tf-camembert-base/tf_model.h5 ” Add camemBERT to the registry.py file (path : rasa/nlu/utils/hugging_face/registry.py). Here is an example : registry.py (3.0 KB) config.py file : pipeline: name: HFTransformersNLP model_name: “camembert” model_weights: “camembert-base” cache_dir: “data/cache_membert” name: “LanguageModelTokenizer” name: “LanguageModelFeaturizer” name: “DIETClassifier”

RASA and camemBERT

Rasa Open Source

Zoukero (Zoukero) July 28, 2020, 7:57am 3

Thanks for your answer ! I wanted to beneficiate from the train process of rasa

Topic		Replies	Views
Fine tuning camemBERT on custom dataset for intent classification Rasa Open Source	2	1129	June 15, 2021
Problem when using transformer in NLU pipeline Rasa Open Source	8	2206	November 25, 2021
Support for Language Models inside Rasa Release Announcements community , rasa	25	12779	November 25, 2021
How can i use another language model in HFTransformersNLP? Tutorials, Resources & Videos	1	1383	December 16, 2020
BERT model using with RASA Rasa Open Source	0	59	June 28, 2024

RASA and camemBERT

Related topics