Hi everyone ! I wanted to know if there was a way to implement the french version of BERT (camembert). It seems how were implemented the other bert version (rasa.nlu.utils.hugging_face) and wanted to know if anyone tried to play with these files to add a version of BERT ! Thank you very much !

Solved ! I heard there was some tries on camemBERT here and looked for these traces There is no need to modify the rasa[transformers] modules from the pip installations, only rasa source code Monkeypatch the dictionary from the modeling_tf_camembert to provide the link to the camemBERT model : add the following lines at the beggining of the hf_transformers.py file (rasa/nlu/utils/hugging_face) from transformers import modeling_tf_camembert modeling_tf_camembert.TF_CAMEMBERT_PRETRAINED_MODEL_ARCHIVE_MAP[“camembert-base”]=“ https://s3.amazonaws.com/models.huggingface.co/bert/jplu/tf-camembert-base/tf_model.h5 ” Add camemBERT to the registry.py file (path : rasa/nlu/utils/hugging_face/registry.py). Here is an example : registry.py (3.0 KB) config.py file : pipeline: name: HFTransformersNLP model_name: “camembert” model_weights: “camembert-base” cache_dir: “data/cache_membert” name: “LanguageModelTokenizer” name: “LanguageModelFeaturizer” name: “DIETClassifier”

RASA and camemBERT

Rasa Open Source

Zoukero (Zoukero) July 28, 2020, 7:57am 3

Thanks for your answer ! I wanted to beneficiate from the train process of rasa

Topic		Replies	Views
Use recent release google bert -MuRIL Rasa Open Source	6	881	January 8, 2021
Support for Language Models inside Rasa Release Announcements community , rasa	25	12732	November 25, 2021
Unable to download huggingface model Feedback on Rasa Open Source rasa-nlu-trainer	2	2993	March 9, 2023
Build a french chatbot using rasa Getting Started with Rasa	9	243	June 23, 2020
Foreign languages pipeline Rasa Open Source	1	473	January 25, 2021

RASA and camemBERT

Related topics