Hi everyone ! I wanted to know if there was a way to implement the french version of BERT (camembert). It seems how were implemented the other bert version (rasa.nlu.utils.hugging_face) and wanted to know if anyone tried to play with these files to add a version of BERT ! Thank you very much !

Solved ! I heard there was some tries on camemBERT here and looked for these traces There is no need to modify the rasa[transformers] modules from the pip installations, only rasa source code Monkeypatch the dictionary from the modeling_tf_camembert to provide the link to the camemBERT model : add the following lines at the beggining of the hf_transformers.py file (rasa/nlu/utils/hugging_face) from transformers import modeling_tf_camembert modeling_tf_camembert.TF_CAMEMBERT_PRETRAINED_MODEL_ARCHIVE_MAP[“camembert-base”]=“ https://s3.amazonaws.com/models.huggingface.co/bert/jplu/tf-camembert-base/tf_model.h5 ” Add camemBERT to the registry.py file (path : rasa/nlu/utils/hugging_face/registry.py). Here is an example : registry.py (3.0 KB) config.py file : pipeline: name: HFTransformersNLP model_name: “camembert” model_weights: “camembert-base” cache_dir: “data/cache_membert” name: “LanguageModelTokenizer” name: “LanguageModelFeaturizer” name: “DIETClassifier”

RASA and camemBERT

Rasa Open Source

MaxGdr (Maxime GENDRE) August 28, 2020, 8:11am 8

Maybe you should create an intent “What is it”, and switch by entities your response for time, day, or another thing…

Your two intentions are very close

Using BERT with RASA

Topic		Replies	Views
Use recent release google bert -MuRIL Rasa Open Source	6	881	January 8, 2021
Support for Language Models inside Rasa Release Announcements community , rasa	25	12665	November 25, 2021
Unable to download huggingface model Feedback on Rasa Open Source rasa-nlu-trainer	2	2940	March 9, 2023
Build a french chatbot using rasa Getting Started with Rasa	9	229	June 23, 2020
Foreign languages pipeline Rasa Open Source	1	471	January 25, 2021

RASA and camemBERT

Related topics