Hi everyone ! I wanted to know if there was a way to implement the french version of BERT (camembert). It seems how were implemented the other bert version (rasa.nlu.utils.hugging_face) and wanted to know if anyone tried to play with these files to add a version of BERT ! Thank you very much !

Solved ! I heard there was some tries on camemBERT here and looked for these traces There is no need to modify the rasa[transformers] modules from the pip installations, only rasa source code Monkeypatch the dictionary from the modeling_tf_camembert to provide the link to the camemBERT model : add the following lines at the beggining of the hf_transformers.py file (rasa/nlu/utils/hugging_face) from transformers import modeling_tf_camembert modeling_tf_camembert.TF_CAMEMBERT_PRETRAINED_MODEL_ARCHIVE_MAP[“camembert-base”]=“ https://s3.amazonaws.com/models.huggingface.co/bert/jplu/tf-camembert-base/tf_model.h5 ” Add camemBERT to the registry.py file (path : rasa/nlu/utils/hugging_face/registry.py). Here is an example : registry.py (3.0 KB) config.py file : pipeline: name: HFTransformersNLP model_name: “camembert” model_weights: “camembert-base” cache_dir: “data/cache_membert” name: “LanguageModelTokenizer” name: “LanguageModelFeaturizer” name: “DIETClassifier”

RASA and camemBERT

Rasa Open Source

MaxGdr (Maxime GENDRE) August 28, 2020, 8:11am 8

Maybe you should create an intent “What is it”, and switch by entities your response for time, day, or another thing…

Your two intentions are very close

Using BERT with RASA

Topic		Replies	Views
Use recent release google bert -MuRIL Rasa Open Source	6	810	January 8, 2021
Support for Language Models inside Rasa Release Announcements community , rasa	25	12086	November 25, 2021
Unable to download huggingface model Feedback on Rasa Open Source rasa-nlu-trainer	2	2656	March 9, 2023
Foreign languages pipeline Rasa Open Source	1	429	January 25, 2021
How to import huggingface models to Rasa? Rasa Open Source	12	4128	December 27, 2021

RASA and camemBERT

Related Topics