BERT provides an option to include pre-trained language models from Hugging Face in pipline. As per the doc: name: HFTransformersNLP Name of the language model to use model_name: “bert” Pre-Trained weights to be loaded model_weights: “bert-base-uncased” An optional path to a specific directory to download and cache the pre-trained model weights. The default cache_dir is the same as Export to ONNX . cache_dir: null Following this I configured my pipeline as: name: “HFTransformersNLP” # Name of the language model to use model_name: “bert” # Pre-Trained weights to be loaded model_weights: “bert-base-uncased” cache_dir: “C:/Project ABC/cache/” But the problem is that on running the training steps, the model keeps failing with: OSError: Model name ‘bert-base-uncased’ was not found in tokenizers model name list (bert-base-uncased, bert-large-uncased, bert-base-cased, bert-large-cased, bert-base-multilingual-uncased, bert-base-multilingual-cased, bert-base-chinese, bert-base-german-cased, bert-large-uncased-whole-word-masking, bert-large-cased-whole-word-masking, bert-large-uncased-whole-word-masking-finetuned-squad, bert-large-cased-whole-word-masking-finetuned-squad, bert-base-cased-finetuned-mrpc, bert-base-german-dbmdz-cased, bert-base-german-dbmdz-uncased, bert-base-finnish-cased-v1, bert-base-finnish-uncased-v1, bert-base-dutch-cased). We assumed ‘bert-base-uncased’ was a path, a model identifier, or url to a directory containing vocabulary files named [‘vocab.txt’] but couldn’t find such vocabulary files at this path or url. I did some research and it looks like that there might be issue in downloading the files from internet, so I manually downloaded the files config.json, pytorch_model.bin and placed it in C:/Project ABC/cache/ still I am getting the same error message. Any idea how to resolve this, not giving cache directory is failing too with the same error. Posted the same in SO, but still did not get any response.

Using BERT with RASA

kasar3 (kasar3) September 9, 2020, 10:40am 11

Hi,

I got the same kind of problem using the french model of BERT, CamemBERT. I did follow advice from this link: RASA and camemBERT - #8 by MaxGdr

This helped me to configure my Rasa chatbot and now it’s working.

Hope it will help.

Topic		Replies	Views
Loading Bert language weights offline Tutorials, Resources & Videos community	1	1126	November 17, 2020
Support for Language Models inside Rasa Release Announcements community , rasa	25	12057	November 25, 2021
Can't load bert German model from huggingface Rasa Open Source	2	2305	June 13, 2022
How to import huggingface models to Rasa? Rasa Open Source	12	4102	December 27, 2021
Clarification on Model Weights Getting Started with Rasa	2	222	November 23, 2020