I want to use PhoBert model in pre-train . I found the model here, it’s community-uploaded models on HFTransformersNLP.
But i don’t know how to use it in Rasa config for trainning. Please help me. Thank you
Hey @1412392
I definitely recommend this video about Diet Architecture.
Link: https://www.youtube.com/watch?v=oj5oPGDlep4&t=701s
In this video, you will find a clear explanation about tuning the DietClassifier and how you can implement a pre-trained Bert model.
Example of config.yml with pre-trained Bert model + HFTransformers
Hope this helps 