I am really new to Rasa and planning to use Rasa for a low resource/underrepresented language (Kinyarwanda). From my research, I think I need a Language Model for this language because neither Rasa nor Spacy has a pretrained Language model for this language.
My question is do I have to train a language model specifically and connect it somehow to Rasa?. Typically I don’t know where to start from.
Thanks
Do you have the language in FastText - https://github.com/facebookresearch/fastText/blob/master/docs/crawl-vectors.md
if so, you can take a look at vincent’s helper code for integrating word vectors from FastText
No I don’t. Unfortunately.
https://dl.fbaipublicfiles.com/fasttext/vectors-wiki/wiki.rw.zip
the language kinarwanda exists as fastText vectors
Wow… Thanks a lot. I appreciate. Would look into this