@SemionushkinDenis1988 Thanks for the question! Yes, you can use the BERT model with the specified russian language weights. Although, I see that the model checkpoint is for pytorch backend which we don’t support as of now. However, you can convert the pytorch checkpoint into a Tensorflow checkpoint and then load the converted checkpoint in your pipeline. Please refer to this thread to understand how you can do this.
1 Like