Is there any way to use the LanguageModelFeaturizer model in GGUF format?
I’m trying to use a GGUF model as Featurizer for my pipelines. I am facing a problem that when i try to modify the RASA source code, when i try to tokenizer = AutoTokenizer.from_pretrained(model_id, gguf_file=filename) model = AutoModelForCausalLM.from_pretrained(model_id, gguf_file=filename) I get error ValueError: Architecture bert is not supported
Are there alternative ways to use GGUF in RASA?