I have changed the default OpenAI model to Microsoft Phi-2 model from Huggingface. I followed the default tutorial: LLM Providers please note: I have already installed huggingfacehub and set huggingface token as an environment variable. set HUGGINGFACEHUB_API_TOKEN=<token> and made relevant changes to config.yaml file. For reference below config.yaml file: recipe: default.v1 language: en pipeline: - name: LLMCommandGenerator llm: type: "huggingface_hub" repo_id: "microsoft/phi-2" task: "text-generation" policies: - name: FlowPolicy # - name: EnterpriseSearchPolicy # - name: RulePolicy assistant_id: 20240424-061357-all-patch I’m receiving the following error: Traceback (most recent call last): File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\engine\graph.py", line 526, in __call__ output = self._fn(self._component, **run_kwargs) File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\dialogue_understanding\generator\llm_command_generator.py", line 213, in train self.flow_retrieval.populate(flows.user_flows, domain) File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\dialogue_understanding\generator\flow_retrieval.py", line 181, in populate embeddings = self._create_embedder(self.config) File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\dialogue_understanding\generator\flow_retrieval.py", line 153, in _create_embedder return embedder_factory( File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\shared\utils\llm.py", line 245, in embedder_factory return embeddings_cls(**parameters) File "E:\Computer Science\CALM\venv\lib\site-packages\pydantic\v1\main.py", line 341, in __init__ raise validation_error pydantic.v1.error_wrappers.ValidationError: 1 validation error for OpenAIEmbeddings __root__ Did not find openai_api_key, please add an environment variable `OPENAI_API_KEY` which contains it, or pass `openai_api_key` as a named parameter. (type=value_error) The above exception was the direct cause of the following exception: Traceback (most recent call last): File "C:\Program Files\Python38\lib\runpy.py", line 194, in _run_module_as_main return _run_code(code, main_globals, None, File "C:\Program Files\Python38\lib\runpy.py", line 87, in _run_code exec(code, run_globals) File "E:\Computer Science\CALM\venv\Scripts\rasa.exe\__main__.py", line 8, in <module> File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\__main__.py", line 133, in main cmdline_arguments.func(cmdline_arguments) File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\cli\train.py", line 61, in <lambda> train_parser.set_defaults(func=lambda args: run_training(args, can_exit=True)) File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\cli\train.py", line 104, in run_training training_result = train_all( File "E:\Computer Science\CALM\venv\lib\site-packages\rasa\api.py", line 105, in train return asyncio.run( File "C:\Program Files\Pytho…

using huggingface as LLM provider doesn’t work for me :frowning_face:

Getting OpenAI API Key error after changing to Huggingface model

vss (Vibhuti) June 20, 2024, 10:26am 3

Did anyone get it working?

Topic		Replies	Views
Cannot change from openai to huggingface_hub Rasa CALM	1	118	July 30, 2024
Hugging face LLM instead of OpenAI Rasa CALM	5	709	May 21, 2024
Hugging Face LLM ‘huggingface_hub.inference_api’ is deprecated, Rasa CALM	4	755	May 6, 2024
Getting - Error raised by inference API: Cannot override task for LLM models when using model from hugging face Rasa CALM	3	576	May 23, 2024
Rasa CALM: Could not import huggingface_hub python package Rasa CALM installation , rasa	2	600	August 3, 2024