Cannot change from openai to huggingface_hub

Rasa Pro CALM
1

I have followed other LLM\Embedding tutorial and changed my config to this:

recipe: default.v1 language: en pipeline:

  • name: SingleStepLLMCommandGenerator llm: type: “huggingface_hub” repo_id: “HuggingFaceH4/zephyr-7b-beta” task: “text-generation” embeddings: type: “huggingface_hub” repo_id: “sentence-transformers/all-mpnet-base-v2” task: “feature-extraction” policies:
  • name: FlowPolicy assistant_id: 20240729-132344-grouchy-boulevard

I also set enviormental variable HUGGINGFACEHUB_API_TOKEN, yet when I try to train rasa i get OPEN AI API errors.

2

Hi Marcin,

This is most likely coming from the flow_retrieval feature that uses openai by default for the embeddings. You need to configure it to use other embeddings or turn that feature off: flow-retrieval