Hugging Face LLM ‘huggingface_hub.inference_api’ is deprecated,

Rasa CALM
5

Hi. Thanks for the information. Here’s my config file:

pipeline:
  - name: LLMCommandGenerator
       llm: 
          type: "huggingface_hub"
          repo_id: "mistralai/Mixtral-8x7B-Instruct-v0.1"
       embeddings:
           type: "huggingface_hub"
           repo_id: "sentence-transformers/all-mpnet-base-v2"

policies:
- name: EnterpriseSearchPolicy
  llm: 
     type: "huggingface_hub"
     repo_id: "mistralai/Mixtral-8x7B-Instruct-v0.1"
  embeddings:
    type: "huggingface_hub"
    repo_id: "sentence-transformers/all-mpnet-base-v2"
  vector_store:
       type: "faiss"
       source: "./docs"
  citation_enabled: True

Here’s the error:

FutureWarning: 'InferenceApi (from 'huggingface_hub.inference_api') is deprecated and will be removed from version '1.0''. 'InferenceApi' client is deprecated in favor of the more feature-complete 'InferenceClient'.

Please correct me if I’m not using it correctly. Thank you.