# Rasa 3.10.0 provider for local llm is giving error

**URL:** <https://forum.rasa.com/t/rasa-3-10-0-provider-for-local-llm-is-giving-error/63436>\
**Category:** Rasa CALM\
**Created:** [September 16, 2024, 5:51pm UTC](https://forum.rasa.com/t/rasa-3-10-0-provider-for-local-llm-is-giving-error/63436 "2024-09-16T17:51:38Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sanjukta.bs](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sanjukta.bs/32/24453_2.png) [@Sanjukta.bs](https://forum.rasa.com/u/Sanjukta.bs)\
**Post date:** [September 16, 2024, 5:51pm UTC](https://forum.rasa.com/t/rasa-3-10-0-provider-for-local-llm-is-giving-error/63436/1 "2024-09-16T17:51:38Z")

</div>

My config file-

```auto
recipe: default.v1
language: en
pipeline:
- name: SingleStepLLMCommandGenerator
  llm:
    model: gemma     
    base_url: http://localhost:11434/v1 
    # api_type: ollama
  
  flow_retrieval:
    embeddings:
      provider: "huggingface_local"
      model: "BAAI/bge-small-en-v1.5"
      api_base: "http://localhost:11434/"
      model_kwargs: # used during instantiation
        device: "cpu"
      encode_kwargs: # used during inference
        normalize_embeddings: true
    # active: false

policies:
- name: FlowPolicy
- name: IntentlessPolicy
  llm:
    model: gemma     
    base_url: http://localhost:11434/v1 
  embeddings:
    provider: "huggingface_local"
    model: "BAAI/bge-small-en-v1.5"
    api_base: "http://localhost:11434/"
    model_kwargs: # used during instantiation
      device: "cpu"
    encode_kwargs: # used during inference
      normalize_embeddings: true
      # api_type: ollama
assistant_id: 20240916-212334-mean-developer

```

My error looks like this-

```auto
Give Feedback / Get Help: https://github.com/BerriAI/litellm/issues/new
LiteLLM.Info: If you need to debug this error, use `litellm.set_verbose=True'.

2024-09-17 01:04:50 ERROR rasa.utils.log_utils - [error] nlg.llm.error error=Prov

```

1. List item