# Can I use Rasa Pro developer edition without an OpenAI API key?

**URL:** <https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521>\
**Category:** Rasa CALM\
**Created:** [September 23, 2024, 5:44am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521 "2024-09-23T05:44:00Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![muzzammil](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/muzzammil/32/24185_2.png) [@muzzammil](https://forum.rasa.com/u/muzzammil)\
**Post date:** [September 23, 2024, 5:44am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/1 "2024-09-23T05:44:00Z")

</div>

Hi, I’ve been using Rasa Open Source since the beginning of the year and had decided to switch to Rasa Pro CALM Developer Edition just last week. I’ve got all of my setup and installation done perfectly.

But I just have this main question I would like to clarify:

- Does CALM completely depend on the OpenAI API? Can I disable the pipelines/configs that depend on the OpenAI API and just leverage CALM itself? The reason for this is I don’t to depend on an external/third-party service when I am adding/training my bot with sensitive data.

Is there an alternative around this?

---

<div class="post-metadata">

**Author:** ![Lauren-Goerz](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/lauren-goerz/32/20242_2.png) [@Lauren-Goerz](https://forum.rasa.com/u/Lauren-Goerz)\
**Post date:** [September 23, 2024, 6:37am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/2 "2024-09-23T06:37:15Z")

</div>

Hi Muzzammil,

An LLM is recommended for using CALM as a dialogue system. However, the LLM certainly doesn’t have to be an OpenAI one.

Starting with version Rasa Pro 3.10, CALM uses [LiteLLM](https://litellm.vercel.app/) under the hood to integrate with different LLM providers. Hence, all [LiteLLM’s integrated providers](https://litellm.vercel.app/docs/providers) are also supported with CALM. For a general overview of how to set this up in your project, check out our [LLM Configuration](https://rasa.com/docs/rasa-pro/concepts/components/llm-configuration/) page in our docs.

---

<div class="post-metadata">

**Author:** ![muzzammil](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/muzzammil/32/24185_2.png) [@muzzammil](https://forum.rasa.com/u/muzzammil)\
**Post date:** [September 23, 2024, 6:43am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/3 "2024-09-23T06:43:27Z")

</div>

Hi Lauren, Thank you so much for clarifying this! Will explore the resources provided as well 😄

---

<div class="post-metadata">

**Author:** ![Cabrell](https://avatars.discourse-cdn.com/v4/letter/c/ee59a6/32.png) [@Cabrell](https://forum.rasa.com/u/Cabrell)\
**Post date:** [September 23, 2024, 10:25am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/4 "2024-09-23T10:25:12Z")

</div>

Hi Please i have a question on this point. 'm developping a AI Assistant with Rasa-pro too. But i want to use ollama instead of openai. But i get the error message that the provider must be openai to train the model. How can i change it please?

---

<div class="post-metadata">

**Author:** ![muzzammil](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/muzzammil/32/24185_2.png) [@muzzammil](https://forum.rasa.com/u/muzzammil)\
**Post date:** [September 23, 2024, 11:48am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/5 "2024-09-23T11:48:10Z")

</div>

Okay I seem to be getting a similar error as well.

I used ollama, followed the syntax from [Self-Hostel Model server: ollama](https://rasa.com/docs/rasa-pro/concepts/components/llm-configuration/#self-hosted-model-server) . I had the endpoint running (checked using _ollama serve_)

I am receiving the following error:

```auto
INFO rasa.engine.training.hooks - Starting to train component 'SingleStepLLMCommandGenerator'.
2024-09-23 17:12:13 INFO rasa.dialogue_understanding.generator.llm_based_command_generator - [info] llm_based_command_generator.flow_retrieval.enabled
2024-09-23 17:12:13 ERROR rasa.shared.providers.llm._base_litellm_client - [error] Environment variables: ['OLLAMA_API_BASE'] not set. Required for API calls. event_key=base_litellm_client.validate_environment_variables missing_environment_variables=['OLLAMA_API_BASE']
2024-09-23 17:12:13 ERROR rasa.shared.utils.llm - [error] llm_based_command_generator.train.llm_instantiation_failed error=ProviderClientValidationError("Environment variables: ['OLLAMA_API_BASE'] not set. Required for API calls.") message=Unable to instantiate LLM client.
Unable to create the LLM client for component - LLMBasedCommandGenerator. Please make sure you specified the required environment variables. Error: Environment variables: ['OLLAMA_API_BASE'] not set. Required for API calls.

```

Not sure why I need an API key for this process. (I’ve set the OLLAMA\_API\_BASE as an env as well) Please is there a mistake from our end? @Lauren-Goerz

---

<div class="post-metadata">

**Author:** ![Cabrell](https://avatars.discourse-cdn.com/v4/letter/c/ee59a6/32.png) [@Cabrell](https://forum.rasa.com/u/Cabrell)\
**Post date:** [September 23, 2024, 1:27pm UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/6 "2024-09-23T13:27:40Z")

</div>

Hi I have a ollama service running on a docker container. And i try to set up as llm model to use. Config file:

![image](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/3X/3/9/39c8934c5e235769f2c578df3df2f30c1dd1d7a1.png)

But i get this error:

 ![image](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/3X/1/f/1f60cbc3b537d6d3798d158feb5df42f5238f90e.png)I don’t understand why it’s doing that. When i check up the service with a curl, it works nicely:

![image](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/3X/a/5/a5b05c48d56c764de77d44928005f6c7eea63a7d.png)

---

<div class="post-metadata">

**Author:** ![Cabrell](https://avatars.discourse-cdn.com/v4/letter/c/ee59a6/32.png) [@Cabrell](https://forum.rasa.com/u/Cabrell)\
**Post date:** [September 23, 2024, 1:55pm UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/7 "2024-09-23T13:55:06Z")

</div>

and when i set provider to openai i get this error instead:

 ![image](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/3X/c/5/c5e14fe43e506731616b58b1d362d8987e660c96.png)

---

<div class="post-metadata">

**Author:** ![Cabrell](https://avatars.discourse-cdn.com/v4/letter/c/ee59a6/32.png) [@Cabrell](https://forum.rasa.com/u/Cabrell)\
**Post date:** [October 1, 2024, 7:18am UTC](https://forum.rasa.com/t/can-i-use-rasa-pro-developer-edition-without-an-openai-api-key/63521/8 "2024-10-01T07:18:14Z")

</div>

Hello, please can you help me find a solution to my problem please? and how to use olama entirely as llm provider and not openai?
