# Rasa test not loading all intents

**URL:** <https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553>\
**Category:** Rasa Open Source\
**Created:** [May 13, 2021, 3:16pm UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553 "2021-05-13T15:16:45Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![jonathanpwheat](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/jonathanpwheat/32/4880_2.png) [@jonathanpwheat](https://forum.rasa.com/u/jonathanpwheat)\
**Post date:** [May 13, 2021, 3:16pm UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553/1 "2021-05-13T15:16:45Z")

</div>

I have a Rasa 2.6.0 project that has 39 intents broken down into 4 different `domain.yml` files each of which is in their own directory under the main `data` directory along with associated `stories.yml`,`rules.yml` and `nlu.yml`

Running `rasa data validate --domain data` works and returns **No story structure conflicts found.**

But when running this statement

`rasa test nlu -f 2 --cross-validation` or simply `rasa test`

I get the following seemingly random list of intents that seem to be not included as part of my domain.

```auto
rasa test nlu -f 2 --cross-validation              
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/common-general/rules.yml': 
Found intent 'general_wait_estimate' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/common-general/rules.yml':
Found intent 'forget' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/common-helpdesk-triage/rules.yml': 
Found intent 'initial_contact' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/common-helpdesk-triage/stories.yml': 
Found intent 'triage_handoff_to_agent' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/common-helpdesk-triage/stories.yml':     
Found intent 'triage_submit_incident_request' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'abilities' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'account_reactivation_types_of_accounts' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'deny' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'affirm' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'account_reactivation' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'account_lapse_30' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'account_lapse_90' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories
/home/jwheat/anaconda2/envs/rasa260/lib/python3.8/site-packages/rasa/shared/utils/io.py:97: UserWarning: Issue found in 'data/account-reactivation/stories.yml':
Found intent 'account_lapse_90plus' in stories which is not part of the domain.
  More info at https://rasa.com/docs/rasa/stories

```

Rasa goes ahead and trains and runs the tests, and the results are pretty bad, I’m guessing due to these missing intents.

Any ideas if this is a bug, or some malformed training data? The intents all look ok to me.

Each of these indeed is included in the respective domain under the `intents:` key.

I’m not sure why it’s cherry picking these out as a problem.

---

<div class="post-metadata">

**Author:** ![RuhtraZ](https://avatars.discourse-cdn.com/v4/letter/r/b9bd4f/32.png) [@RuhtraZ](https://forum.rasa.com/u/RuhtraZ)\
**Post date:** [May 14, 2021, 12:33pm UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553/2 "2021-05-14T12:33:14Z")

</div>

Look at this, it’s unresolved at the moment :

> <https://github.com/RasaHQ/rasa/issues/8135>
>
> Rasa version:
> 2.3.4
> Rasa SDK version (if used & relevant):
> 2.3.1
> Rasa X version (if used & relevant):
> Python version:
> 3.8.8
> Operating system (windows, osx, ...):
> Linux-4.4.0-186-generic-x86\_64-with-glibc2.10
> Issue:
> This is annoying....

---

<div class="post-metadata">

**Author:** ![jonathanpwheat](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/jonathanpwheat/32/4880_2.png) [@jonathanpwheat](https://forum.rasa.com/u/jonathanpwheat)\
**Post date:** [May 17, 2021, 12:29pm UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553/3 "2021-05-17T12:29:21Z")

</div>

Thanks, and this is funny and a bit disturbing - looks like I already asked this - [Testing with split domain files = UserWarnings](http://forum.rasa.com/t/testing-with-split-domain-files-userwarnings/40837) I was even tagged at the end of that issue.

I must be losing it.

HOWEVER, this time it was with Rasa 2.6.0, so maybe I feel ok about double posting 😖

---

<div class="post-metadata">

**Author:** ![rhododendron](https://avatars.discourse-cdn.com/v4/letter/r/22d042/32.png) [@rhododendron](https://forum.rasa.com/u/rhododendron)\
**Post date:** [May 19, 2021, 10:48am UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553/4 "2021-05-19T10:48:44Z")

</div>

Hi. I am also having the same UserWarning, although I only have one domain.yml and nlu/stories files. My project directory is structured just as the inital directory (after `rasa init`) the only difference is that I removed rules.yml, other files, and folders named the same.

`rasa data validate` Does not show any problems with my training files.

---

<div class="post-metadata">

**Author:** ![jonathanpwheat](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/jonathanpwheat/32/4880_2.png) [@jonathanpwheat](https://forum.rasa.com/u/jonathanpwheat)\
**Post date:** [May 20, 2021, 5:35pm UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553/5 "2021-05-20T17:35:17Z")

</div>

Haha, I never thought to try it with the basic `rasa init` bot. I just assumed it was my split files and directories.

---

<div class="post-metadata">

**Author:** ![zjntmo](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/zjntmo/32/16492_2.png) [@zjntmo](https://forum.rasa.com/u/zjntmo)\
**Post date:** [August 12, 2021, 2:09pm UTC](https://forum.rasa.com/t/rasa-test-not-loading-all-intents/43553/6 "2021-08-12T14:09:53Z")

</div>

Has this been resolved? I am running into this as well. Using `-d domain_location` gives the all-green when using `data validate`, but for `test nlu --cross-validation` it always throws these warnings regardless of what I try or how my directories and files are structured.
