# Grab the NLU training dataset! **URL:** \ **Category:** Getting Started with Rasa\ **Created:** [September 6, 2018, 11:02am UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903 "2018-09-06T11:02:23Z")\ **Posts on this page:** 20\ **Page:** 2
**Author:** ![Serge](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/serge/32/10491_2.png) [@Serge](https://forum.rasa.com/u/Serge)\ **Post date:** [January 22, 2019, 4:33am UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/24 "2019-01-22T04:33:13Z")
Hi. I just downloaded and training the smalltalk.md and during training I started to get the warnings: ![image](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/2X/5/5fe36c197e51553db38639d73fc3d185c4bf966f.png)At runtme, I started to get the following warnings: - 2019-01-22 04:22:54+0000 [-] /usr/local/lib/python3.5/dist-packages/sklearn/preprocessing/label.py:151: builtins.DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty. I noticed something related: > > > \*\*rasa NLU version\*\* (e.g. \`0.7.3\`): > > \*\*Used backend / pipeline\*\* (\`spacy\_skle…arn\`): > > \*\*Operating system\*\* (Ubuntu 64bit ): > > \*\*demo-rasa.json has duplicate training data\*: > https://github.com/golastmile/rasa\_nlu/blob/master/data/examples/rasa/demo-rasa.json > > I just noticed that demo-rasa.json has duplicate data in "common\_examples". I see that the whole examples are copied exactly twice. > I looked at the history of the file and found that this happened when the two sections "entity\_examples" and "intent\_examples" were merged into "common\_examples" recently (btw both sections had the same data) > > But now if I remove the duplicates from "common\_examples" and train the model, I get the following warnings > > \`....../sklearn/metrics/classification.py:1113: UndefinedMetricWarning: F-score is ill-defined and being set to 0.0 in labels with no predicted samples. > 'precision', 'predicted', average, warn\_for) > ....../sklearn/metrics/classification.py:1115: UndefinedMetricWarning: F-score is ill-defined and being set to 0.0 in labels with no true samples. > 'recall', 'true', average, warn\_for)\` > > Of course the confidence level in results also get affected badly, e.g. trying with "chinese restaurant in the center" doesn't classify "cuisine" entity and the confidence level drops to under 4 > > If I keep the duplicate data it runs fine and without any warnings... This behavior is strange to me, can someone please explain why the data duplication is required? > > Thanks And in the smalltalk.md there are duplicate intents. ``` ## intent:smart - study - you should study better - you must learn - be clever - be more clever - be smarter - be smart - get qualified ``` and ## intent:smart - you are so intelligent - you are a genius - smart - brilliant - clever - you are clever - you are so brainy - you’re really smart - you’re really brainy - you know a lot - you know a lot of things - you have a lot of knowledge - you know so much - how smart you are - how brainy you are - how clever you are - how brilliant you are - you are intelligent - you are qualified - you are really smart - you’re very smart - you are so smart - you are too smart - you are very clever - you are very intelligent - you are very smart - you’re intelligent - you’re a genius - you’re a smart cookie - you’re clever - you’re pretty smart - you’re qualified - why are you so smart - you are so clever Same applies for intent:good - it’s there twice and maybe more. Is it the duplicates that cause this problem? As the confidence level went to near zero after the retrain with this smalltalk.md: ---
**Author:** ![HeiooDo](https://avatars.discourse-cdn.com/v4/letter/h/8baadc/32.png) [@HeiooDo](https://forum.rasa.com/u/HeiooDo)\ **Post date:** [March 10, 2019, 12:23pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/25 "2019-03-10T12:23:08Z")
Hi Juste, are there also some stories available which are related to the new intents? Ciao HeiooDo ---
**Author:** ![unit01](https://avatars.discourse-cdn.com/v4/letter/u/ee7513/32.png) [@unit01](https://forum.rasa.com/u/unit01)\ **Post date:** [March 10, 2019, 3:51pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/26 "2019-03-10T15:51:42Z")
Hey @fade2black. Are there any better alternatives you’d suggest looking at? ---
**Author:** ![fade2black](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/fade2black/32/1922_2.png) [@fade2black](https://forum.rasa.com/u/fade2black)\ **Post date:** [March 10, 2019, 4:10pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/27 "2019-03-10T16:10:01Z")
Hi @unit01, alternative to what? ---
**Author:** ![unit01](https://avatars.discourse-cdn.com/v4/letter/u/ee7513/32.png) [@unit01](https://forum.rasa.com/u/unit01)\ **Post date:** [March 10, 2019, 5:01pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/28 "2019-03-10T17:01:12Z")
@fade2black An alternative to Rasa, that doesn’t have the downsides you mentioned in your comment (withdrawn now): [Grab the NLU training dataset and starter-packs!](http://forum.rasa.com/t/grab-the-nlu-training-dataset-and-starter-packs/903/19). What works better in your experience? ---
**Author:** ![fade2black](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/fade2black/32/1922_2.png) [@fade2black](https://forum.rasa.com/u/fade2black)\ **Post date:** [March 10, 2019, 7:46pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/29 "2019-03-10T19:46:53Z")
@unit01I don’t know any alternatives to RASA. I have looked at several others such as Watson but they do not fit my problem either. My problem is creating a closed-domain QA system where creating a chit-chat bot is not a major problem. I have been dealing with a harder problem concerning a QA system. If RASA does not solve your problem you could create your own chat bot from scratch or create your own layer between incoming data (sentences) and RASA server where you could preprocess the sentence and either take other actions or simply delegate it to RASA. ---
**Author:** ![Juste](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/juste/32/15_2.png) [@Juste](https://forum.rasa.com/u/Juste)\ **Post date:** [March 11, 2019, 10:49am UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/30 "2019-03-11T10:49:25Z")
Hey @HeiooDo. Not at the moment, but it would be a great community contribution if you would decide to generate some conversations! 🙂 ---
**Author:** ![Devan0369](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/devan0369/32/2572_2.png) [@Devan0369](https://forum.rasa.com/u/Devan0369)\ **Post date:** [April 17, 2019, 2:21pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/32 "2019-04-17T14:21:33Z")
Juste, I am having trouble with running nlu\_model.py as the error indicate cannot find rasa\_nlu.converters can you explain where or how I can import rasa\_nlu.converters from?? ---
**Author:** ![Mayflower](https://avatars.discourse-cdn.com/v4/letter/m/958977/32.png) [@Mayflower](https://forum.rasa.com/u/Mayflower)\ **Post date:** [April 19, 2019, 4:25am UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/33 "2019-04-19T04:25:02Z")
@Juste, Hi Juste, I am Jinglong, a Software Engineer from China, Hangzhou.In my company, We want to build a chatbot platform for different kinds of customer ,for example,E-commerce( taobao sellers),Education industry,Medical industry and so on.I have already run some demo by rasa stack. We want to use your rasa platform module,Can you tell me the price and level? After I sent message to rasa sales team by [Contact Us - Rasa](https://rasa.com/contact-sales/) . I received one email from Dominik. Then I wrote some more email to Dominik to get information about rasa platform several days ago, but I have not received reply . My email is [jiaojinglong@qipeng.com](mailto:jiaojinglong@qipeng.com) . Could you help me about this problems? Thanks! 😃 ---
**Author:** ![AllBecomesGood](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/allbecomesgood/32/2684_2.png) [@AllBecomesGood](https://forum.rasa.com/u/AllBecomesGood)\ **Post date:** [April 19, 2019, 1:13pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/34 "2019-04-19T13:13:51Z")
After retraining with the newly added data my bot forgot how to tell jokes and doesn’t reply much in general anymore \>.\> ---
**Author:** ![vishnunahak23](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/vishnunahak23/32/2639_2.png) [@vishnunahak23](https://forum.rasa.com/u/vishnunahak23)\ **Post date:** [April 23, 2019, 12:30pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/35 "2019-04-23T12:30:52Z")
@ Juste, I am trying to train nlu but its throwing following error can you please help me on this make: \*\*\* No rule to make target `train’. Stop. ![Error](https://europe1.discourse-cdn.com/flex013/uploads/rasa/original/2X/2/29ad924fdee5a7992e255b7ecf438249ab7b354d.png) ---
**Author:** ![AllBecomesGood](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/allbecomesgood/32/2684_2.png) [@AllBecomesGood](https://forum.rasa.com/u/AllBecomesGood)\ **Post date:** [April 25, 2019, 11:36pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/36 "2019-04-25T23:36:34Z")
@vishnunahak23 This doesn’t work because Windows doesn’t know “make”. Instead, if you go into the file of this make command “Makefile” then you can find the following commands which can work on windows (but I recommend using anaconda cmd in windows [https://www.anaconda.com/](https://www.anaconda.com/)) example of where “make train\_nlu” goes looking for what command to execute (in Makefile): train-nlu: python -m rasa\_nlu.train -c nlu\_config.yml --data data/nlu\_data.md -o models --fixed\_model\_name nlu --project current --verbose So just run the python commands. Edit: Actually it could also be cause you execute from the data folder folder. go up a level into \starter-pack-rasa-nlu\> ---
**Author:** ![Aerosoul](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/aerosoul/32/6277_2.png) [@Aerosoul](https://forum.rasa.com/u/Aerosoul)\ **Post date:** [April 26, 2019, 1:35pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/37 "2019-04-26T13:35:58Z")
Hi, I just installed Rasa Core, NLU and had a few error messages when linking Spacy, although the command seem to end fine and said I could now link to ‘en’. However, when trying to train rasa\_nlu i get this: python -m rasa\_nlu.train -c nlu\_config.yml --data data/nlu\_data.md -o models --fixed\_model\_name nlu --project current --verbose C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\runpy.py:125: RuntimeWarning: ‘rasa\_nlu.train’ found in sys.modules after import of package ‘rasa\_nlu’, but prior to execution of ‘rasa\_nlu.train’; this may result in unpredictable behaviour warn(RuntimeWarning(msg)) 2019-04-26 15:17:54 INFO rasa\_nlu.utils.spacy\_utils - Trying to load spacy model with name ‘en’ Traceback (most recent call last): File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\runpy.py”, line 193, in \_run\_module\_as\_main “ **main** ”, mod\_spec) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\runpy.py”, line 85, in \_run\_code exec(code, run\_globals) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\train.py”, line 173, in num\_threads=cmdline\_args.num\_threads) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\train.py”, line 136, in train trainer = Trainer(nlu\_config, component\_builder) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\model.py”, line 150, in **init** self.pipeline = self.\_build\_pipeline(cfg, component\_builder) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\model.py”, line 162, in _build\_pipeline component = component\_builder.create\_component(component\_cfg, cfg) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\components.py”, line 448, in create\_component component\_config, cfg) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\registry.py”, line 186, in create\_component\_by\_config return component\_class.create(component\_config, config) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\rasa\_nlu\utils\spacy\_utils.py”, line 64, in create nlp = spacy.load(spacy\_model\_name, disable=[‘parser’]) File "C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\spacy\_init_.py", line 21, in load return util.load\_model(name, \*\*overrides) File “C:\Users\RC\AppData\Local\Continuum\anaconda3\lib\site-packages\spacy\util.py”, line 119, in load\_model raise IOError(Errors.E050.format(name=name)) OSError: [E050] Can’t find model ‘en’. It doesn’t seem to be a shortcut link, a Python package or a valid path to a data directory. Any idea how to resolve this? Thanks a ton! ---
**Author:** ![Juste](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/juste/32/15_2.png) [@Juste](https://forum.rasa.com/u/Juste)\ **Post date:** [April 26, 2019, 1:39pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/38 "2019-04-26T13:39:30Z")
Hi @Aerosoul. Are you sure the linking was successful? After installing the model, did you get the message the the model is now linked and can be loaded using ‘en’? If you get an error, then on Windows you might need to run your cmd as an administrator for the linking to actually take place ---
**Author:** ![Juste](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/juste/32/15_2.png) [@Juste](https://forum.rasa.com/u/Juste)\ **Post date:** [April 26, 2019, 1:42pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/39 "2019-04-26T13:42:06Z")
Hey @amt. Good point on the differences between the repos! They should for sure not be different. I would say bot are good ones to start - Sara (rasa demo) is a good ‘best practices’ example where the startepack is something you can take, quickly build and then change it all to build your own bot 🙂 ---
**Author:** ![Juste](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/juste/32/15_2.png) [@Juste](https://forum.rasa.com/u/Juste)\ **Post date:** [April 26, 2019, 1:43pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/40 "2019-04-26T13:43:37Z")
Hey @AllBecomesGood. Hahaha, that’s not a good thing 😃 Did you add any new stories as well? That could be the case - you need at least a few stories which would make use of the newly added intents. ---
**Author:** ![AllBecomesGood](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/allbecomesgood/32/2684_2.png) [@AllBecomesGood](https://forum.rasa.com/u/AllBecomesGood)\ **Post date:** [April 26, 2019, 2:30pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/41 "2019-04-26T14:30:12Z")
Hello to you, too @Juste ! I haven’t added new stories, that could be it! I’m trying something different now tho, I wanna build a bot that mainly asks the user questions rather than only reacting to input. I can relax the requirements by sometimes not needing to care what the user said (only that they said anything really) and then ask the next question. It’s also meant to happen in a specific order and all that confuses the heck out of my brain currently lol! I haven’t been through all tutorials yet tho, so hopefully I’ll learn more stuff that’ll help me with that ---
**Author:** ![Juste](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/juste/32/15_2.png) [@Juste](https://forum.rasa.com/u/Juste)\ **Post date:** [April 26, 2019, 2:32pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/42 "2019-04-26T14:32:30Z")
Sounds awesome! Keep us updated with your experience along the way! 🙂 ---
**Author:** ![Nasnl](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/nasnl/32/9755_2.png) [@Nasnl](https://forum.rasa.com/u/Nasnl)\ **Post date:** [April 27, 2019, 3:23pm UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/43 "2019-04-27T15:23:31Z")
I’m running into the same thing, and installing make in windows doesn’t provide a solution… it seems. Maybe I’m doing something wrong, but after installing make in windows, I get the same error. Is there something else I should do? ---
**Author:** ![Aerosoul](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/aerosoul/32/6277_2.png) [@Aerosoul](https://forum.rasa.com/u/Aerosoul)\ **Post date:** [April 29, 2019, 6:35am UTC](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903/44 "2019-04-29T06:35:08Z")
Hi, yes - I am running under Anaconda commandline and had to run under Administrator on Win to get the linking done properly. It said it had linked properly but apparently something failed. When running Anaconda commandline as Admin all works fine. Thanks! [Previous page](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903.md?page=1) [Next page](https://forum.rasa.com/t/grab-the-nlu-training-dataset/903.md?page=3)