# Rasa-nlu-benchmark: Collection of dataset and corresponding benchmark for Rasa NLU **URL:** \ **Category:** Rasa Open Source\ **Created:** [July 26, 2019, 2:24am UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564 "2019-07-26T02:24:29Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![nghuyong](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/nghuyong/32/4035_2.png) [@nghuyong](https://forum.rasa.com/u/nghuyong)\ **Post date:** [July 26, 2019, 2:24am UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564/1 "2019-07-26T02:24:29Z")
Project link : [GitHub - nghuyong/rasa-nlu-benchmark: Collection of dataset and corresponding benchmark for Rasa NLU](https://github.com/nghuyong/rasa-nlu-benchmark) Rasa NLU is a powerful and open-source natural language processing tool for intent classification and entity extraction in chatbots. However, we found that there is no published public dataset and the corresponding benchmark. This makes it difficult to evaluate the performance of our own NLU system built by Rasa. Therefore, we do a project aims to collect and organize datasets and baselines for Task-Oriented Dialogue, which will be in the [data format](https://rasa.com/docs/rasa/nlu/training-data-format/) required by Rasa NLU and you can directly use them in your Rasa NLU system. Welcome to star and contribute together~ ---
**Author:** ![MetcalfeTom](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/metcalfetom/32/1422_2.png) [@MetcalfeTom](https://forum.rasa.com/u/MetcalfeTom)\ **Post date:** [July 26, 2019, 8:22am UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564/2 "2019-07-26T08:22:17Z")
Wow! Amazing work @nghuyong! I’m interested the see the supervised embeddings achieving a fairly high accuracy with low amounts of data (on `AskUbuntuCorpus`) - actually, I’d request you run these datasets under the [NLU model comparison script](https://rasa.com/docs/rasa/user-guide/evaluating-models/#comparing-nlu-pipelines) and report on how well the models perform on these datasets with different occlusions! The script would make some informative graphs for the repository as well. I hope you know about the [Rasa contributor program too](https://rasa.com/community/contribute/). I believe this warrants a reward 🙂 ---
**Author:** ![nghuyong](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/nghuyong/32/4035_2.png) [@nghuyong](https://forum.rasa.com/u/nghuyong)\ **Post date:** [July 26, 2019, 8:39am UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564/3 "2019-07-26T08:39:36Z")
Thanks，I will add experiments and report how well the models perform on these datasets with different occlusions! And you mean, this work can contribute to rasa rep ? ---
**Author:** ![MetcalfeTom](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/metcalfetom/32/1422_2.png) [@MetcalfeTom](https://forum.rasa.com/u/MetcalfeTom)\ **Post date:** [July 26, 2019, 2:00pm UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564/4 "2019-07-26T14:00:33Z")
Well it’s not a direct contribution to the Github repo, but we consider it a contribution since you put in the work to help other Rasa Community members 🙂 we love to see these kinds of projects. ---
**Author:** ![nghuyong](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/nghuyong/32/4035_2.png) [@nghuyong](https://forum.rasa.com/u/nghuyong)\ **Post date:** [July 27, 2019, 1:30pm UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564/5 "2019-07-27T13:30:47Z")
We have added the Comparing NLU Pipelines experiments~ > **[GitHub - nghuyong/rasa-nlu-benchmark: Collection of dataset and corresponding...](https://github.com/nghuyong/rasa-nlu-benchmark#result)** > > Collection of dataset and corresponding benchmark for Rasa NLU - GitHub - nghuyong/rasa-nlu-benchmark: Collection of dataset and corresponding benchmark for Rasa NLU ---
**Author:** ![tuxalket](https://avatars.discourse-cdn.com/v4/letter/t/85f322/32.png) [@tuxalket](https://forum.rasa.com/u/tuxalket)\ **Post date:** [April 2, 2020, 9:04am UTC](https://forum.rasa.com/t/rasa-nlu-benchmark-collection-of-dataset-and-corresponding-benchmark-for-rasa-nlu/13564/6 "2020-04-02T09:04:04Z")
Hello i am trying to do some benchmark of my dataset, but i do not know how to set the number of data that rasa uses for the benchmark. i did a split of my data. thanks