# How to split train test data using python

**URL:** <https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441>\
**Category:** Rasa Open Source\
**Created:** [October 13, 2021, 5:16am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441 "2021-10-13T05:16:21Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![SATEESH302](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sateesh302/32/17610_2.png) [@SATEESH302](https://forum.rasa.com/u/SATEESH302)\
**Post date:** [October 13, 2021, 5:16am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/1 "2021-10-13T05:16:21Z")

</div>

how to split train test data using python

---

<div class="post-metadata">

**Author:** ![nik202](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/nik202/32/16098_2.png) [@nik202](https://forum.rasa.com/u/nik202)\
**Post date:** [October 13, 2021, 5:17am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/2 "2021-10-13T05:17:11Z")

</div>

Hi and welcome to forum 💐@SATEESH302 Why you need that? is that you need for chatbot? can you elaborate more.

---

<div class="post-metadata">

**Author:** ![ChrisRahme](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/chrisrahme/32/15572_2.png) [@ChrisRahme](https://forum.rasa.com/u/ChrisRahme)\
**Post date:** [October 13, 2021, 5:19am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/3 "2021-10-13T05:19:01Z")

</div>

Welcome to the forum!

You can use `rasa data split` as mentioned in the [docs](https://rasa.com/docs/rasa/command-line-interface#rasa-data-split).

---

<div class="post-metadata">

**Author:** ![nik202](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/nik202/32/16098_2.png) [@nik202](https://forum.rasa.com/u/nik202)\
**Post date:** [October 13, 2021, 5:22am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/4 "2021-10-13T05:22:04Z")

</div>

@SATEESH302

1. It is a benchmark or recommended while training the model we consider 80:20 ratio is a standard starting point to train and test our model.

In RASA they have set the default 0.8 as mention: –training-fraction TRAINING\_FRACTION Percentage of the data which should be in the training data. (default: **0.8** )

**Reference 1:** [Testing Your Assistant](https://rasa.com/docs/rasa/testing-your-assistant#evaluating-an-nlu-model)

**Reference 2:** [https://rasa.com/docs/rasa/command-line-interface#rasa-data-splithttps://rasa.com/docs/rasa/command-line-interface#rasa-data-split](https://rasa.com/docs/rasa/command-line-interface#rasa-data-splithttps://rasa.com/docs/rasa/command-line-interface#rasa-data-split)

So, if you have enough data then you not need to worried about changing the ratio, as it’s standard and can deal with a large number of data as deep learning required.

If you further want to investigate how it works with the TensorFlow pipeline, Further, you can even see this link and read it step by step: [https://aspiresoftware.in/blog/rasa-nlu-intent-classification-using-different-pipeline/](https://aspiresoftware.in/blog/rasa-nlu-intent-classification-using-different-pipeline/) Hope it will help 🙂

---

<div class="post-metadata">

**Author:** ![SATEESH302](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sateesh302/32/17610_2.png) [@SATEESH302](https://forum.rasa.com/u/SATEESH302)\
**Post date:** [October 13, 2021, 5:22am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/5 "2021-10-13T05:22:39Z")

</div>

i want to generate that test data using python script

---

<div class="post-metadata">

**Author:** ![SATEESH302](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sateesh302/32/17610_2.png) [@SATEESH302](https://forum.rasa.com/u/SATEESH302)\
**Post date:** [October 13, 2021, 5:23am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/6 "2021-10-13T05:23:52Z")

</div>

i want to generate train test data using python script so that i need code in python

---

<div class="post-metadata">

**Author:** ![ChrisRahme](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/chrisrahme/32/15572_2.png) [@ChrisRahme](https://forum.rasa.com/u/ChrisRahme)\
**Post date:** [October 13, 2021, 5:26am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/7 "2021-10-13T05:26:01Z")

</div>

Are you asking for Rasa or in general?

---

<div class="post-metadata">

**Author:** ![SATEESH302](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sateesh302/32/17610_2.png) [@SATEESH302](https://forum.rasa.com/u/SATEESH302)\
**Post date:** [October 13, 2021, 5:27am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/8 "2021-10-13T05:27:35Z")

</div>

rasa only

---

<div class="post-metadata">

**Author:** ![ChrisRahme](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/chrisrahme/32/15572_2.png) [@ChrisRahme](https://forum.rasa.com/u/ChrisRahme)\
**Post date:** [October 13, 2021, 5:28am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/9 "2021-10-13T05:28:39Z")

</div>

Well you can run the above command from Python:

```python
import os
os.system('cmd /c "rasa data split"')

```

---

<div class="post-metadata">

**Author:** ![SATEESH302](https://dub1.discourse-cdn.com/flex013/user_avatar/forum.rasa.com/sateesh302/32/17610_2.png) [@SATEESH302](https://forum.rasa.com/u/SATEESH302)\
**Post date:** [October 13, 2021, 5:29am UTC](https://forum.rasa.com/t/how-to-split-train-test-data-using-python/48441/10 "2021-10-13T05:29:01Z")

</div>

i know that rasa split nlu command works in terminal but i want run script using python