I am training the NLU with a large 3 GB markdown NLU train format file. It has been 12 hours since I started the training phase, but it is stuck and filled up the resources on the machine that does not accept new ssh access. Is there consideration I should remember when training on such large files, or are there options on rasa train nlu so it would use multi-core CPU or the GPU?

Rasa nlu train with a large dataset is stuck

KamyarGhajar (Kamyar Ghajar) April 8, 2020, 7:19am 21

Hi, The stuck situation happens even with a 200MB dataset. It works with a 80MB data but 200MB makes the system stuck again on the same machine (32GB ram, 8 cores ,…)

Topic		Replies	Views
[Rasa NLU] how to train the data with GPU Rasa Open Source	5	2050	June 12, 2019
NLU training taking lot of time Rasa Open Source	12	1415	September 6, 2019
Rasa Training not completing with large NLU data [Deprecated] Rasa X Community Edition	3	748	March 25, 2022
Training Rasa NLU model on AWS EC2 p2.xlarge Instance Rasa Open Source	10	1073	November 18, 2020
How does rasa train on large data Rasa Open Source	2	399	September 13, 2022

Rasa nlu train with a large dataset is stuck

Related topics