I have a NVIDIA Quadro P520 on my laptop and I would like to take advantage of that when training my rasa model (rasa train). How can I enable GPU/CUDA for an existing rasa project? I am using 2.5.0
Rasa should automatically use your GPU during training. You should be able to check that your GPU is visible and that it is handling the job by using the
nvidia-smi tool from the command line. https://developer.download.nvidia.com/compute/DCGM/docs/nvidia-smi-367.38.pdf
This will show your GPU if available and then during training, you’ll see the memory utilization increase.
This blog post may be helpful.
Yeah I did the nvidia-smi while training the rasa model and it only showed my available GPU but no utilization at all. So for some reason, Rasa is not automatically training on GPU while it is available.