Hi, While training NLU it is consuming 100% CPU with following specs. 8 GB RAM i5 7th gen 2 GB Nvidia 940 mx I need help regarding setting up the GPU for training.

It would help us debug if you gave us detailed information about the steps that you took as well as your operating system. One thing to point out though. While DIET is able to use the GPU via tensorflow, the other components in your NLU pipeline cannot. A countvectorizer cannot run faster when there’s a GPU around and will only use a CPU. That said, the CV object is made with scikit-learn so that can only use 1 CPU core at a time. So I’m curious what else might be causing it.

Hi… from reading this, I understand CV is not viable for GPU training. Let me know, if this config pipeline components can use GPU to the fullest… language: en pipeline: name: HFTransformersNLP model_weights: “bert-base-uncased” model_name: “bert” name: LanguageModelTokenizer name: LanguageModelFeaturizer name: DIETClassifier epochs: 20 number_of_transformer_layers: 4 transformer_size: 256 use_masked_language_model: True drop_rate: 0.25 weight_sparsity: 0.7 batch_size: [64, 256] embedding_dimension: 30 hidden_layers_sizes: text: [512, 128] Will LanguageModelTokenizer, and LanguageModelFeaturizer work using GPU? Thanks in advance.

What version of Rasa are you using? The HFTransformersNLP is technically deprecated.

Rasa Version : 2.7.1 Minimum Compatible Version: 2.6.0 Rasa SDK Version : 2.7.0 Rasa X Version : None Python Version : 3.8.5 Operating System : macOS-10.15.7-x86_64-i386-64bit What to use in place of HFTransformers?

As explained on the docs , you should just be able to use the LanguageModelFeaturizer directly.

Traning NLU on GPU

Rasa Open Source

ritik872000 (Ritik Kesharwani) May 28, 2021, 11:58am 3

Hey thanks for the response but, I am not trying to set up the GPU anymore.

Topic		Replies	Views
Rasa 1.10.14 DIETClassifier takes a very long time and it's not using GPU Rasa Open Source	1	875	June 29, 2022
Rasa training on GPU Rasa Open Source	1	143	July 19, 2024
Should we install GPU for training? Rasa Open Source	15	6959	May 18, 2021
Run NLU training on multiple GPUs Rasa Open Source	6	2205	November 20, 2022
Rasa Assistent trained on CPU faster than on GPU Rasa Open Source	9	1854	January 25, 2023

Traning NLU on GPU

Related topics