Hi everyone , i came across this video to learn more about DIET architecture. After watching the videos i have some questions and hope to get expert to clear my doubts Link : Rasa Algorithm Whiteboard - Diet Architecture 1: How it Works - YouTube Pretrained word embedding, what is the default wording embedding if there are none is used ? How does to masking technique (with MASK token ) helps on prediction with using the mask loss ? 3.The total loss at the end of computation , how can we improve the performance by minimize the loss function value ? Sorry if those are beginner question , i am quite new to machine learning , NLP .

Question on Algorithms Whiteboard How DIET works

BELIEVEIT (TAY WEN JIE ) October 7, 2021, 6:10pm 2

Can anyone help me on those questions ?

Topic		Replies	Views
Introducing The Algorithm Whiteboard! Important Updates	8	2874	May 27, 2020
Question about how DIET processes new data Rasa Open Source	1	422	December 14, 2021
DIET Architecture - Individual Token Pathway Feedback on Rasa Open Source	4	969	November 14, 2021
DIETClassifier: Where do pretrained embeddings come from? Rasa Open Source	2	1309	July 28, 2020
DIETClassifier and Other Language Rasa Open Source	2	553	August 18, 2020