Hey everyone, We are working on a chatbot use case in which the data is not so clean and balanced. Our initial attempt was to try out Rasa DIET for NLU and got some decent results but the issue we identified of DIET was with false positive being inferred with very high accuracy we can reduce this by using out_of_scope intent to an extend and accuracy issues due to class imbalance. So we then tried out a custom classification model using distilled BERT with tuned class weights and the results were more generalised and better compared to DIET. Now the scenario is to use our own pytorch based Intent classifier for intent classification and rest of rasa components like entity extraction, tracker and dialogue management with RASA. The rules/story has to work based on the intent identified from the custom model instead of rasa NLU. Is there any feasible solutions for the same ? Came across an blog post [image] Enhancing Rasa NLU models with Custom Components We believe that customizing ML models is crucial for building successful AI assistants. The open source Rasa NLU library provides you with… Reading time: 8 min read

Thanks for the update @stephens

Integrating Custom Pytorch models to RASA pipeline

stephens (Greg Stephens) January 10, 2023, 5:12pm 2

Yes, you can create your own intent classifier component. I just posted about this here.

Topic		Replies	Views
ML model Rasa Open Source	6	483	June 24, 2021
Can Rasa be integrated with Custom Intent Classifier? Rasa Open Source	2	2062	September 18, 2019
Enhance rasa with a pre-trained classification model Rasa Open Source	4	2128	October 22, 2019
Pytorch classifier for Rasa 3.x Rasa Open Source	0	167	March 15, 2024
Custom nlu pipeline component Rasa Open Source	6	1886	December 8, 2021