What is the difference between the DIET Classifier and the TED policy? When I run “rasa test” I get a TEDPolicy_confusion_matrix.png and a DIETClassifier_confusion_matrix.png. The DIET Classifier matric looks more correct and reports the correct number (16) nlu examples I have but the TED Policy shows only 1s and 2s.How do I correct the TED policy confusion because adding nlu examples don’t seem to register. Am I missing something? I am using rasa 3.2.6.

You should review the Rasa architecture and docs on pipeline components vs policies. Pipeline componets are part of the NLU which predicts the intent and entities. Policies are use to predict the next step in the dialogue. You can read about the DIETClassifier here . It’s an NLU component which predicts intents and entities in a user utterance. You can read about the TEDPolicy here . It predicts the next step in the dialogue.

Thank you for your response @stephens . I have read those but they didn’t help me fix the confusion matrix. Thank you for your clarification on the difference. If the TEDPolicy is just supposed to predict the next step in dialogue then why is rasa test using it to test entity extraction and giving me a TED Policy entity confusion matrix? Is it testing entities that influence conversation? Does creating more stories help the confusion because creating more nlu examples isn’t. Are you aware of the issue I linked in my reply?

If you share you’re repo, I’ll take a look. Regarding the TED confusion matrix, I was not aware of that issue? Have you created test stories?

DIET Classifier vs TED policy

Rasa Open Source

agerami (Ava Gerami) March 30, 2023, 3:47pm 2

Everything on my TEDPolicy confusion matrix shows as no_entity and realized people are having the same issue here. TED policy test shows no output

Topic		Replies	Views
TED policy test shows no output Rasa Open Source	5	1028	March 30, 2023
Rasa.core.policies.ted_policy predicting wrong action Getting Started with Rasa	0	109	May 9, 2024
DIETClassifier not working properly Rasa Open Source	2	614	April 7, 2020
Entity Extraction Failure Feedback on Rasa Open Source entity , ted	0	350	October 7, 2022
TED Entities Recognition Rasa Open Source	1	983	August 10, 2021

DIET Classifier vs TED policy

Related topics