Ask about Training Metrics

I wanna ask about some definition of training metrics DIET Classifiers

what is t_loss, i_acc, and e_f1? i dont know what is t, i, and e before the underscore mean

I believe t is test, i is intent, e is entity.

loss is the loss, acc is the accuracy, f1 is the F1 score.

So it’s showing you the loss, intent extraction accuracy, and entity extraction F1 score.

You can find detailed info on Rasa’s Algorithm Whiteboard.

3 Likes

t_loss is total loss I assume.

i_loss - intent loss

e_loss - entity loss

t_loss = i_loss + e_loss + mask_loss

i_acc - intent accuracy

e_f1 - f1 score calculated on entity identification

Ref: https://arxiv.org/pdf/2004.09936.pdf

2 Likes

thank you very much @lis

1 Like