Intent recognition extremely low how to improve?

I highly suggest using Tensorboard (see this post to learn more).

Any reason you’re using this particular pipeline? Why not use DIET?