Immediate update during interactive training

Hello all, I am new to Rasa core and it is an interesting project. Currently I encountered a problem (or confusion) when I tried to use Interactive learning.

When I gave the feedback on the errors in interactive mode, next time when I ask the same question, it will still give the wrong answer. In fact, the score of correct intent/action does not even have a big change.

My question is, does the model update on-the-fly in interactive learning mode or I have to export the stories and retrain to get an updated model?

Anyone can help me? I wondered where in the code I can see how user’s input in interactive learning mode affect the model?