Incremental Training [Experimental]

Announcements Important Updates
#1

Hey Rasa @community

We’re excited to announce the release of incremental training, a new experimental feature shipped in Rasa Open Source 2.2.0. This has been a frequently-requested feature by our community, and we’re excited for you to try it out!

:speedboat: Incremental training allows you to fine-tune an existing model after adding new training examples instead of training a new model from scratch. This cuts down training time significantly, reducing the time between annotating new data and testing its impact on model performance. Teams practicing conversation-driven development (CDD) benefit from greater efficiency, faster experimentation, and fewer bottlenecks.

For more details and information on How to Get Started with Incremental Training including code snippets, check out our latest blog post:

:speech_balloon: As it’s still an experimental feature, and we need your help testing and refining this feature based on your feedback. If you’ve tried incremental training, let us know how it performed on your data set. We’d particularly like to know how training times compared when fine-tuning vs training from scratch, as well as how the fine-tuned model performed. Let us know below! :slight_smile:

10 Likes
Do I need to train after each change?
#2

FAQs

Does incremental training replace training from scratch?

In short, incremental training supplements training from scratch, but it isn’t intended to replace it. Incremental training is a fast way to incorporate new data, but we recommend periodically training your production model from scratch to get the full benefit of longer training time.

It’s important to note that incremental training can only be performed when updates are limited to adding new NLU training examples to existing intents. Other changes, like adding or merging intents, creating a new entity, or adding slots and actions to the domain, require training from scratch.

Which model configuration settings do I need to consider?

Incremental training requires the base model to be the same shape and size as the fine-tuned model. Aside from epoch, you should keep your model configuration the same when creating your base model and performing incremental training.

In addition, there are a few extra hyperparameters you should add to your config.yml file if you use RegexFeaturizer or CountVectorsFeaturizer (follow the links for more details in the docs). These additional hyperparameters ensure that the sparse features are of a fixed size between the base and fine-tuned models.

How does the performance of a fine-tuned model compare to training from scratch?

Our early experiments have shown that the performance of a fine-tuned model is very close to the performance of a model trained from scratch. For teams who do frequent annotation and testing, a fine-tuned model provides an accurate representation of how a production model would perform with the new data.

To learn more about our benchmarking experiments and get a deep dive into the inner workings of incremental training, check out our latest Algorithm Whiteboard video.

#3

Great stuff! Really nice.

Question: is the model exactly the same in both versions of training? So if you train incrementally in a few steps, is the end result the same as when you would train all over again?

I assume it’s not considering the description about replacement, but just to make sure… :slight_smile:

Could you indicate how the models differ?

#4

@Nasnl The model architecture would be exactly the same, but the learnt model weights would differ. However, as the post mentions the performance of the two models should be comparable to each other.

2 Likes
#5

Thanks for the explanation @dakshvar22!

#6

Hi , I went through the incremental training white board at Rasa Algorithm Whiteboard - Incremental Training - YouTube They only speak about keeping some wiggle room for inputs (sparse features) but how are they handling the new classes/label on the output side. will they also keep some kind of empty spaces to accommodate new classes or the pertained models dose not consider the previous output layer?