It seems there is a new feature --auto-reload that If enabled, modules containing actions will be reloaded when an HTTP request is received. Is there a feature that does the same for the newly trained models, without needing to restart the rasa server?

Hi @teresalazar13 . I believe you are referring to this reload functionality when the actions file changes. There is not a feature for hot reloading the rasa server. Maybe you could create a feature request here and describe how you would want / expect it to work in more detail?

You can auto-reload the Rasa model! There are a few possibilities: you can use a Restful endpoint URL or e.g. Amazon S3. As soon as you update the model, the Rasa server will automatically download it. There is also a configuration option about the poll intervall that you can set when you start Rasa, so it will not spam your logs unnecessarily. See here: https://rasa.com/docs/rasa/model-storage/ If you really want a zero downtime deployment though, you need at least 2 running Rasa servers and a load-balancer in-between, as even with the auto-loading of the model, there will be a short time, until the new model is activated.

Auto-reload server

Rasa Open Source

davidbalu10 (David Barrientos) May 22, 2023, 12:35pm 3

What would be the complete command to activate the subclasses to do the reload? –auto-reload Enable auto-reloading of modules containing Action subclasses. (default: False)

Topic		Replies	Views
Restart the rasa actions server automatically whenever there is a change in actions file Rasa Open Source	4	478	November 22, 2023
Can custom action server auto reload in rasa open source version 2.8? Rasa Open Source	0	305	June 7, 2022
Can I auto reload an Alexa custom connector? Rasa Open Source	0	274	March 17, 2022
How to reload the model without restart server Rasa Open Source	3	3139	September 17, 2020
Automatically Reload the nlu model after training Rasa Open Source	1	604	September 14, 2020

Auto-reload server

Related topics