I have a rasa project deployed to k8s cluster. In one commit I added few training phrases + intents, changed the config.yaml and updated some custom actions. I run the bot locally and it worked as expected. But when deployed to the cluster the bot fails to predict intents. The logs from the remote instance 2023-09-28 16:32:34 INFO rasa.core.processor - Loading model models/20230928-185010-spry-rubble.tar.gz... 2023-09-28 16:32:35 DEBUG rasa.engine.storage.local_model_storage - Extracted model to '/tmp/tmpa20a_qib'. /opt/venv/lib/python3.10/site-packages/rasa/shared/core/slot_mappings.py:224: UserWarning: Slot auto-fill has been removed in 3.0 and replaced with a new explicit mechanism to set slots. Please refer to https://rasa.com/docs/rasa/domain#slots to learn more. rasa.shared.utils.io.raise_warning( 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'nlu_message_converter' loading 'NLUMessageConverter.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'run_WhitespaceTokenizer0' loading 'WhitespaceTokenizer.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'run_RegexFeaturizer1' loading 'RegexFeaturizer.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.storage.local_model_storage - Resource 'train_RegexFeaturizer1' was requested for reading. 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'run_LexicalSyntacticFeaturizer2' loading 'LexicalSyntacticFeaturizer.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.storage.local_model_storage - Resource 'train_LexicalSyntacticFeaturizer2' was requested for reading. 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'run_CountVectorsFeaturizer3' loading 'CountVectorsFeaturizer.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.storage.local_model_storage - Resource 'train_CountVectorsFeaturizer3' was requested for reading. 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'run_CountVectorsFeaturizer4' loading 'CountVectorsFeaturizer.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.storage.local_model_storage - Resource 'train_CountVectorsFeaturizer4' was requested for reading. 2023-09-28 16:32:35 DEBUG rasa.engine.graph - Node 'run_DIETClassifier5' loading 'DIETClassifier.load' and kwargs: '{}'. 2023-09-28 16:32:35 DEBUG rasa.engine.storage.local_model_storage - Resource 'train_DIETClassifier5' was requested for reading. 2023-09-28 16:32:35 DEBUG rasa.utils.tensorflow.models - Loading the model from /tmp/tmpljuup8vr/train_DIETClassifier5/DIETClassifier.tf_model with finetune_mode=False... 2023-09-28 16:32:35 DEBUG rasa.nlu.classifiers.diet_classifier - Following metrics will be logged during training: 2023-09-28 16:32:35 DEBU…

There’s a recently discovered issue training on arm under 2.6 and then using the model on amd64. This seems to have been introduced in 3.6.x and does not happen with 3.5.x

Failed to load ABCMeta from model storage. Resource 'train_DIETClassifier5' doesn't exist

Topic		Replies	Views	Activity
Error loading model Rasa Open Source	0	63	April 5, 2024
Rasa.nlu.classifiers.diet_classifier Rasa Open Source	16	2783	February 8, 2021
Rasa.nlu.classifiers.diet_classifier - Failed to load model for 'ResponseSelector' Rasa Open Source	3	1724	May 18, 2021
Failed to load the component rasa Rasa Open Source	3	568	July 29, 2021
Issue while training the model using docker Rasa Open Source testing	1	38	April 24, 2024