URGENT: Connetions problems with socketio channel and SANIC_WORKERS > 1

MantasLukauskas · July 27, 2023, 6:29am

Hello everyone,

When rasa is used with socketio channel and SANIC_WORKERS=2, socket io clients have connection problems. Duplicate connections and disconnections happen. Interesting that everything works fine on Windows, but on Linux, errors start to occur. On the client side we can see:

widget.js:6758 POST http://localhost:5005/socket.io/?EIO=4&transport=polling&t=OcL_h9e&sid=xtIDyCqZVl0MWzwsAADK 400 (Bad Request) widget.js:6934 WebSocket connection to ‘ws://localhost:5005/socket.io/?EIO=4&transport=websocket&sid=s-7paZeeXVE8COadAABe’ failed:

rasa 3.6.0 redis:lastest with default configs

In both Windows and Linux using same Rasa code, same Redis looks like related with the multiprocessing on the Linux and Windows.

With REST calls everything works fine also

credentials

socketio: 
   user_message_evt: user_uttered
   bot_message_evt: bot_uttered
   session_persistence: true

endpoints:

lock_store:
    type: "redis"
    url: localhost
    port: 6379
    password:

arnasd · July 27, 2023, 7:39am

Up, I am interested as well, have same issue

MantasLukauskas · July 27, 2023, 9:02am

UPDATE: tried Nginx as the load balancer, and now I see chat around 50 percent of the time, so it looks like the problem is related to the wrong worker selected in the Rasa server call by WebSocket.

arnasd · August 1, 2023, 1:38pm

@anoopshrma maybe you could help us out here?

anoopshrma · August 2, 2023, 7:28am

Hi @arnasd @MantasLukauskas

Interesting problem!

One problem that I could think of is:

Each workers are having their own In Memory tracker stores when you are instantiating 2 workers. Now you want the workers to be in sync which is difficult if they have their own tracker stores. I would suggest you have a tracker store [ Either Redis or Mongo ] as it would work as a centre point for all the conversation of all the workers.

Please try this and let me know!

MantasLukauskas · August 2, 2023, 7:42am

I am using the tracker store Redis, and even with it, I have the same problem here endpoints:

tracker_store:
    type: redis
    url: localhost
    port: 6379
    db: 0

lock_store:
    type: "redis"
    url: localhost
    port: 6379

anoopshrma · August 2, 2023, 10:28am

I see, Can you share the error log if you get any, That will help to gain better insight on this

MantasLukauskas · August 3, 2023, 4:04am

@anoopshrma Ok, here is one more piece of information maybe that will help to understand the problem better, or maybe you know someone who can also help us here to find the solution

The problem that is it starts to connect and disconnect the chat (in this example, one chat opened).

We tried this one in Kubernetes but had the same result: all-time connect and disconnect.

As mentioned earlier, on Windows everything works, but Windows has different multiprocessing, where Windows uses threads for multiprocess, and Linux uses process forking. It is possible to see the difference as well in model loading Windows load the model one time, then Linux load models 2 times for each worker, so there is quite a big difference that maybe can have some impact on the problem.

In Redis, it is visible that a lock and tracker were created, so it looks like the connection with Redis is OK. Also, with the same script/ Rasa code but parameter SANIC_WORKER = 1, everything works just fine, even if the Redis is included as a tracker store and lock store.

credentials.yml:

socketio:
  user_message_evt: user_uttered
  bot_message_evt: bot_uttered
  session_persistence: true
  metadata_key: customData

Front-end connection For front-end connection we use standard Rasa code:

<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="UTF-8">
    <title>Title</title>
</head>
<body>
  <div id="rasa-chat-widget" data-websocket-url="http://localhost:5005/socket.io"></div>
  <script src="https://unpkg.com/@rasahq/rasa-chat" type="application/javascript"></script>
</body>
</html>

Debug log of the Rasa:

(rasa) mantaslukauskas@Mantass-MacBook-Pro-2 rasa % SANIC_WORKERS=2 rasa run --enable-api --cors "*" --debug

/Users/mantaslukauskas/Desktop/env/rasa/lib/python3.10/site-packages/rasa/core/tracker_store.py:1042: MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings.  Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
  Base: DeclarativeMeta = declarative_base()
<frozen importlib._bootstrap>:283: DeprecationWarning: the load_module() method is deprecated and slated for removal in Python 3.12; use exec_module() instead
2023-08-03 06:46:11 DEBUG    rasa.cli.utils  - Parameter 'credentials' not set. Using default location 'credentials.yml' instead.
/Users/mantaslukauskas/Desktop/env/rasa/lib/python3.10/site-packages/sanic_cors/extension.py:39: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
  SANIC_VERSION = LooseVersion(sanic_version)
/Users/mantaslukauskas/Desktop/env/rasa/lib/python3.10/site-packages/future/standard_library/__init__.py:65: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses
  import imp
2023-08-03 06:46:18 DEBUG    h5py._conv  - Creating converter from 7 to 5
2023-08-03 06:46:18 DEBUG    h5py._conv  - Creating converter from 5 to 7
2023-08-03 06:46:18 DEBUG    h5py._conv  - Creating converter from 7 to 5
2023-08-03 06:46:18 DEBUG    h5py._conv  - Creating converter from 5 to 7
2023-08-03 06:46:27 DEBUG    rasa.core.utils  - Available web server routes:
/conversations/<conversation_id:path>/messages     POST                           add_message
/conversations/<conversation_id:path>/tracker/events POST                           append_events
/webhooks/rest                                     GET                            custom_webhook_RestInput.health
/webhooks/rest/webhook                             POST                           custom_webhook_RestInput.receive
/model/test/intents                                POST                           evaluate_intents
/model/test/stories                                POST                           evaluate_stories
/conversations/<conversation_id:path>/execute      POST                           execute_action
/domain                                            GET                            get_domain
/socket.io                                         GET                            handle_request
/                                                  GET                            hello
/model                                             PUT                            load_model
/model/parse                                       POST                           parse
/conversations/<conversation_id:path>/predict      POST                           predict
/conversations/<conversation_id:path>/tracker/events PUT                            replace_events
/conversations/<conversation_id:path>/story        GET                            retrieve_story
/conversations/<conversation_id:path>/tracker      GET                            retrieve_tracker
/webhooks/socketio                                 GET                            socketio_webhook.health
/status                                            GET                            status
/model/predict                                     POST                           tracker_predict
/model/train                                       POST                           train
/conversations/<conversation_id:path>/trigger_intent POST                           trigger_intent
/model                                             DELETE                         unload_model
/version                                           GET                            version
2023-08-03 06:46:27 INFO     root  - Starting Rasa server on http://0.0.0.0:5005
2023-08-03 06:46:27 DEBUG    rasa.core.utils  - Using 2 Sanic workers.
2023-08-03 06:46:28 DEBUG    urllib3.connectionpool  - Starting new HTTPS connection (1): api.segment.io:443
2023-08-03 06:46:29 DEBUG    urllib3.connectionpool  - https://api.segment.io:443 "POST /v1/track HTTP/1.1" 200 21
2023-08-03 06:46:29 DEBUG    rasa.core.tracker_store  - Connected to RedisTrackerStore.
2023-08-03 06:46:29 DEBUG    rasa.core.tracker_store  - Connected to RedisTrackerStore.
2023-08-03 06:46:29 DEBUG    rasa.core.lock_store  - Connected to lock store 'RedisLockStore'.
2023-08-03 06:46:29 DEBUG    rasa.core.lock_store  - Connected to lock store 'RedisLockStore'.
2023-08-03 06:46:29 DEBUG    rasa.core.nlg.generator  - Instantiated NLG to 'TemplatedNaturalLanguageGenerator'.
2023-08-03 06:46:29 DEBUG    rasa.core.nlg.generator  - Instantiated NLG to 'TemplatedNaturalLanguageGenerator'.
2023-08-03 06:46:29 INFO     rasa.core.processor  - Loading model models/20230727-122239-faded-echelon.tar.gz...
2023-08-03 06:46:29 INFO     rasa.core.processor  - Loading model models/20230727-122239-faded-echelon.tar.gz...
2023-08-03 06:46:29 DEBUG    rasa.engine.storage.local_model_storage  - Extracted model to '/var/folders/lg/rd841kzx7p5dsjb9jntz8dq80000gn/T/tmpvkboyx2w'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'nlu_message_converter' loading 'NLUMessageConverter.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_translation.GoogleTranslateComponent0' loading 'GoogleTranslateComponent.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_WhitespaceTokenizer1' loading 'WhitespaceTokenizer.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.storage.local_model_storage  - Extracted model to '/var/folders/lg/rd841kzx7p5dsjb9jntz8dq80000gn/T/tmpewksdfmc'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_RegexFeaturizer2' loading 'RegexFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_RegexFeaturizer2' was requested for reading.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_LexicalSyntacticFeaturizer3' loading 'LexicalSyntacticFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_LexicalSyntacticFeaturizer3' was requested for reading.
/Users/mantaslukauskas/Desktop/env/rasa/lib/python3.10/site-packages/rasa/shared/core/slot_mappings.py:224: UserWarning: Slot auto-fill has been removed in 3.0 and replaced with a new explicit mechanism to set slots. Please refer to https://rasa.com/docs/rasa/domain#slots to learn more.
  rasa.shared.utils.io.raise_warning(
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_CountVectorsFeaturizer4' loading 'CountVectorsFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_CountVectorsFeaturizer4' was requested for reading.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'nlu_message_converter' loading 'NLUMessageConverter.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_translation.GoogleTranslateComponent0' loading 'GoogleTranslateComponent.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_WhitespaceTokenizer1' loading 'WhitespaceTokenizer.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.graph  - Node 'run_CountVectorsFeaturizer5' loading 'CountVectorsFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:29 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_CountVectorsFeaturizer5' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.engine.graph  - Node 'run_RegexFeaturizer2' loading 'RegexFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:30 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_RegexFeaturizer2' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.engine.graph  - Node 'run_LexicalSyntacticFeaturizer3' loading 'LexicalSyntacticFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:30 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_LexicalSyntacticFeaturizer3' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.engine.graph  - Node 'run_DIETClassifier6' loading 'DIETClassifier.load' and kwargs: '{}'.
2023-08-03 06:46:30 DEBUG    rasa.engine.graph  - Node 'run_CountVectorsFeaturizer4' loading 'CountVectorsFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:30 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_DIETClassifier6' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_CountVectorsFeaturizer4' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.engine.graph  - Node 'run_CountVectorsFeaturizer5' loading 'CountVectorsFeaturizer.load' and kwargs: '{}'.
2023-08-03 06:46:30 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_CountVectorsFeaturizer5' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.utils.tensorflow.models  - Loading the model from /var/folders/lg/rd841kzx7p5dsjb9jntz8dq80000gn/T/tmpwiwudn9v/train_DIETClassifier6/DIETClassifier.tf_model with finetune_mode=False...
2023-08-03 06:46:30 DEBUG    rasa.engine.graph  - Node 'run_DIETClassifier6' loading 'DIETClassifier.load' and kwargs: '{}'.
2023-08-03 06:46:30 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_DIETClassifier6' was requested for reading.
2023-08-03 06:46:30 DEBUG    rasa.utils.tensorflow.models  - Loading the model from /var/folders/lg/rd841kzx7p5dsjb9jntz8dq80000gn/T/tmp95vqtyn_/train_DIETClassifier6/DIETClassifier.tf_model with finetune_mode=False...
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  - Following metrics will be logged during training:
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  - Following metrics will be logged during training:
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   t_loss (total loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   t_loss (total loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   i_acc (intent acc)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   i_acc (intent acc)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   i_loss (intent loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   i_loss (intent loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   e_f1 (entity f1)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   e_f1 (entity f1)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   e_loss (entity loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   e_loss (entity loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   r_f1 (role f1)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   r_f1 (role f1)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   r_loss (role loss)
2023-08-03 06:46:30 DEBUG    rasa.nlu.classifiers.diet_classifier  -   r_loss (role loss)
2023-08-03 06:47:24 DEBUG    rasa.utils.tensorflow.models  - Finished loading the model.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_CRFEntityExtractor7' loading 'CRFEntityExtractor.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_CRFEntityExtractor7' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.utils.tensorflow.models  - Finished loading the model.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_CRFEntityExtractor7' loading 'CRFEntityExtractor.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_CRFEntityExtractor7' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_EntitySynonymMapper8' loading 'EntitySynonymMapper.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_EntitySynonymMapper8' loading 'EntitySynonymMapper.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_EntitySynonymMapper8' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_EntitySynonymMapper8' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_ResponseSelector9' loading 'ResponseSelector.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_ResponseSelector9' loading 'ResponseSelector.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_ResponseSelector9' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_ResponseSelector9' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.nlu.classifiers.diet_classifier  - Failed to load ABCMeta from model storage. Resource 'train_ResponseSelector9' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.nlu.classifiers.diet_classifier  - Failed to load ABCMeta from model storage. Resource 'train_ResponseSelector9' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_ResponseSelector9' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_ResponseSelector9' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.nlu.selectors.response_selector  - Failed to load ResponseSelector from model storage. Resource 'train_ResponseSelector9' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.nlu.selectors.response_selector  - Failed to load ResponseSelector from model storage. Resource 'train_ResponseSelector9' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_FallbackClassifier10' loading 'FallbackClassifier.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_FallbackClassifier10' loading 'FallbackClassifier.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_RegexMessageHandler' loading 'RegexMessageHandler.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_RegexMessageHandler' loading 'RegexMessageHandler.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'domain_provider' loading 'DomainProvider.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'domain_provider' loading 'DomainProvider.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'domain_provider' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'domain_provider' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_intent_policy.MyCustomPolicy0' loading 'MyCustomPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_intent_policy.MyCustomPolicy0' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_intent_policy.MyCustomPolicy0' loading 'MyCustomPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_intent_policy.MyCustomPolicy0' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.core.policies.policy  - Couldn't load metadata for policy 'MyCustomPolicy' as the persisted metadata couldn't be loaded.
2023-08-03 06:47:24 DEBUG    rasa.core.policies.policy  - Couldn't load metadata for policy 'MyCustomPolicy' as the persisted metadata couldn't be loaded.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_MemoizationPolicy1' loading 'MemoizationPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_MemoizationPolicy1' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_MemoizationPolicy1' loading 'MemoizationPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_MemoizationPolicy1' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_UnexpecTEDIntentPolicy2' loading 'UnexpecTEDIntentPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_UnexpecTEDIntentPolicy2' loading 'UnexpecTEDIntentPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_UnexpecTEDIntentPolicy2' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_UnexpecTEDIntentPolicy2' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.core.policies.ted_policy  - Failed to load ABCMeta from model storage. Resource 'train_UnexpecTEDIntentPolicy2' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.core.policies.ted_policy  - Failed to load ABCMeta from model storage. Resource 'train_UnexpecTEDIntentPolicy2' doesn't exist.
2023-08-03 06:47:24 WARNING  rasa.shared.utils.common  - The UnexpecTED Intent Policy is currently experimental and might change or be removed in the future   Please share your feedback on it in the forum (https://forum.rasa.com) to help us make this feature ready for production.
2023-08-03 06:47:24 WARNING  rasa.shared.utils.common  - The UnexpecTED Intent Policy is currently experimental and might change or be removed in the future   Please share your feedback on it in the forum (https://forum.rasa.com) to help us make this feature ready for production.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_TEDPolicy3' loading 'TEDPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_TEDPolicy3' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_TEDPolicy3' loading 'TEDPolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.core.policies.ted_policy  - Failed to load ABCMeta from model storage. Resource 'train_TEDPolicy3' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_TEDPolicy3' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_RulePolicy4' loading 'RulePolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_RulePolicy4' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.core.policies.ted_policy  - Failed to load ABCMeta from model storage. Resource 'train_TEDPolicy3' doesn't exist.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'run_RulePolicy4' loading 'RulePolicy.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_RulePolicy4' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'rule_only_data_provider' loading 'RuleOnlyDataProvider.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_RulePolicy4' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'rule_only_data_provider' loading 'RuleOnlyDataProvider.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'select_prediction' loading 'DefaultPolicyPredictionEnsemble.load' and kwargs: '{}'.
2023-08-03 06:47:24 DEBUG    rasa.engine.storage.local_model_storage  - Resource 'train_RulePolicy4' was requested for reading.
2023-08-03 06:47:24 DEBUG    rasa.engine.graph  - Node 'select_prediction' loading 'DefaultPolicyPredictionEnsemble.load' and kwargs: '{}'.
2023-08-03 06:47:24 INFO     root  - Rasa server is up and running.
2023-08-03 06:47:24 INFO     root  - Rasa server is up and running.
2023-08-03 06:47:24 INFO     root  - Enabling coroutine debugging. Loop id 140456026439696.
2023-08-03 06:47:24 INFO     root  - Enabling coroutine debugging. Loop id 140456026439696.
2023-08-03 06:47:57 DEBUG    rasa.core.channels.socketio  - User jqyp0JIpXMvCBlNkAAAB connected to socketIO endpoint.
2023-08-03 06:47:57 DEBUG    rasa.core.channels.socketio  - User jqyp0JIpXMvCBlNkAAAB connected to socketIO endpoint.
Invalid session Nj5dvtmlCwZzckBwAAAA (further occurrences of this error will be logged with level INFO)
2023-08-03 06:48:02 DEBUG    rasa.core.channels.socketio  - User jqyp0JIpXMvCBlNkAAAB disconnected from socketIO endpoint.
2023-08-03 06:48:02 DEBUG    rasa.core.channels.socketio  - User qiO3VcndTVcvw2ozAAAD connected to socketIO endpoint.
2023-08-03 06:48:02 DEBUG    rasa.core.channels.socketio  - User qiO3VcndTVcvw2ozAAAD connected to socketIO endpoint.
2023-08-03 06:48:07 DEBUG    rasa.core.channels.socketio  - User qiO3VcndTVcvw2ozAAAD disconnected from socketIO endpoint.
2023-08-03 06:48:09 DEBUG    rasa.core.channels.socketio  - User R4W9M_x1cLTHwMn-AAAF connected to socketIO endpoint.
Invalid session QZeJgNzXzBNqijj3AAAA (further occurrences of this error will be logged with level INFO)
2023-08-03 06:48:10 DEBUG    rasa.core.channels.socketio  - User IgG7LX2uaSUx3kRWAAAB connected to socketIO endpoint.
2023-08-03 06:48:10 DEBUG    rasa.core.channels.socketio  - User IgG7LX2uaSUx3kRWAAAB disconnected from socketIO endpoint.
2023-08-03 06:48:11 DEBUG    rasa.core.channels.socketio  - User _FZLs9_dWiNRlSpcAAAD connected to socketIO endpoint.
2023-08-03 06:48:11 DEBUG    rasa.core.channels.socketio  - User _FZLs9_dWiNRlSpcAAAD disconnected from socketIO endpoint.
2023-08-03 06:48:12 DEBUG    rasa.core.channels.socketio  - User i4ZCQ9liX8-oQg7rAAAF connected to socketIO endpoint.
2023-08-03 06:48:13 DEBUG    rasa.core.channels.socketio  - User We5gbEiPZetTIaOfAAAH connected to socketIO endpoint.
2023-08-03 06:48:13 DEBUG    rasa.core.channels.socketio  - User 93xY_YbLPN9WzPcCAAAH connected to socketIO endpoint.
2023-08-03 06:48:14 DEBUG    rasa.core.channels.socketio  - User lGWwd_O9MRKteadwAAAJ connected to socketIO endpoint.
2023-08-03 06:48:15 DEBUG    rasa.core.channels.socketio  - User i54bSIcb9H2QcgcRAAAJ connected to socketIO endpoint.
2023-08-03 06:48:16 DEBUG    rasa.core.channels.socketio  - User a7p_ZiICUrzst4nMAAAL connected to socketIO endpoint.
2023-08-03 06:48:17 DEBUG    rasa.core.channels.socketio  - User S2_bCk4GzrOsDRIzAAAL connected to socketIO endpoint.
2023-08-03 06:48:18 DEBUG    rasa.core.channels.socketio  - User AWJluF-LDICUU5XCAAAN connected to socketIO endpoint.
2023-08-03 06:48:19 DEBUG    rasa.core.channels.socketio  - User 0IaWlaZZBppzHJR8AAAN connected to socketIO endpoint.
2023-08-03 06:48:19 DEBUG    rasa.core.channels.socketio  - User 0IaWlaZZBppzHJR8AAAN disconnected from socketIO endpoint.
2023-08-03 06:48:20 DEBUG    rasa.core.channels.socketio  - User NbhlxQ2yhPd9XW9mAAAP connected to socketIO endpoint.
2023-08-03 06:48:21 DEBUG    rasa.core.channels.socketio  - User 03EWW8-w2A3aANoxAAAP connected to socketIO endpoint.
2023-08-03 06:48:22 DEBUG    rasa.core.channels.socketio  - User pjh6Z4AvjqKLifduAAAR connected to socketIO endpoint.
2023-08-03 06:48:22 DEBUG    rasa.core.channels.socketio  - User pjh6Z4AvjqKLifduAAAR disconnected from socketIO endpoint.
2023-08-03 06:48:23 DEBUG    rasa.core.channels.socketio  - User rq7fpzQbo_5rZiX4AAAT connected to socketIO endpoint.
2023-08-03 06:48:23 DEBUG    rasa.core.channels.socketio  - User rq7fpzQbo_5rZiX4AAAT disconnected from socketIO endpoint.
2023-08-03 06:48:25 DEBUG    rasa.core.channels.socketio  - User ypUZY_VgazqV-mBnAAAV connected to socketIO endpoint.
2023-08-03 06:48:26 DEBUG    rasa.core.channels.socketio  - User f3-M21LC9Hwvm_KVAAAR connected to socketIO endpoint.
2023-08-03 06:48:26 DEBUG    rasa.core.channels.socketio  - User f3-M21LC9Hwvm_KVAAAR disconnected from socketIO endpoint.
2023-08-03 06:48:27 DEBUG    rasa.core.channels.socketio  - User DHNE85cj2wC_Q88KAAAT connected to socketIO endpoint.
2023-08-03 06:48:27 DEBUG    rasa.core.channels.socketio  - User DHNE85cj2wC_Q88KAAAT disconnected from socketIO endpoint.

arnasd · August 7, 2023, 12:44pm

Hey @Horizon733, sorry for pinging you here, but we really want to solve this somehow. Maybe you would be able to help us out?

Topic		Replies	Views
Connetions problems with socketio channel and SANIC_WORKERS > 1 Rasa Open Source	1	403	September 16, 2020
Socket Channel not working in rasa 3.1.0 Rasa Open Source	4	2550	September 6, 2022
Socket IO [ERROR] Exception occurred while handling uri: 'ws://localhost:5005/socket.io/?EIO=4&transport=websocket&sid=HKjcsdx8bMAgyrYaAAAC' Rasa Open Source	0	1770	January 26, 2022
Nobody Using Rasa 3.1 and above with SocketIO, Websockets? Rasa Open Source	2	366	October 17, 2023
Rasa 3 socket.io not working Rasa Open Source	20	2759	April 11, 2023

URGENT: Connetions problems with socketio channel and SANIC_WORKERS > 1

Related topics