Issue while training the model using docker

Hi @nik202

I am facing issue while training the model in linux:

Getting error as raise GraphComponentException( rasa.engine.exceptions.GraphComponentException: Error running after hook for node ‘train_DIETClassifier5’.

Epochs: 100%|████████████████████████████████████████████| 100/100 [02:22<00:00, 1.42s/it, t_loss=2.16, i_loss=1.18, e_loss=0.0888, i_acc=0.999, e_f1=0.571] 2024-04-24 08:58:51 DEBUG rasa.engine.storage.local_model_storage - Resource ‘train_DIETClassifier5’ was requested for writing. 2024-04-24 08:58:51 DEBUG rasa.engine.storage.local_model_storage - Resource ‘train_DIETClassifier5’ was persisted. 2024-04-24 08:58:51 DEBUG rasa.engine.graph - Hook ‘LoggingHook.on_after_node’ running for node ‘train_DIETClassifier5’. 2024-04-24 08:58:51 INFO rasa.engine.training.hooks - Finished training component ‘DIETClassifier’. 2024-04-24 08:58:51 DEBUG rasa.engine.graph - Hook ‘TrainingHook.on_after_node’ running for node ‘train_DIETClassifier5’. 2024-04-24 08:58:51 DEBUG rasa.engine.training.hooks - Caching ‘Resource’ with fingerprint_key: ‘b7dd109521630b14981bc7577ed3bf0e’ and output_fingerprint ‘51c12a53b5ea42318606e097b594f76b’. 2024-04-24 08:58:51 DEBUG rasa.engine.storage.local_model_storage - Resource ‘train_DIETClassifier5’ was requested for reading. 2024-04-24 08:58:51 DEBUG rasa.engine.caching - Caching output of type ‘Resource’ succeeded. 2024-04-24 08:58:51 DEBUG urllib3.connectionpool - Starting new HTTPS connection (1): o251570.ingest.sentry.io:443 Traceback (most recent call last): File “/usr/local/lib/python3.10/dist-packages/rasa/engine/graph.py”, line 523, in _run_after_hooks hook.on_after_node( File “/usr/local/lib/python3.10/dist-packages/rasa/engine/training/hooks.py”, line 77, in on_after_node self._cache.cache_output( File “/usr/local/lib/python3.10/dist-packages/rasa/engine/caching.py”, line 270, in cache_output cache_dir, output_type = self._cache_output_to_disk(output, model_storage) File “/usr/local/lib/python3.10/dist-packages/rasa/engine/caching.py”, line 344, in _cache_output_to_disk self._drop_least_recently_used_item() File “/usr/local/lib/python3.10/dist-packages/rasa/engine/caching.py”, line 364, in _drop_least_recently_used_item self._delete_cached_result(oldest_cache_item) File “/usr/local/lib/python3.10/dist-packages/rasa/engine/caching.py”, line 255, in _delete_cached_result shutil.rmtree(entry.result_location) File “/usr/lib/python3.10/shutil.py”, line 725, in rmtree _rmtree_safe_fd(fd, path, onerror) File “/usr/lib/python3.10/shutil.py”, line 681, in _rmtree_safe_fd onerror(os.unlink, fullname, sys.exc_info()) File “/usr/lib/python3.10/shutil.py”, line 679, in _rmtree_safe_fd os.unlink(entry.name, dir_fd=topfd) PermissionError: [Errno 13] Permission denied: ‘DIETClassifier.data_example.pkl’

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File “/usr/local/bin/rasa”, line 8, in sys.exit(main()) File “/usr/local/lib/python3.10/dist-packages/rasa/main.py”, line 133, in main cmdline_arguments.func(cmdline_arguments) File “/usr/local/lib/python3.10/dist-packages/rasa/cli/train.py”, line 61, in train_parser.set_defaults(func=lambda args: run_training(args, can_exit=True)) File “/usr/local/lib/python3.10/dist-packages/rasa/cli/train.py”, line 101, in run_training training_result = train_all( File “/usr/local/lib/python3.10/dist-packages/rasa/api.py”, line 105, in train return train( File “/usr/local/lib/python3.10/dist-packages/rasa/model_training.py”, line 207, in train return _train_graph( File “/usr/local/lib/python3.10/dist-packages/rasa/model_training.py”, line 286, in _train_graph trainer.train( File “/usr/local/lib/python3.10/dist-packages/rasa/engine/training/graph_trainer.py”, line 105, in train graph_runner.run(inputs={PLACEHOLDER_IMPORTER: importer}) File “/usr/local/lib/python3.10/dist-packages/rasa/engine/runner/dask.py”, line 101, in run dask_result = dask.get(run_graph, run_targets) File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 557, in get_sync return get_async( File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 500, in get_async for key, res_info, failed in queue_get(queue).result(): File “/usr/lib/python3.10/concurrent/futures/_base.py”, line 451, in result return self.__get_result() File “/usr/lib/python3.10/concurrent/futures/_base.py”, line 403, in __get_result raise self._exception File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 542, in submit fut.set_result(fn(*args, **kwargs)) File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 238, in batch_execute_tasks return [execute_task(*a) for a in it] File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 238, in return [execute_task(a) for a in it] File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 229, in execute_task result = pack_exception(e, dumps) File “/usr/local/lib/python3.10/dist-packages/dask/local.py”, line 224, in execute_task result = _execute_task(task, data) File “/usr/local/lib/python3.10/dist-packages/dask/core.py”, line 119, in _execute_task return func((_execute_task(a, cache) for a in args)) File “/usr/local/lib/python3.10/dist-packages/rasa/engine/graph.py”, line 512, in call self._run_after_hooks(input_hook_outputs, output) File “/usr/local/lib/python3.10/dist-packages/rasa/engine/graph.py”, line 531, in _run_after_hooks raise GraphComponentException( rasa.engine.exceptions.GraphComponentException: Error running after hook for node ‘train_DIETClassifier5’. 2024-04-24 08:58:51 DEBUG urllib3.connectionpool - https://o251570.ingest.sentry.io:443 “POST /api/2801673/store/ HTTP/1.1” 200 41 mf11408@pt-testing://etc/rasa$

I have fixed this issue by removing cache files ie,. → etc/rasa/.rasa/cache

And trained the model.