same issue when running “rasa test” in docker e.g. docker run --rm -it -v ${PWD}:/app rasa/rasa:1.9.5-full test or in CI/CD
I’m having the same error when running from a dockerfile. Im currently trying to downgrade to version 1.5.3 to see if it’ll help.
Same here, I wonder if it has something to do with admin privileges on windows for docker
Hi all, I have the same issue.
I just installed RASA for the first time, following what said in the installation guidelines: Installation
During RASA installation I got the error:
ERROR: tensorflow 2.1.0 has requirement six>=1.12.0, but you'll have six 1.11.0 which is incompatible
During tests also I got the related error:
2020-04-21 16:58:21.395564: E tensorflow/stream_executor/cuda/cuda_driver.cc:351] failed call to cuInit: UNKNOWN ERROR (303)
Ok, that seems related to GPU/Cuda. My question is:
is the error just a warning or it’s BLOCKING?
BTW, I installed on a Ubuntu 18.04 virtual machine with 2 CPUs (without GPUs), see below details.
Here attached some OS settings and the logs:
Thanks giorgio
$ inxi -CG
CPU: Dual core Intel Core (Broadwell) (-MCP-) cache: 4096 KB
clock speeds: max: 2399 MHz 1: 2399 MHz 2: 2399 MHz
Graphics: Card: Red Hat QXL paravirtual graphic card
Display Server: N/A driver: qxl tty size: 174x51 Advanced Data: N/A out of X
(venv) $ python3 --version
Python 3.6.9
(venv) $ pip3 --version
pip 20.0.2 from /home/giorgio/RASA/venv/lib/python3.6/site-packages/pip (python 3.6)
(venv) $ uname -a
Linux vrt5itd 4.15.0-70-generic #79-Ubuntu SMP Tue Nov 12 10:36:11 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
(venv) $ lsb
lsb_release lsblk
(venv) $ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.04.4 LTS
Release: 18.04
Codename: bionic
(venv) $ pip install rasa Collecting rasa Using cached rasa-1.9.6-py3-none-any.whl (497 kB) Collecting jsonschema<3.3,>=3.2 Downloading jsonschema-3.2.0-py2.py3-none-any.whl (56 kB) |████████████████████████████████| 56 kB 1.8 MB/s Collecting tensorflow-addons>=0.7.1 Downloading tensorflow_addons-0.9.1-cp36-cp36m-manylinux2010_x86_64.whl (1.0 MB) |████████████████████████████████| 1.0 MB 7.3 MB/s Collecting rocketchat_API<0.7.0,>=0.6.31 Downloading rocketchat_API-0.6.36-py3-none-any.whl (9.5 kB) Collecting python-telegram-bot<12.0,>=11.1 Downloading python_telegram_bot-11.1.0-py2.py3-none-any.whl (326 kB) |████████████████████████████████| 326 kB 10.3 MB/s Collecting redis<4.0,>=3.4 Downloading redis-3.4.1-py2.py3-none-any.whl (71 kB) |████████████████████████████████| 71 kB 6.6 MB/s Collecting tensorflow-estimator==2.1.0 Downloading tensorflow_estimator-2.1.0-py2.py3-none-any.whl (448 kB) |████████████████████████████████| 448 kB 9.8 MB/s Collecting tensorflow-probability<0.8,>=0.7 Downloading tensorflow_probability-0.7.0-py2.py3-none-any.whl (981 kB) |████████████████████████████████| 981 kB 5.4 MB/s Collecting tensorflow<2.2,>=2.1 Downloading tensorflow-2.1.0-cp36-cp36m-manylinux2010_x86_64.whl (421.8 MB) |████████████████████████████████| 421.8 MB 45 kB/s Collecting gevent<1.5.0,>=1.4.0 Downloading gevent-1.4.0-cp36-cp36m-manylinux1_x86_64.whl (5.5 MB) |████████████████████████████████| 5.5 MB 52.5 MB/s Collecting pykwalify<1.8.0,>=1.7.0 Downloading pykwalify-1.7.0-py2.py3-none-any.whl (40 kB) |████████████████████████████████| 40 kB 10.0 MB/s Collecting questionary<1.6.0,>=1.5.1 Downloading questionary-1.5.2-py3-none-any.whl (26 kB) Collecting numpy<2.0,>=1.16 Downloading numpy-1.18.3-cp36-cp36m-manylinux1_x86_64.whl (20.2 MB) |████████████████████████████████| 20.2 MB 37.7 MB/s Collecting sanic<20.0.0,>=19.12.2 Downloading sanic-19.12.2-py3-none-any.whl (72 kB) |████████████████████████████████| 72 kB 1.6 MB/s Collecting multidict<5.0,>=4.6 Downloading multidict-4.7.5-cp36-cp36m-manylinux1_x86_64.whl (148 kB) |████████████████████████████████| 148 kB 58.9 MB/s Collecting ruamel.yaml<0.16,>=0.15 Downloading ruamel.yaml-0.15.100-cp36-cp36m-manylinux1_x86_64.whl (656 kB) |████████████████████████████████| 656 kB 45.7 MB/s Collecting async_generator<1.11,>=1.10 Downloading async_generator-1.10-py3-none-any.whl (18 kB) Collecting networkx<2.5.0,>=2.4.0 Downloading networkx-2.4-py3-none-any.whl (1.6 MB) |████████████████████████████████| 1.6 MB 50.1 MB/s Collecting matplotlib<3.2,>=3.1 Downloading matplotlib-3.1.3-cp36-cp36m-manylinux1_x86_64.whl (13.1 MB) |████████████████████████████████| 13.1 MB 36.2 MB/s Collecting aiohttp<3.7,>=3.6 Downloading aiohttp-3.6.2-cp36-cp36m-manylinux1_x86_64.whl (1.2 MB) |████████████████████████████████| 1.2 MB 52.0 MB/s Collecting mattermostwrapper<2.3,>=2.2 Downloading mattermostwrapper-2.2.tar.gz (2.5 kB) Collecting requests<3.0,>=2.23 Downloading requests-2.23.0-py2.py3-none-any.whl (58 kB) |████████████████████████████████| 58 kB 8.6 MB/s Collecting boto3<2.0,>=1.12 Downloading boto3-1.12.42-py2.py3-none-any.whl (128 kB) |████████████████████████████████| 128 kB 59.6 MB/s Collecting scipy<2.0.0,>=1.4.1 Downloading scipy-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (26.1 MB) |████████████████████████████████| 26.1 MB 53.3 MB/s Collecting python-engineio<3.12,>=3.11 Downloading python_engineio-3.11.2-py2.py3-none-any.whl (49 kB) |████████████████████████████████| 49 kB 11.7 MB/s Collecting tqdm<4.32.0,>=4.31.0 Using cached tqdm-4.31.1-py2.py3-none-any.whl (48 kB) Collecting python-socketio<4.5,>=4.4 Downloading python_socketio-4.4.0-py2.py3-none-any.whl (50 kB) |████████████████████████████████| 50 kB 9.2 MB/s Collecting prompt-toolkit<3.0,>=2.0 Using cached prompt_toolkit-2.0.10-py3-none-any.whl (340 kB) Collecting sanic-jwt<1.4.0,>=1.3.2 Downloading sanic-jwt-1.3.2.tar.gz (18 kB) Collecting colorhash<1.1.0,>=1.0.2 Downloading colorhash-1.0.2-py2.py3-none-any.whl (6.0 kB) Collecting webexteamssdk<1.2.0,>=1.1.1 Downloading webexteamssdk-1.1.1.tar.gz (48 kB) |████████████████████████████████| 48 kB 6.9 MB/s Collecting slackclient<3.0.0,>=2.0.0 Downloading slackclient-2.5.0-py2.py3-none-any.whl (54 kB) |████████████████████████████████| 54 kB 3.5 MB/s Collecting kafka-python<2.0,>=1.4 Downloading kafka_python-1.4.7-py2.py3-none-any.whl (266 kB) |████████████████████████████████| 266 kB 52.2 MB/s Collecting pymongo[srv,tls]<3.9.0,>=3.8.0 Downloading pymongo-3.8.0-cp36-cp36m-manylinux1_x86_64.whl (416 kB) |████████████████████████████████| 416 kB 41.8 MB/s Collecting tensorflow_hub<0.8,>=0.7 Downloading tensorflow_hub-0.7.0-py2.py3-none-any.whl (89 kB) |████████████████████████████████| 89 kB 15.3 MB/s Collecting PyJWT<1.8,>=1.7 Using cached PyJWT-1.7.1-py2.py3-none-any.whl (18 kB) Collecting terminaltables<3.2.0,>=3.1.0 Downloading terminaltables-3.1.0.tar.gz (12 kB) Collecting rasa-sdk<2.0.0,>=1.9.0 Downloading rasa_sdk-1.9.0-py3-none-any.whl (37 kB) Collecting sklearn-crfsuite<0.4,>=0.3 Downloading sklearn_crfsuite-0.3.6-py2.py3-none-any.whl (12 kB) Collecting pytz<2020.0,>=2019.1 Downloading pytz-2019.3-py2.py3-none-any.whl (509 kB) |████████████████████████████████| 509 kB 53.2 MB/s Collecting python-dateutil<2.9,>=2.8 Downloading python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB) |████████████████████████████████| 227 kB 55.5 MB/s Collecting colorclass<2.3,>=2.2 Downloading colorclass-2.2.0.tar.gz (17 kB) Collecting setuptools>=41.0.0 Downloading setuptools-46.1.3-py3-none-any.whl (582 kB) |████████████████████████████████| 582 kB 51.5 MB/s Collecting jsonpickle<1.4,>=1.3 Downloading jsonpickle-1.3-py2.py3-none-any.whl (32 kB) Collecting pydot<1.5,>=1.4 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting oauth2client==4.1.3 Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) |████████████████████████████████| 98 kB 14.5 MB/s Collecting SQLAlchemy<1.4.0,>=1.3.3 Downloading SQLAlchemy-1.3.16-cp36-cp36m-manylinux2010_x86_64.whl (1.2 MB) |████████████████████████████████| 1.2 MB 48.1 MB/s Collecting attrs<19.4,>=19.3 Downloading attrs-19.3.0-py2.py3-none-any.whl (39 kB) Collecting packaging<19.1,>=19.0 Downloading packaging-19.0-py2.py3-none-any.whl (26 kB) Collecting ujson<2.0,>=1.35 Downloading ujson-1.35.tar.gz (192 kB) |████████████████████████████████| 192 kB 66.4 MB/s Collecting absl-py<0.10,>=0.9 Downloading absl-py-0.9.0.tar.gz (104 kB) |████████████████████████████████| 104 kB 62.5 MB/s Collecting scikit-learn<0.23,>=0.22 Downloading scikit_learn-0.22.2.post1-cp36-cp36m-manylinux1_x86_64.whl (7.1 MB) |████████████████████████████████| 7.1 MB 41.2 MB/s Collecting fbmessenger<6.1.0,>=6.0.0 Downloading fbmessenger-6.0.0-py2.py3-none-any.whl (11 kB) Collecting pika<1.2.0,>=1.1.0 Downloading pika-1.1.0-py2.py3-none-any.whl (148 kB) |████████████████████████████████| 148 kB 62.7 MB/s Collecting cloudpickle<1.3.0,>=1.2.0 Using cached cloudpickle-1.2.2-py2.py3-none-any.whl (25 kB) Collecting twilio<6.27,>=6.26 Downloading twilio-6.26.3-py2.py3-none-any.whl (979 kB) |████████████████████████████████| 979 kB 43.9 MB/s Collecting apscheduler<3.7,>=3.6 Downloading APScheduler-3.6.3-py2.py3-none-any.whl (58 kB) |████████████████████████████████| 58 kB 9.6 MB/s Collecting sanic-cors<0.11.0,>=0.10.0b1 Downloading Sanic_Cors-0.10.0.post3-py2.py3-none-any.whl (17 kB) Collecting coloredlogs<11.0,>=10.0 Downloading coloredlogs-10.0-py2.py3-none-any.whl (47 kB) |████████████████████████████████| 47 kB 9.2 MB/s Collecting psycopg2-binary<2.9.0,>=2.8.2 Downloading psycopg2_binary-2.8.5-cp36-cp36m-manylinux1_x86_64.whl (2.9 MB) |████████████████████████████████| 2.9 MB 42.1 MB/s Collecting pyrsistent>=0.14.0 Downloading pyrsistent-0.16.0.tar.gz (108 kB) |████████████████████████████████| 108 kB 44.6 MB/s Collecting importlib-metadata; python_version < “3.8” Downloading importlib_metadata-1.6.0-py2.py3-none-any.whl (30 kB) Requirement already satisfied: six>=1.11.0 in /usr/lib/python3/dist-packages (from jsonschema<3.3,>=3.2->rasa) (1.11.0) Collecting typeguard>=2.7 Downloading typeguard-2.7.1-py3-none-any.whl (15 kB) Collecting future>=0.16.0 Downloading future-0.18.2.tar.gz (829 kB) |████████████████████████████████| 829 kB 47.7 MB/s Requirement already satisfied: cryptography in /usr/lib/python3/dist-packages (from python-telegram-bot<12.0,>=11.1->rasa) (2.1.4) Requirement already satisfied: certifi in /usr/lib/python3/dist-packages (from python-telegram-bot<12.0,>=11.1->rasa) (2018.1.18) Collecting decorator Downloading decorator-4.4.2-py2.py3-none-any.whl (9.2 kB) Collecting grpcio>=1.8.6 Downloading grpcio-1.28.1-cp36-cp36m-manylinux2010_x86_64.whl (2.8 MB) |████████████████████████████████| 2.8 MB 54.9 MB/s Requirement already satisfied: wheel>=0.26; python_version >= “3” in /usr/lib/python3/dist-packages (from tensorflow<2.2,>=2.1->rasa) (0.30.0) Collecting keras-applications>=1.0.8 Downloading Keras_Applications-1.0.8-py3-none-any.whl (50 kB) |████████████████████████████████| 50 kB 12.1 MB/s Collecting astor>=0.6.0 Downloading astor-0.8.1-py2.py3-none-any.whl (27 kB) Collecting tensorboard<2.2.0,>=2.1.0 Downloading tensorboard-2.1.1-py3-none-any.whl (3.8 MB) |████████████████████████████████| 3.8 MB 53.9 MB/s Collecting termcolor>=1.1.0 Downloading termcolor-1.1.0.tar.gz (3.9 kB) Collecting wrapt>=1.11.1 Downloading wrapt-1.12.1.tar.gz (27 kB) Collecting opt-einsum>=2.3.2 Downloading opt_einsum-3.2.1-py3-none-any.whl (63 kB) |████████████████████████████████| 63 kB 3.1 MB/s Collecting protobuf>=3.8.0 Downloading protobuf-3.11.3-cp36-cp36m-manylinux1_x86_64.whl (1.3 MB) |████████████████████████████████| 1.3 MB 48.1 MB/s Collecting keras-preprocessing>=1.1.0 Downloading Keras_Preprocessing-1.1.0-py2.py3-none-any.whl (41 kB) |████████████████████████████████| 41 kB 1.5 MB/s Collecting google-pasta>=0.1.6 Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB) |████████████████████████████████| 57 kB 7.9 MB/s Collecting gast==0.2.2 Downloading gast-0.2.2.tar.gz (10 kB) Collecting greenlet>=0.4.14; platform_python_implementation == “CPython” Downloading greenlet-0.4.15-cp36-cp36m-manylinux1_x86_64.whl (41 kB) |████████████████████████████████| 41 kB 342 kB/s Requirement already satisfied: PyYAML>=3.11 in /usr/lib/python3/dist-packages (from pykwalify<1.8.0,>=1.7.0->rasa) (3.12) Collecting docopt>=0.6.2 Downloading docopt-0.6.2.tar.gz (25 kB) Collecting aiofiles>=0.3.0 Downloading aiofiles-0.5.0-py3-none-any.whl (11 kB) Collecting httpx==0.9.3 Downloading httpx-0.9.3-py2.py3-none-any.whl (64 kB) |████████████████████████████████| 64 kB 6.3 MB/s Collecting httptools>=0.0.10 Downloading httptools-0.1.1-cp36-cp36m-manylinux1_x86_64.whl (216 kB) |████████████████████████████████| 216 kB 35.8 MB/s Collecting uvloop>=0.5.3; sys_platform != “win32” and implementation_name == “cpython” Downloading uvloop-0.14.0-cp36-cp36m-manylinux2010_x86_64.whl (3.9 MB) |████████████████████████████████| 3.9 MB 31.3 MB/s Collecting websockets<9.0,>=7.0 Downloading websockets-8.1-cp36-cp36m-manylinux2010_x86_64.whl (78 kB) |████████████████████████████████| 78 kB 10.0 MB/s Collecting pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) |████████████████████████████████| 67 kB 9.8 MB/s Collecting cycler>=0.10 Downloading cycler-0.10.0-py2.py3-none-any.whl (6.5 kB) Collecting kiwisolver>=1.0.1 Downloading kiwisolver-1.2.0-cp36-cp36m-manylinux1_x86_64.whl (88 kB) |████████████████████████████████| 88 kB 13.3 MB/s Collecting idna-ssl>=1.0; python_version < “3.7” Downloading idna-ssl-1.1.0.tar.gz (3.4 kB) Collecting typing-extensions>=3.6.5; python_version < “3.7” Downloading typing_extensions-3.7.4.2-py3-none-any.whl (22 kB) Collecting yarl<2.0,>=1.0 Downloading yarl-1.4.2-cp36-cp36m-manylinux1_x86_64.whl (252 kB) |████████████████████████████████| 252 kB 64.5 MB/s Collecting async-timeout<4.0,>=3.0 Downloading async_timeout-3.0.1-py3-none-any.whl (8.2 kB) Requirement already satisfied: chardet<4.0,>=2.0 in /usr/lib/python3/dist-packages (from aiohttp<3.7,>=3.6->rasa) (3.0.4) Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/lib/python3/dist-packages (from requests<3.0,>=2.23->rasa) (1.22) Requirement already satisfied: idna<3,>=2.5 in /usr/lib/python3/dist-packages (from requests<3.0,>=2.23->rasa) (2.6) Collecting jmespath<1.0.0,>=0.7.1 Downloading jmespath-0.9.5-py2.py3-none-any.whl (24 kB) Collecting botocore<1.16.0,>=1.15.42 Downloading botocore-1.15.42-py2.py3-none-any.whl (6.1 MB) |████████████████████████████████| 6.1 MB 28.1 MB/s Collecting s3transfer<0.4.0,>=0.3.0 Downloading s3transfer-0.3.3-py2.py3-none-any.whl (69 kB) |████████████████████████████████| 69 kB 9.4 MB/s Collecting wcwidth Downloading wcwidth-0.1.9-py2.py3-none-any.whl (19 kB) Collecting requests-toolbelt Downloading requests_toolbelt-0.9.1-py2.py3-none-any.whl (54 kB) |████████████████████████████████| 54 kB 4.2 MB/s Collecting dnspython<2.0.0,>=1.13.0; extra == “srv” Downloading dnspython-1.16.0-py2.py3-none-any.whl (188 kB) |████████████████████████████████| 188 kB 38.3 MB/s Collecting tabulate Downloading tabulate-0.8.7-py3-none-any.whl (24 kB) Collecting python-crfsuite>=0.8.3 Downloading python_crfsuite-0.9.7-cp36-cp36m-manylinux1_x86_64.whl (743 kB) |████████████████████████████████| 743 kB 32.5 MB/s Collecting rsa>=3.1.4 Downloading rsa-4.0-py2.py3-none-any.whl (38 kB) Requirement already satisfied: pyasn1-modules>=0.0.5 in /usr/lib/python3/dist-packages (from oauth2client==4.1.3->rasa) (0.2.1) Requirement already satisfied: pyasn1>=0.1.7 in /usr/lib/python3/dist-packages (from oauth2client==4.1.3->rasa) (0.4.2) Requirement already satisfied: httplib2>=0.9.1 in /usr/lib/python3/dist-packages (from oauth2client==4.1.3->rasa) (0.9.2) Collecting joblib>=0.11 Downloading joblib-0.14.1-py2.py3-none-any.whl (294 kB) |████████████████████████████████| 294 kB 52.6 MB/s Collecting pysocks; python_version >= “3.0” Downloading PySocks-1.7.1-py3-none-any.whl (16 kB) Collecting tzlocal>=1.2 Downloading tzlocal-2.0.0-py2.py3-none-any.whl (15 kB) Collecting sanic-plugins-framework>=0.9.0 Downloading Sanic_Plugins_Framework-0.9.2-py2.py3-none-any.whl (23 kB) Collecting humanfriendly>=4.7 Downloading humanfriendly-8.2-py2.py3-none-any.whl (86 kB) |████████████████████████████████| 86 kB 10.2 MB/s Collecting zipp>=0.5 Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB) Collecting h5py Downloading h5py-2.10.0-cp36-cp36m-manylinux1_x86_64.whl (2.9 MB) |████████████████████████████████| 2.9 MB 26.3 MB/s Collecting werkzeug>=0.11.15 Downloading Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB) |████████████████████████████████| 298 kB 41.3 MB/s Collecting google-auth<2,>=1.6.3 Downloading google_auth-1.14.0-py2.py3-none-any.whl (88 kB) |████████████████████████████████| 88 kB 11.4 MB/s Collecting markdown>=2.6.8 Downloading Markdown-3.2.1-py2.py3-none-any.whl (88 kB) |████████████████████████████████| 88 kB 11.6 MB/s Collecting google-auth-oauthlib<0.5,>=0.4.1 Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB) Collecting sniffio==1.* Downloading sniffio-1.1.0-py3-none-any.whl (4.5 kB) Collecting h2==3.* Downloading h2-3.2.0-py2.py3-none-any.whl (65 kB) |████████████████████████████████| 65 kB 7.0 MB/s Collecting rfc3986<2,>=1.3 Downloading rfc3986-1.4.0-py2.py3-none-any.whl (31 kB) Collecting h11==0.8.* Downloading h11-0.8.1-py2.py3-none-any.whl (55 kB) |████████████████████████████████| 55 kB 5.7 MB/s Collecting hstspreload Downloading hstspreload-2020.4.21-py3-none-any.whl (872 kB) |████████████████████████████████| 872 kB 46.7 MB/s Collecting docutils<0.16,>=0.10 Downloading docutils-0.15.2-py3-none-any.whl (547 kB) |████████████████████████████████| 547 kB 51.0 MB/s Collecting cachetools<5.0,>=2.0.0 Downloading cachetools-4.1.0-py3-none-any.whl (10 kB) Collecting requests-oauthlib>=0.7.0 Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB) Collecting contextvars>=2.1; python_version < “3.7” Downloading contextvars-2.4.tar.gz (9.6 kB) Collecting hpack<4,>=3.0 Downloading hpack-3.0.0-py2.py3-none-any.whl (38 kB) Collecting hyperframe<6,>=5.2.0 Downloading hyperframe-5.2.0-py2.py3-none-any.whl (12 kB) Collecting oauthlib>=3.0.0 Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB) |████████████████████████████████| 147 kB 61.0 MB/s Collecting immutables>=0.9 Downloading immutables-0.11-cp36-cp36m-manylinux1_x86_64.whl (92 kB) |████████████████████████████████| 92 kB 1.5 MB/s Building wheels for collected packages: mattermostwrapper, sanic-jwt, webexteamssdk, terminaltables, colorclass, ujson, absl-py, pyrsistent, future, termcolor, wrapt, gast, docopt, idna-ssl, contextvars Building wheel for mattermostwrapper (setup.py) … done Created wheel for mattermostwrapper: filename=mattermostwrapper-2.2-py3-none-any.whl size=3259 sha256=25940942ba23cf03b7d7b9daa2f1d1b526ceec5bda820ae6ca05399150e3a4a4 Stored in directory: /home/giorgio/.cache/pip/wheels/d2/75/76/94b6c87fdd21609f3bd562b7b0f4810a896719b86835c6de4c Building wheel for sanic-jwt (setup.py) … done Created wheel for sanic-jwt: filename=sanic_jwt-1.3.2-py3-none-any.whl size=22952 sha256=0541e6c7e87aeb80fa79d55d28f222b0b37d4cbc036b269fb0ca83a9022ff32a Stored in directory: /home/giorgio/.cache/pip/wheels/c6/24/48/ab2d47994bc5fb4b898fc3be1b9f4cc5fce9b8eefd63c3d3ce Building wheel for webexteamssdk (setup.py) … done Created wheel for webexteamssdk: filename=webexteamssdk-1.1.1-py3-none-any.whl size=80968 sha256=3ddbd5c58ec026917c2ddb92359d689d69a79f051738feedb03bcfeb5b49ea74 Stored in directory: /home/giorgio/.cache/pip/wheels/b2/00/6a/55fe3d2e2a5f61c89b2bce9bf7e3b44ea5aff222884935d040 Building wheel for terminaltables (setup.py) … done Created wheel for terminaltables: filename=terminaltables-3.1.0-py3-none-any.whl size=17908 sha256=80190f587f144cfe2466e7e50cf99bfcbed5fd90b7d2bff5b5d6e7b2634e19aa Stored in directory: /home/giorgio/.cache/pip/wheels/86/1b/58/c23af2fe683acd8edc15d5a1268f0242be1ff2cf827fe34737 Building wheel for colorclass (setup.py) … done Created wheel for colorclass: filename=colorclass-2.2.0-py3-none-any.whl size=22954 sha256=e124b26689eeca005abed9ec3a6a77e581cbd1bbe6de39de71d1fe53807eb941 Stored in directory: /home/giorgio/.cache/pip/wheels/94/c4/e5/8f9dbdb37ddd97e0896de7de36b4d7598df223012918049801 Building wheel for ujson (setup.py) … done Created wheel for ujson: filename=ujson-1.35-cp36-cp36m-linux_x86_64.whl size=71468 sha256=edfd354bf3a073be193411d20453a7cd2ab6c4e662d755a564d721d56e34dcb4 Stored in directory: /home/giorgio/.cache/pip/wheels/e0/e6/69/fc449f332d998b63ede372a74a53bb953ff0ca6bb90da39fac Building wheel for absl-py (setup.py) … done Created wheel for absl-py: filename=absl_py-0.9.0-py3-none-any.whl size=119396 sha256=d75657dadb92a36cb0ac3311121630c7e675346e347f7eaf3b4a23ea727958fc Stored in directory: /home/giorgio/.cache/pip/wheels/c3/af/84/3962a6af7b4ab336e951b7877dcfb758cf94548bb1771e0679 Building wheel for pyrsistent (setup.py) … done Created wheel for pyrsistent: filename=pyrsistent-0.16.0-cp36-cp36m-linux_x86_64.whl size=106542 sha256=86a00aa3a273f7389c38ab4ec036841e3f619d3bce15ad9f19bac1ea173d1778 Stored in directory: /home/giorgio/.cache/pip/wheels/d1/8a/1c/32ab9017418a2c64e4fbaf503c08648bed2f8eb311b869a464 Building wheel for future (setup.py) … done Created wheel for future: filename=future-0.18.2-py3-none-any.whl size=493275 sha256=8a4bd97a9463a9ad0afb9b14c6ec7f13cd21e36bb6303ef9839a2354009d7121 Stored in directory: /home/giorgio/.cache/pip/wheels/6e/9c/ed/4499c9865ac1002697793e0ae05ba6be33553d098f3347fb94 Building wheel for termcolor (setup.py) … done Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=5679 sha256=a7a9860b269b8b40877ec0e2a2ad02ac1e35ec410ae120026608d462ec03bb15 Stored in directory: /home/giorgio/.cache/pip/wheels/93/2a/eb/e58dbcbc963549ee4f065ff80a59f274cc7210b6eab962acdc Building wheel for wrapt (setup.py) … done Created wheel for wrapt: filename=wrapt-1.12.1-cp36-cp36m-linux_x86_64.whl size=69334 sha256=2ad055bd3d7863d4df203f2c8325891a6d772f4bd6704e248012a7e5e68489dc Stored in directory: /home/giorgio/.cache/pip/wheels/32/42/7f/23cae9ff6ef66798d00dc5d659088e57dbba01566f6c60db63 Building wheel for gast (setup.py) … done Created wheel for gast: filename=gast-0.2.2-py3-none-any.whl size=7635 sha256=867833aa78f998a80c048a8554dad47dba95014b0615e7069d12c89253a35655 Stored in directory: /home/giorgio/.cache/pip/wheels/19/a7/b9/0740c7a3a7d1d348f04823339274b90de25fbcd217b2ee1fbe Building wheel for docopt (setup.py) … done Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=19852 sha256=2740882ffe6ce8099e88cb42acb58731d4c5e5aa3118e7cca05175bbb1244b5f Stored in directory: /home/giorgio/.cache/pip/wheels/3f/2a/fa/4d7a888e69774d5e6e855d190a8a51b357d77cc05eb1c097c9 Building wheel for idna-ssl (setup.py) … done Created wheel for idna-ssl: filename=idna_ssl-1.1.0-py3-none-any.whl size=3949 sha256=9a5228158d114402aa1323c8957370f0ace8e2d52ec4a43d0d537561109dfa52 Stored in directory: /home/giorgio/.cache/pip/wheels/6a/f5/9c/f8331a854f7a8739cf0e74c13854e4dd7b1af11b04fe1dde13 Building wheel for contextvars (setup.py) … done Created wheel for contextvars: filename=contextvars-2.4-py3-none-any.whl size=5272 sha256=94d1dcae11881e9906e5526b10a0a247becda44f8ba454418f63d0eb2c272e98 Stored in directory: /home/giorgio/.cache/pip/wheels/41/11/53/911724983aa48deb94792432e14e518447212dd6c5477d49d3 Successfully built mattermostwrapper sanic-jwt webexteamssdk terminaltables colorclass ujson absl-py pyrsistent future termcolor wrapt gast docopt idna-ssl contextvars ERROR: tensorflow 2.1.0 has requirement six>=1.12.0, but you’ll have six 1.11.0 which is incompatible. Installing collected packages: pyrsistent, setuptools, zipp, importlib-metadata, attrs, jsonschema, typeguard, tensorflow-addons, requests, rocketchat-API, future, python-telegram-bot, redis, tensorflow-estimator, decorator, cloudpickle, numpy, tensorflow-probability, grpcio, absl-py, h5py, keras-applications, astor, werkzeug, cachetools, rsa, google-auth, markdown, oauthlib, requests-oauthlib, google-auth-oauthlib, protobuf, tensorboard, termcolor, wrapt, opt-einsum, scipy, keras-preprocessing, google-pasta, gast, tensorflow, greenlet, gevent, python-dateutil, docopt, pykwalify, wcwidth, prompt-toolkit, questionary, aiofiles, multidict, immutables, contextvars, sniffio, hpack, hyperframe, h2, rfc3986, h11, hstspreload, httpx, httptools, uvloop, ujson, websockets, sanic, ruamel.yaml, async-generator, networkx, pyparsing, cycler, kiwisolver, matplotlib, idna-ssl, typing-extensions, yarl, async-timeout, aiohttp, mattermostwrapper, jmespath, docutils, botocore, s3transfer, boto3, python-engineio, tqdm, python-socketio, PyJWT, sanic-jwt, colorhash, requests-toolbelt, webexteamssdk, slackclient, kafka-python, dnspython, pymongo, tensorflow-hub, terminaltables, sanic-plugins-framework, sanic-cors, humanfriendly, coloredlogs, rasa-sdk, tabulate, python-crfsuite, sklearn-crfsuite, pytz, colorclass, jsonpickle, pydot, oauth2client, SQLAlchemy, packaging, joblib, scikit-learn, fbmessenger, pika, pysocks, twilio, tzlocal, apscheduler, psycopg2-binary, rasa Attempting uninstall: setuptools Found existing installation: setuptools 39.0.1 Uninstalling setuptools-39.0.1: Successfully uninstalled setuptools-39.0.1 Attempting uninstall: attrs Found existing installation: attrs 17.4.0 Not uninstalling attrs at /usr/lib/python3/dist-packages, outside environment /home/giorgio/RASA/venv Can’t uninstall ‘attrs’. No files were found to uninstall. Attempting uninstall: jsonschema Found existing installation: jsonschema 2.6.0 Not uninstalling jsonschema at /usr/lib/python3/dist-packages, outside environment /home/giorgio/RASA/venv Can’t uninstall ‘jsonschema’. No files were found to uninstall. Attempting uninstall: requests Found existing installation: requests 2.18.4 Not uninstalling requests at /usr/lib/python3/dist-packages, outside environment /home/giorgio/RASA/venv Can’t uninstall ‘requests’. No files were found to uninstall. Attempting uninstall: oauthlib Found existing installation: oauthlib 2.0.6 Not uninstalling oauthlib at /usr/lib/python3/dist-packages, outside environment /home/giorgio/RASA/venv Can’t uninstall ‘oauthlib’. No files were found to uninstall. Attempting uninstall: PyJWT Found existing installation: PyJWT 1.5.3 Not uninstalling pyjwt at /usr/lib/python3/dist-packages, outside environment /home/giorgio/RASA/venv Can’t uninstall ‘PyJWT’. No files were found to uninstall. Successfully installed PyJWT-1.7.1 SQLAlchemy-1.3.16 absl-py-0.9.0 aiofiles-0.5.0 aiohttp-3.6.2 apscheduler-3.6.3 astor-0.8.1 async-generator-1.10 async-timeout-3.0.1 attrs-19.3.0 boto3-1.12.42 botocore-1.15.42 cachetools-4.1.0 cloudpickle-1.2.2 colorclass-2.2.0 coloredlogs-10.0 colorhash-1.0.2 contextvars-2.4 cycler-0.10.0 decorator-4.4.2 dnspython-1.16.0 docopt-0.6.2 docutils-0.15.2 fbmessenger-6.0.0 future-0.18.2 gast-0.2.2 gevent-1.4.0 google-auth-1.14.0 google-auth-oauthlib-0.4.1 google-pasta-0.2.0 greenlet-0.4.15 grpcio-1.28.1 h11-0.8.1 h2-3.2.0 h5py-2.10.0 hpack-3.0.0 hstspreload-2020.4.21 httptools-0.1.1 httpx-0.9.3 humanfriendly-8.2 hyperframe-5.2.0 idna-ssl-1.1.0 immutables-0.11 importlib-metadata-1.6.0 jmespath-0.9.5 joblib-0.14.1 jsonpickle-1.3 jsonschema-3.2.0 kafka-python-1.4.7 keras-applications-1.0.8 keras-preprocessing-1.1.0 kiwisolver-1.2.0 markdown-3.2.1 matplotlib-3.1.3 mattermostwrapper-2.2 multidict-4.7.5 networkx-2.4 numpy-1.18.3 oauth2client-4.1.3 oauthlib-3.1.0 opt-einsum-3.2.1 packaging-19.0 pika-1.1.0 prompt-toolkit-2.0.10 protobuf-3.11.3 psycopg2-binary-2.8.5 pydot-1.4.1 pykwalify-1.7.0 pymongo-3.8.0 pyparsing-2.4.7 pyrsistent-0.16.0 pysocks-1.7.1 python-crfsuite-0.9.7 python-dateutil-2.8.1 python-engineio-3.11.2 python-socketio-4.4.0 python-telegram-bot-11.1.0 pytz-2019.3 questionary-1.5.2 rasa-1.9.6 rasa-sdk-1.9.0 redis-3.4.1 requests-2.23.0 requests-oauthlib-1.3.0 requests-toolbelt-0.9.1 rfc3986-1.4.0 rocketchat-API-0.6.36 rsa-4.0 ruamel.yaml-0.15.100 s3transfer-0.3.3 sanic-19.12.2 sanic-cors-0.10.0.post3 sanic-jwt-1.3.2 sanic-plugins-framework-0.9.2 scikit-learn-0.22.2.post1 scipy-1.4.1 setuptools-46.1.3 sklearn-crfsuite-0.3.6 slackclient-2.5.0 sniffio-1.1.0 tabulate-0.8.7 tensorboard-2.1.1 tensorflow-2.1.0 tensorflow-addons-0.9.1 tensorflow-estimator-2.1.0 tensorflow-hub-0.7.0 tensorflow-probability-0.7.0 termcolor-1.1.0 terminaltables-3.1.0 tqdm-4.31.1 twilio-6.26.3 typeguard-2.7.1 typing-extensions-3.7.4.2 tzlocal-2.0.0 ujson-1.35 uvloop-0.14.0 wcwidth-0.1.9 webexteamssdk-1.1.1 websockets-8.1 werkzeug-1.0.1 wrapt-1.12.1 yarl-1.4.2 zipp-3.1.0
(venv) $ rasa test
2020-04-21 16:58:21.395564: E tensorflow/stream_executor/cuda/cuda_driver.cc:351] failed call to cuInit: UNKNOWN ERROR (303)
Processed Story Blocks: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [00:00<00:00, 2727.12it/s, # trackers=1]
2020-04-21 16:58:31 INFO rasa.core.test - Evaluating 7 stories
Progress:
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [00:00<00:00, 79.60it/s]
2020-04-21 16:58:31 INFO rasa.core.test - Finished collecting predictions.
2020-04-21 16:58:31 INFO rasa.core.test - Evaluation Results on END-TO-END level:
2020-04-21 16:58:31 INFO rasa.core.test - Correct: 7 / 7
2020-04-21 16:58:31 INFO rasa.core.test - F1-Score: 1.000
2020-04-21 16:58:31 INFO rasa.core.test - Precision: 1.000
2020-04-21 16:58:31 INFO rasa.core.test - Accuracy: 1.000
2020-04-21 16:58:31 INFO rasa.core.test - In-data fraction: 0.943
2020-04-21 16:58:31 INFO rasa.core.test - Evaluation Results on ACTION level:
2020-04-21 16:58:31 INFO rasa.core.test - Correct: 35 / 35
2020-04-21 16:58:31 INFO rasa.core.test - F1-Score: 1.000
2020-04-21 16:58:31 INFO rasa.core.test - Precision: 1.000
2020-04-21 16:58:31 INFO rasa.core.test - Accuracy: 1.000
2020-04-21 16:58:31 INFO rasa.core.test - In-data fraction: 0.943
2020-04-21 16:58:31 INFO rasa.core.test - Classification report:
precision recall f1-score support
mood_great 1.00 1.00 1.00 2
deny 1.00 1.00 1.00 2
mood_unhappy 1.00 1.00 1.00 3
utter_happy 1.00 1.00 1.00 3
greet 1.00 1.00 1.00 5
bot_challenge 1.00 1.00 1.00 1
utter_cheer_up 1.00 1.00 1.00 3
affirm 1.00 1.00 1.00 1
utter_did_that_help 1.00 1.00 1.00 3
action_listen 1.00 1.00 1.00 16
utter_iamabot 1.00 1.00 1.00 1
goodbye 1.00 1.00 1.00 2
utter_greet 1.00 1.00 1.00 5
utter_goodbye 1.00 1.00 1.00 4
accuracy 1.00 51
macro avg 1.00 1.00 1.00 51
weighted avg 1.00 1.00 1.00 51
2020-04-21 16:58:31 INFO rasa.nlu.test - Confusion matrix, without normalization:
[[16 0 0 0 0 0 0]
[ 0 3 0 0 0 0 0]
[ 0 0 3 0 0 0 0]
[ 0 0 0 4 0 0 0]
[ 0 0 0 0 5 0 0]
[ 0 0 0 0 0 3 0]
[ 0 0 0 0 0 0 1]]
2020-04-21 16:58:35 INFO rasa.nlu.test - Running model for predictions:
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 43/43 [00:00<00:00, 105.04it/s]
2020-04-21 16:58:35 INFO rasa.nlu.test - Intent evaluation results:
2020-04-21 16:58:35 INFO rasa.nlu.test - Intent Evaluation: Only considering those 43 examples that have a defined intent out of 43 examples
2020-04-21 16:58:35 INFO rasa.nlu.test - Classification report saved to results/intent_report.json.
2020-04-21 16:58:35 INFO rasa.nlu.test - Your model predicted all intents successfully.
2020-04-21 16:58:35 INFO rasa.nlu.test - Confusion matrix, without normalization:
[[ 5 0 0 0 0 0 0]
[ 0 4 0 0 0 0 0]
[ 0 0 6 0 0 0 0]
[ 0 0 0 4 0 0 0]
[ 0 0 0 0 6 0 0]
[ 0 0 0 0 0 8 0]
[ 0 0 0 0 0 0 10]]
2020-04-21 16:58:38 INFO rasa.nlu.test - Entity evaluation results:
2020-04-21 16:58:38 INFO rasa.nlu.test - Evaluation for entity extractor: DIETClassifier
2020-04-21 16:58:38 WARNING rasa.nlu.test - No labels to evaluate. Skip evaluation.
2020-04-21 16:58:38 INFO rasa.nlu.test - Classification report for 'DIETClassifier' saved to 'results/DIETClassifier_report.json'.
2020-04-21 16:58:38 INFO rasa.nlu.test - Your model predicted all entities successfully.Hi @stephens,
Happens to me that every I run a RASA server (e.g. with cli commands: rasa train or rasa run ...) I got the (apparently not-blockingbut suspicious) error message:
E tensorflow/stream_executor/cuda/cuda_driver.cc:351] failed call to cuInit: UNKNOWN ERROR (303)
See below below the logs, when running: (venv) $ rasa run --debug --enable-api -m models:
2020-05-02 20:29:20 DEBUG rasa.cli.utils - Parameter 'endpoints' not set. Using default location 'endpoints.yml' instead.
No chat connector configured, falling back to the REST input channel. To connect your bot to another channel, read the docs here: https://rasa.com/docs/rasa/user-guideessaging-and-voice-channels
2020-05-02 20:29:20 DEBUG rasa.core.utils - Available web server routes:
/conversations/<conversation_id>/messages POST add_message
/conversations/<conversation_id>/tracker/events POST append_events
/webhooks/rest GET custom_webhook_RestInput.health
/webhooks/rest/webhook POST custom_webhook_RestInput.receive
/model/test/intents POST evaluate_intents
/model/test/stories POST evaluate_stories
/conversations/<conversation_id>/execute POST execute_action
/domain GET get_domain
/ GET hello
/model PUT load_model
/model/parse POST parse
/conversations/<conversation_id>/predict POST predict
/conversations/<conversation_id>/tracker/events PUT replace_events
/conversations/<conversation_id>/story GET retrieve_story
/conversations/<conversation_id>/tracker GET retrieve_tracker
/status GET status
/model/predict POST tracker_predict
/model/train POST train
/conversations/<conversation_id>/trigger_intent POST trigger_intent
/model DELETE unload_model
/version GET version
2020-05-02 20:29:20 INFO root - Starting Rasa server on http://localhost:5005
2020-05-02 20:29:20 DEBUG rasa.core.utils - Using the default number of Sanic workers (1).
2020-05-02 20:29:20 INFO root - Enabling coroutine debugging. Loop id 95987480.
2020-05-02 20:29:21 DEBUG rasa.model - Extracted model to '/tmp/tmp8se_uv6g'.
/home/solyaris/venv/lib/python3.6/site-packages/thinc/neural/_custom_kernels.py:36: ResourceWarning: unclosed file <_io.TextIOWrapper name='/home/solyaris/venv/lib/pytn3.6/site-packages/thinc/neural/_custom_kernels.cu' mode='r' encoding='utf8'>
SRC = (PWD / "_custom_kernels.cu").open("r", encoding="utf8").read()
/home/solyaris/venv/lib/python3.6/site-packages/thinc/neural/_custom_kernels.py:39: ResourceWarning: unclosed file <_io.TextIOWrapper name='/home/solyaris/venv/lib/pytn3.6/site-packages/thinc/neural/_murmur3.cu' mode='r' encoding='utf8'>
MMH_SRC = (PWD / "_murmur3.cu").open("r", encoding="utf8").read()
2020-05-02 20:29:34 INFO rasa.nlu.components - Added 'SpacyNLP' to component cache. Key 'SpacyNLP-en'.
2020-05-02 20:29:34 DEBUG rasa.utils.tensorflow.models - Loading the model ...
2020-05-02 20:29:34.403298: E tensorflow/stream_executor/cuda/cuda_driver.cc:351] failed call to cuInit: UNKNOWN ERROR (303)
2020-05-02 20:29:34 DEBUG rasa.utils.tensorflow.models - Finished loading the model.
2020-05-02 20:29:34 DEBUG rasa.utils.tensorflow.models - Building tensorflow prediction graph...
2020-05-02 20:29:38 DEBUG rasa.utils.tensorflow.models - Finished building tensorflow prediction graph.
2020-05-02 20:29:38 DEBUG rasa.core.tracker_store - Connected to InMemoryTrackerStore.
2020-05-02 20:29:38 DEBUG rasa.core.lock_store - Connected to lock store 'InMemoryLockStore'.
2020-05-02 20:29:38 DEBUG rasa.model - Extracted model to '/tmp/tmp8yc0gxg1'.
2020-05-02 20:29:38 DEBUG pykwalify.compat - Using yaml library: /home/solyaris/venv/lib/python3.6/site-packages/ruamel/yaml/__init__.py
2020-05-02 20:29:38 DEBUG rasa.utils.tensorflow.models - Loading the model ...
2020-05-02 20:29:38 DEBUG rasa.utils.tensorflow.models - Finished loading the model.
2020-05-02 20:29:38 DEBUG rasa.utils.tensorflow.models - Building tensorflow prediction graph...
2020-05-02 20:29:39 DEBUG rasa.utils.tensorflow.models - Finished building tensorflow prediction graph.
2020-05-02 20:29:39 DEBUG rasa.core.nlg.generator - Instantiated NLG to 'TemplatedNaturalLanguageGenerator'.
Here my PC configuration:
(venv) $ pip list | grep tensorflow
tensorflow 2.1.0
tensorflow-addons 0.9.1
tensorflow-estimator 2.1.0
tensorflow-hub 0.7.0
tensorflow-probability 0.7.0
WARNING: You are using pip version 20.0.2; however, version 20.1 is available.
You should consider upgrading via the '/home/solyaris/venv/bin/python3 -m pip install --upgrade pip' command.
(venv) $ pip3 --version
pip 20.0.2 from /home/solyaris/venv/lib/python3.6/site-packages/pip (python 3.6)
(venv) $ rasa --version
Rasa 1.9.7
(venv) $ inxi -GC
CPU: Quad core Intel Core i7-8565U (-MT-MCP-) cache: 8192 KB
clock speeds: max: 4600 MHz 1: 1151 MHz 2: 841 MHz 3: 958 MHz 4: 848 MHz 5: 802 MHz 6: 838 MHz
7: 802 MHz 8: 838 MHz
Graphics: Card-1: Intel Device 3ea0
Card-2: Advanced Micro Devices [AMD/ATI] Topaz XT [Radeon R7 M260/M265 / M340/M360 / M440/M445]
Display Server: N/A drivers: modesetting,ati,amdgpu (unloaded: fbdev,vesa)
tty size: 169x47 Advanced Data: N/A out of X
Any idea about the origin of the issue?
Thanks/giorgio
2 Likes
Same issue. Anyone here found a solution for this ? Please respond
The origin is Tensorflow and your graphics card configuration. GPU’s do not typically provide an advantage for the Rasa models. This can be safely ignored.
Same error message appears when trying to run rasa in docker
Same here. The primary issue is not about training, it is about hosting a trained model in a docker. @stephens any ideas?
Hi Fanglin,
As indicated in the prior replies this can generally be ignored but is also hardware specific. Update to the latest Rasa if you haven’t already. If you’re running with nvidia this stackoverflow post may be helpful. You an also post the log here.
Greg
Lol, honestly, I am not sure how this is an acceptable answer.
So the issue was reported over one year ago, and Rasa’s response is… “Just ignore it.” while everyone else is saying “stuff is broken”.
I followed the stackoverflow post - it didn’t fix anything in my docker container.
Does anyone have solved this issue? I see this issue with latest version as well. Training and other tasks are aborted on this error.
I’m having this issue as well, both on (RasaX: 0.31.5, rasa: 1.10.10-full) and (RasaX: 0.30.1, rasa:1.10.8). This only happens when I try to train from the RasaX interface deployed on kubernetes(I have tried both on DigitalOcean and on Google Cloud). It did not happen to me when I was developing on my local machine (and trained via CLI). I have tried deploying using both the quick install and the helm install.
It also aborts the training sadly.
I understand if you consider this is as not Rasa’s fault or problem, if you think it’s solely a hardware problem, and that’s fine. I’m sure everyone who supports Rasa and wants to use it would like some form of support though, perhaps an update/closer look at the minimum OS/hardware requirements in the docs? A confirmation that a fresh attempt to host Rasa X on GCP/DigitalOcean/etc. is atm working and it’s mostly our(user’s) fault? Sorry if that sounded rude.
EDIT: I finally got it to work, and I’m here to lay some notes (what worked for me) for everyone else reading this in the future.
- Turn on debugMode=“true” on your helm chart deployment(or any other deployment, they have slightly diff methods), it helps you debug your own problems when you see the pod logs
- If you are using HFTransformers, you might need to solve this Training fails when using HFTransformersNLP Rasa X
- If you think your model is quite big (I was using quite a big BERT model, based on the download pre-training 500MB?), increase your RAM from the minimum of 4 to 8gb. <-- this was the last piece of my puzzle.
Increasing the RAM did not make the error disappear, but it did make the training continue (the others were right, it actually does not abort your training)