Having issues with using S3 remote storage:
Environmental variables have been set:
export AWS_SECRET_ACCESS_KEY=<MY_SECRET> export AWS_ACCESS_KEY_ID=<MY_ACCESS> export AWS_DEFAULT_REGION=<MY_REGION> export BUCKET_NAME=<MY_BUCKET> export AWS_ENDPOINT_URL=https://<MY_BUCKET>.s3-<MY_REGION>.amazonaws.com
Now when I try to start the rasa server, a file
<MY_BUCKET> is created in the bucket, ie, of the following address:
Which is strange to me that the bucket name is the same as the filename.
Anyway, the command I am running is as follows:
rasa run -m models --remote-storage aws --debug --endpoints ./endpoints.yml --credentials ./credentials.yml --enable-api
I have also tried it without the
-m models directory being specified:
rasa run --remote-storage aws --debug --endpoints ./endpoints.yml --credentials ./credentials.yml --enable-api
I have also tried it with/without the
--enable-api argument, and, with/without various
*tar.gz model files already pre-uploaded into the bucket.
In all instances, the program crashes with a whole bunch of error code, including the following:
2019-08-19 07:29:58 DEBUG s3transfer.tasks - Exception raised. Traceback (most recent call last): File "/Users/nick/Projects/Python/rasa-x/env/lib/python3.7/site-packages/s3transfer/tasks.py", line 255, in _main self._submit(transfer_future=transfer_future, **kwargs) File "/Users/nick/Projects/Python/rasa-x/env/lib/python3.7/site-packages/s3transfer/download.py", line 345, in _submit **transfer_future.meta.call_args.extra_args File "/Users/nick/Projects/Python/rasa-x/env/lib/python3.7/site-packages/botocore/client.py", line 357, in _api_call return self._make_api_call(operation_name, kwargs) File "/Users/nick/Projects/Python/rasa-x/env/lib/python3.7/site-packages/botocore/client.py", line 661, in _make_api_call raise error_class(parsed_response, operation_name) botocore.exceptions.ClientError: An error occurred (404) when calling the HeadObject operation: Not Found 2019-08-19 07:29:58 DEBUG s3transfer.utils - Releasing acquire 0/None 2019-08-19 07:29:58 ERROR rasa.core.agent - Could not load model due to An error occurred (404) when calling the HeadObject operation: Not Found.
Running the above without the
--remote-storage argument, everything works as expected, with the obvious exception of using locally stored models, rather than the desired S3 stored model.
So all these kinds of bugs leads me to ask the question, has anyone actually scaled a rasa model?