Rasa X - AWS ECS Fargate Deployment

So I’m about to take my test bot setup on Rasa X and setup the Devops pipeline for it and will be using AWS Cloud Development Kit to deploy the entire stack as well. I don’t really foresee any major issues since I can use RDS for the postgres part but has anyone else done anything like this yet am I way off base on this working?

One issue I have is where the models and stuff are saved locally since in this case I don’t have true storage with the way Fargate works so I might have to stick to EC2 ECS unless someone can shed any light on options to store this data somewhere else and bring it in.

It seems like it should be pretty straight forward with a ALB just forwarding to the internal port exposed on the container.

Can you set up EFS with Fargate?

No EFS is only supported right now on AWS EC2 I know its coming for fargate soon though. I was figuring I would still have to have EFS since even if I had my models and stuff pulling from AWS it still trains and loads all that locally right?

Was just trying to outline my Pipeline stuff for jenkins and how this process might work before I deploy it.

I already have AWS CDK python code to deploy all of this via code as well so I can share it all when its all ready, I just wanted to confirm before I build it out I’ll have to use ECS EC2 with EFS so I can have it load balanced out and scaled it up or down.

I’m going to use Aurora Postgres for the tracker store.

Yeah Im not the AWS expert, but I think if you want persistent and scalable (i.e. new instances launched in a cluster get the volumes too), EFS is the way to go. Not sure quite how EBS works, but I’ve seen about of horror stories of people losing their data randomly on EBS

Yea EFS is the proper solution if there are requirements for local storage which it sounds like there is atm

Yeah, models are stored on disk so it’s definitely a requirement in that sense