Thank you @anoopshrma, I have tried the blog. It works wonderful. There are some tweaks I’m making to the script. I will share them here when I’m done.
Glad it helped you @namph-sgn
Sure
Could you please elaborate your query
@anoopshrma as I could see whenever the app starts the app loads the models and store its object in the dictionary. But my concern is whenever my Kubernetes pod scale that dictionary will reset. Thus the models will load once again, so the load will again increase on the server and eventually, pod will rescale again thus struck in an infinite loop.