Disabling inMemoryTrackerStore when using FallbackTrackerStore

Hi when using SQLTrackerStore some connection problems may occur. we would like to fail in those situations and not use inMemoryTrackerStore instead, because that means those messages will be lost when the DB is back up online. Is there any way to do this?

I DO NOT have inMemoryTrackerStore in my endpoints.yml file. The fallback behavior is built-in the rasa core source code.