The pure-Rasa solution would be to use Reminders that are set after every bot response and canceled/reset after every user message.
Otherwise, if you have a custom front-end interface for your bot, you can just do that in your code by triggering an intent if the last message was more than X minutes ago.