Kafka event broker making everything incredibly slow

We followed this documentation to set up the Kafka event broker via the endpoints configuration: Event Brokers

It worked, but made the bot responses very slow. Prior to adding the event broker, the rest API was able to respond to ~50 requests per second. After adding it, it started to take several seconds per request.

Is this the expected behaviour? The event files are very large, so I wasn’t completely surprised that it was taking so long. Is there any way to configure what gets picked up? We are only interested in a few states and not in capturing the entire tracker for each conversation.


In case anyone else is following, we ended up solving for this by moving away from InMemoryTracker and upgrading to Rasa 2.2.x – haven’t dug too much into the source code, but it seemed much faster to send events in the newer version.