Kafka event broker making everything incredibly slow

Rasa Open Source
1

We followed this documentation to set up the Kafka event broker via the endpoints configuration: Event Brokers

It worked, but made the bot responses very slow. Prior to adding the event broker, the rest API was able to respond to ~50 requests per second. After adding it, it started to take several seconds per request.

Is this the expected behaviour? The event files are very large, so I wasn’t completely surprised that it was taking so long. Is there any way to configure what gets picked up? We are only interested in a few states and not in capturing the entire tracker for each conversation.

Thanks

2

In case anyone else is following, we ended up solving for this by moving away from InMemoryTracker and upgrading to Rasa 2.2.x – haven’t dug too much into the source code, but it seemed much faster to send events in the newer version.