Rasa 3.15 is here: Observability, Voice, and Testing Power-ups!
Hey everyone,
We’re back with Rasa 3.15! We’ve focused on three core pillars: giving you better visibility into LLM behavior, making voice interactions feel natural, and shrinking your testing cycles.
Here’s the breakdown of what’s landing in 3.15:
LLM Observability with Langfuse
Stop guessing how your LLMs are performing. With our new Langfuse integration, every LLM call is automatically traced.
-
Full Visibility: Track inputs, outputs, latency, and cost in real-time.
-
Data-Driven Evaluation: Use production traces to run evaluations and refine your prompts based on how users actually talk to your bot.
First-Class Voice Experience
We’re closing the gap between “robotic” IVRs and human-like voice AI:
-
* DTMF Support: Your assistant can now handle “Press 1 for sales” or keypad entries for account numbers, perfect for noisy environments where voice recognition might struggle.
-
* Streaming Responses: No more awkward silences. We now stream generated responses from enterprise search or the rephraser directly to your voice channels. The audio starts as soon as the first tokens arrive.
Ship Faster with Smarter Testing
We’ve overhauled the QA workflow so you can iterate without the wait:
-
Generative E2E Testing: Test custom actions against “ground truth” using new * grounding and relevance assertions.
-
Isolate & Re-run Failures: Don’t wait for your entire suite to finish. * Export only the failed tests and re-run them specifically:
Bash
# Export failures rasa test e2e -f failed_tests.yml # Re-run only what broke rasa test e2e failed_tests.yml
The “Quality of Life” List
-
DateTime Awareness: Rasa now natively understands “quarter past 9, two days after yesterday” out of the box. See adjustments in the * new system prompt template.
-
Clarification Control: You can now limit the * number of options presented in clarification patterns to avoid overwhelming users.
Ready to upgrade?
Check out the full changelog for the breakdown, and don’t forget to try the Rasa Playground to try out Rasa quickly and easily.