Rasa Voice Interface - future plans?

Having seen the blog post on building a voice assistant I’ve long been meaning to try it out and finally did this weekend :slightly_smiling_face:

It’s great, thanks a lot for putting it together @juste I had quite a few road bumps on the way to getting it working, and am interested in finding out more about the general direction for the Voice Interface.

Q. Are the repo and/or blog post expected to be updated much?

There’s a few points where it might do with some improvement.

I don’t know if others had these issues but I couldn’t get the TTS working in the same process as DeepSpeech and the way it’s architected, it seems like it risks problems whenever any of the three underlying projects get updated (especially regarding python dependencies). I ended up running the TTS demo server as a separate process and calling that via requests (replacing most of the TTS code in the connector).

There is a bug with CORS, and another one with Sanic (for which there’s a workaround), there’s that duckling error too (although it seems it’s fine to ignore), the dependencies are a bit of a nightmare (and barely touched on in the blog) and a few details are missing (eg installing Sara skips the requirements.txt step). Nothing impossible to figure out but it might help others if they could be updated.

Q.Are there any plans to simplify the voice demo?

Sara is cool but it does seem to require various things that are peripheral (eg the duckling docker image just adds needless complexity; it has a bunch of dependencies for things that Sara uses but aren’t really necessary for voice, eg for the newsletter sign-up etc)

One small point on the blog, in case it helps others, the original link I’d arrived at from Twitter was for the AMP version and in that version none of the script sections from GitHub showed up correctly. As there were a number of other instructions missing in the main text (eg directories to do things in) I initially thought the script sections mentioned had been missed out the blog in error. It was only when I got to the connector code section that I was stuck without the complete script and spotted the AMP thing :slightly_smiling_face:

For anyone interested, here’s a video of my installation working: https://youtu.be/C2LYAU39rA4

3 Likes