Interaction from BOT to AGENT

Rasa Open Source
1

Hi guys, I have a problem with my thesis project (this is last point of my thesis) : I built a Rasa bot and I’ve integrated it in my website that is a photo viewer based on Mirador. I’ve created some interactions AGENT TO BOT with ‘user_uttered’ , this interactions works in this way: we have 3 photos : X,Y and Z. If you clicks on X , and ask the bot “What is this?” he answers with “It’s X” but when you click on Y and ask the bot "“What is this?” he answers with “It’s Y”.

Now I would like to create an interaction BOT TO AGENT, like for example if I am on photo of X and ask the bot “What is Y?” , I want that the page changes to the photo of Y automatically. Can you help me?

The way I did the first interaction is simple: I have an intent : What_Is , and the answer changes according to the value of a slot : Topic and I have another intent : Page_Change who acquires the link of the photo changed through the ‘user uttered’. I’ve created synonyms between the words of my topic and the link of the photos who represent each topic and when the intent Page_Change arrives, it triggers a custom action that set the slots of entity : Topic with the link of the page. And it works very well.

Now as I said, I’d like to create an interaction from the BOT to AGENT. If you can help me, thank you so much

2

Thinking about the problem, the solution I want to implement is to create a custom action in rasa that send to the webpage the link of the photo, and when the site receive the link he changes photo thanks to the link that I send with the custom action. Can you give me some example for doing this?

3

Most of the work for this is done in your front end web page/widget. The response would contain the web URL for the image and your web page app would extract that from the message and update the page.

1 Like
4

This is precisely how we do it as well.

Our chat widget (custom built angular) accepts a custom response from Rasa. That custom response is never seen by the user (as a text message), the widgets sees the custom response come through and that triggers the chat UI to manipulate something on the screen. You can do that a couple different ways depending on what language you wrote your chat UI with. This lets us send special types of content and have the chat UI render them properly.