Mattermost Channel debugging

Charlesjwilliams2 · October 10, 2019, 7:26pm

I have a Mattermost site running locally and exposed at localhost:8065. I have a Rasa instance running rasa run --debug locally as well, exposed as localhost:5005. I created an outgoing webhook in Mattermost according to your doc at: https://rasa.com/docs/rasa/user-guide/connectors/mattermost/#getting-credentials and set the Callback URL to http://localhost:5005/webhooks/mattermost/webhook. Does that mean I need to edit the credentials.yml, mattermost section to look like:

mattermost:
  url: "http://localhost:8065/hooks/xx615yapapbipeqyqtn3xasc4a"
  team: "Groupname"
  user: "Username"
  pw: "********"

Where the url is the outgoing webhook with it’s token. Also had to AllowUntrustedInternalConnections to 127.0.0.1/8

I’m getting

2019-10-10 15:23:46 ERROR    rasa.core.channels.mattermost  - Exception when trying to handle message.'token'
2019-10-10 15:23:46 DEBUG    rasa.core.channels.mattermost  - 'token'
Traceback (most recent call last):
  File "c:\programdata\anaconda3\envs\rasa\lib\site-packages\rasa\core\channels\mattermost.py", line 98, in webhook
    self.url, self.team, self.user, self.pw, self.bot_channel
  File "c:\programdata\anaconda3\envs\rasa\lib\site-packages\rasa\core\channels\mattermost.py", line 27, in __init__
    super(MattermostBot, self).login(user, pw)
  File "c:\programdata\anaconda3\envs\rasa\lib\site-packages\mattermostwrapper\wrapper.py", line 39, in login
    self.token = p.headers["Token"] # Store the token for further requests
  File "c:\programdata\anaconda3\envs\rasa\lib\site-packages\requests\structures.py", line 52, in __getitem__
    return self._store[key.lower()][1]
KeyError: 'token'

and no response from the bot.So something is being sent to rasa (I’m trying to find the exact json) and rasa is choking on it.

btotharye · October 15, 2019, 12:49pm

So I can try to take a look at this, I wrote the mattermost wrapper that is used but I also haven’t updated it in a while so this could be related to Mattermost updates as well.

Give me a few days and I’ll test my wrapper code to ensure it isn’t the issue here either. I’m assuming you never have had this working yet?

Thanks

Charlesjwilliams2 · October 15, 2019, 1:39pm

Thank you. The logs appear to indicate that Rasa is receiving some input from the webhook, but is unable to interpret it. Any tips for debugging that I can do on my own?

btotharye · October 15, 2019, 2:39pm

Nothing immediately comes to mind I haven’t tested out the mattermost wrapper I wrote in a while so its very possible something has changed. I just need to get my server up again and test it.

Charlesjwilliams2 · October 16, 2019, 7:38pm

Is there some more setup to do? I have setup a debug environment in Pycharm and with Postman I can call and trace a GET /webhooks/rest and a POST to /webhooks/rest/webhook. But a similar call to GET /webhooks/mattermost does not get to

        @mattermost_webhook.route("/", methods=["GET"])
        async def health(_: Request) -> HTTPResponse:
            return response.json({"status": "ok"})

in /rasa/core/channels/mattermost.py I get

Error: Requested URL /webhooks/mattermost not found

as the 404 response in Postman.

It’s acting like requests are not dispatched to the mattermost handler.

btotharye · October 17, 2019, 7:41am

Hey @Charlesjwilliams2,

So I tested my wrapper and it still works fine here is how I setup my bot and as you can see from the screenshot it works.

I just spun up the basic docker mattermost via:

docker run --name mattermost-preview -d --publish 8065:8065 mattermost/mattermost-preview - Now I have a instance running at whatever my ip/localhost:8065

Then I created the outgoing webhook (I’m also going to look into these new bot account options they have soon) with the following callback url, I just used my ip of my machine:

http://192.168.1.79:5005/webhooks/mattermost/webhook

Made sure I set it up like you mentioned to be a trusted connection in the System Console/Developer section with 192.168.1.0/24

Then my crendentials.yml file looked like this:

rest:

rasa:
  url: "http://localhost:5002/api"

mattermost:
  url: "http://localhost:8065/api/v4"
  team: "testing"
  user: "whatever@domain.com"
  pw: "testing123!"

And it worked fine for me using Rasa 1.3.9

So not sure where this token error is coming from but I don’t think its the connector

Charlesjwilliams2 · October 17, 2019, 4:04pm

Ok. I configured my Rasa environment to match yours above and got the debugger working so I can trace through the mattermost connection. It turned out that I wasn’t invoking the debugger with the --credentials switch. Now I can trace the code from the log:

2019-10-17 11:54:36 ERROR    rasa.core.channels.mattermost  - Exception when trying to handle message.'token'
2019-10-17 11:54:36 DEBUG    rasa.core.channels.mattermost  - 'token'
Traceback (most recent call last):
  File "C:\Users\willic38\Documents\rasa\rasa\rasa\core\channels\mattermost.py", line 173, in message_with_trigger_word
    self.webhook_url,
  File "C:\Users\willic38\Documents\rasa\rasa\rasa\core\channels\mattermost.py", line 44, in __init__
    super(MattermostBot, self).login(user, pw)
  File "C:\ProgramData\Anaconda3\envs\rasa\lib\site-packages\mattermostwrapper\wrapper.py", line 39, in login
    self.token = p.headers["Token"] # Store the token for further requests
  File "C:\ProgramData\Anaconda3\envs\rasa\lib\site-packages\requests\structures.py", line 52, in __getitem__
    return self._store[key.lower()][1]
KeyError: 'token'

It looks like it’s failing to login. The POST is returning a 401.

It’s the user and password for an input webhook.

Charlesjwilliams2 · October 17, 2019, 5:07pm

Ok. My bad. I was using the display name for the user instead of the email format user name. After correcting the credentials.yml, I now get:

So this wasn’t all a total waste. I have figured out how to debug rasa in Pycharm and you can close this ticket. I will try and follow up with an article with the important points for setting up the debug environment.

btotharye · October 18, 2019, 5:45am

Ok great I’m gonna update those docs a little bit as well to be more clear

vuhoa199x · December 1, 2019, 7:56am

Hi charles
i have some issue when intergrate rasabot with mattermost. it alway return log is connection refuse. Can you help me
This is my setting. i cannot understand why my bot cannot connect

vunt39 · December 2, 2019, 6:51am

@btotharye Can you help me about under issue

btotharye · December 2, 2019, 6:49pm

I’m sorry which issue @vunt39 this thread has a lot going on in it. Might even be best to start a new thread with your issue.

btotharye · December 2, 2019, 6:50pm

I have responded to your thread I believe it is because you have the webhook_url commented out in that screenshot.

vunt39 · December 3, 2019, 1:45am

oh. i’m sorry. Because of i see your example that it have no webhook_url so i commented out that line. But now everything it’s ok. i have some problem with the ip in docker. i spent many time on it with the support from my partners.
Thank you so much for reply

btotharye · December 3, 2019, 12:06pm

What was the solution out of curiosity to get it working for you?

vunt39 · December 3, 2019, 12:14pm

oh i just config the webhook url with the ip inside docker. in this case that cannot be the localhost and i have to go inside docker and find. finally it worked

andzejsp · May 6, 2021, 3:00pm

i know im late to the party but im getting problems with this too.

rasax.community.api.blueprints.interface  - Answered 404 with index.html. Request url '/': 'http://192.168.254.89:5002/webhooks/mattermost/webhook'

every time i @ bot i see this in my rasax debug window. dont know why and bot dont reply in mattermost.

in credential i have specified similar to the above guys config… username as email and password…

I also tried webhook url and token with bot but same thing…

In mattermost i get this error in server logs

{"level":"error","ts":1620312841.696581,"caller":"app/notification_email.go:106","msg":"Error while sending the email","user_email":"batja@localhost","error":"unable to connect to the SMTP server: dial tcp 127.0.0.1:10025: connect: connection refused","errorVerbose":"dial tcp 127.0.0.1:10025: connect: connection refused\nunable to connect to the SMTP server\ngithub.com/mattermost/mattermost-server/v5/services/mailservice.ConnectToSMTPServerAdvanced\n\tgithub.com/mattermost/mattermost-server/v5/services/mailservice/mail.go:142\ngithub.com/mattermost/mattermost-server/v5/services/mailservice.ConnectToSMTPServer\n\tgithub.com/mattermost/mattermost-server/v5/services/mailservice/mail.go:150\ngithub.com/mattermost/mattermost-server/v5/services/mailservice.sendMailUsingConfigAdvanced\n\tgithub.com/mattermost/mattermost-server/v5/services/mailservice/mail.go:265\ngithub.com/mattermost/mattermost-server/v5/services/mailservice.SendMailWithEmbeddedFilesUsingConfig\n\tgithub.com/mattermost/mattermost-server/v5/services/mailservice/mail.go:252\ngithub.com/mattermost/mattermost-server/v5/services/mailservice.SendMailUsingConfig\n\tgithub.com/mattermost/mattermost-server/v5/services/mailservice/mail.go:256\ngithub.com/mattermost/mattermost-server/v5/app.(*EmailService).sendMailWithCC\n\tgithub.com/mattermost/mattermost-server/v5/app/email.go:702\ngithub.com/mattermost/mattermost-server/v5/app.(*EmailService).sendMail\n\tgithub.com/mattermost/mattermost-server/v5/app/email.go:695\ngithub.com/mattermost/mattermost-server/v5/app.(*EmailService).sendNotificationMail\n\tgithub.com/mattermost/mattermost-server/v5/app/email.go:691\ngithub.com/mattermost/mattermost-server/v5/app.(*App).sendNotificationEmail.func1\n\tgithub.com/mattermost/mattermost-server/v5/app/notification_email.go:105\ngithub.com/mattermost/mattermost-server/v5/app.(*Server).Go.func1\n\tgithub.com/mattermost/mattermost-server/v5/app/server.go:973\nruntime.goexit\n\truntime/asm_amd64.s:1374"}
{"level":"error","ts":1620312841.7031543,"caller":"app/webhook.go:112","msg":"Event POST failed.","error":"invalid character '<' looking for beginning of value"}

mihai-satmarean · November 25, 2021, 12:29pm

I am having the behaviour that I am tying to use the Helpdesk Assistant, everything seems correctly configured, I get no error but is not sending anything to the channel. Using a curl to test the POST to mattermost works. Usin a curl to sent to mattemost webhook of rasa results in

curl -i -X POST -H "Content-Type: application/json" -d '{"user_id": "cj3fzbpbf6impuiko7tbo4nr","text": "@bot hello", "channel_id": "6oa9c7cy9pdtzrfjt6r5yr6o"}' http://localhost:5005/webhooks/mattermost/webhook
HTTP/1.1 200 OK
Access-Control-Expose-Headers: filename
Access-Control-Allow-Credentials: true
Content-Length: 7
Content-Type: text/plain; charset=utf-8
Connection: keep-alive
Keep-Alive: 5

but nothing is sent. Please help in debugging further.

Topic		Replies	Views
Intergrate rasa with mattermost Rasa Open Source	6	957	June 11, 2023
Rasa integration with Mattermost Bot Account Rasa Open Source	1	376	May 7, 2021
Mattermost intergrate with rasa. Connection refused Rasa Open Source	1	668	December 2, 2019
Integrating Rasa with Mattermost slash command Rasa Open Source	3	648	May 21, 2020
Rasa mattermost bot account Rasa Open Source	3	419	January 1, 2020

Mattermost Channel debugging

Related topics