Matrix Chat Integration

Optionally you can also integrate matrix chat for receiving alerts. We use the project https://github.com/metio/matrix-alertmanager-receiver for this as the base project.

Configuration

In the grafana chart values files you need to enable it with values like this.

matrixAlertmanagerReceiver:
  enabled: true
  homeserverUrl: "https://mozilla.modular.im/"
  userId: "@chat-bot:mozilla.org"

The homeserverUrl and userId values need to be replaced with your settings.

The access token for the chat needs to be set in the kubriX OpenBao instance in kubrix-kv\observability\matrix with the property accessToken.

With this, a matrix-alertmanager-receiver pod gets deployed which forwards your grafana alerts to the matrix chat.

Platform team and application team alerting config

To send platform team alerts and team alerts to this matrix chat, you need to specify the internally deployed matrix-alertmanager-receiver as the receiver url:

In the team-onboarding values file for the platformteam:

platformteam:
  alerting:
    defaultReceiver: platform-team-default
    groupBy:
      - grafana_folder
      - alertname
      - namespace
      - severity
    contactPoints:
      platform-team-default:
        receivers:
          - uid: platform-team-default
            type: webhook
            settings:
              url: "http://matrix-alertmanager-receiver:3000/alerts/{roomId}"
            disableResolveMessage: false

... and for the application teams (optional):

teams:
  - name: my-awesome-team
    alerting:
      defaultReceiver: my-awesome-team-default
      groupBy:
        - grafana_folder
        - alertname
        - namespace
        - severity
      contactPoints:
        uniweb-default:
          receivers:
            - uid: my-awesome-team-default
              type: webhook
              settings:
                url: "http://matrix-alertmanager-receiver:3000/alerts/{roomId}"
              disableResolveMessage: false

The {roomId} needs to get replaced with your specific room, e.g. !mXXX:mozilla.org. So the url will then look like http://matrix-alertmanager-receiver:3000/alerts/!mXXX:mozilla.org .

Additional infos are in the Alerting docs.