Prometheus+Alertmanager configure email alarm

(1) Install A lertmanager

Installed on k8s-node2 server

[root@k8s-node2 ~]# tar -zxvf alertmanager-0.21.0.linux-amd64.tar.gz

alertmanager-0.21.0.linux-amd64/

alertmanager-0.21.0.linux-amd64/alertmanager

alertmanager-0.21.0.linux-amd64/amtool

alertmanager-0.21.0.linux-amd64/NOTICE

alertmanager-0.21.0.linux-amd64/LICENSE

alertmanager-0.21.0.linux-amd64/alertmanager.yml

[root@k8s-node2 ~]# ls

alertmanager-0.21.0.linux-amd64 alertmanager-0.21.0.linux-amd64.tar.gz anaconda-ks.cfg disk_free.sh node_exporter-1.0.1.linux-amd64.tar.gz

[root@k8s-node2 ~]# cp alertmanager-0.21.0.linux-amd64/alertmanager /usr/local/bin/

[root@k8s-node2 ~]# cp alertmanager-0.21.0.linux-amd64/amtool /usr/local/bin/

[root@k8s-node2 ~]# alertmanager  --version

image

(2) Configure Alertmanager

[root@k8s-node2 ~]# mkdir -pv /etc/alertmanager

mkdir: The  directory "/etc/alertmanager" has been created 

[root@k8s-node2 ~]# cp alertmanager-0.21.0.linux-amd64/alertmanager.yml  /etc/alertmanager/

[root@k8s-node2 ~]# cat /etc/alertmanager/alertmanager.yml  default configuration file

image

(3) Reconfigure Alertmanager

[root @ k8s-node2 alertmanager] # cp alertmanager.yml alertmanager.yml.bak

[root@k8s-node2 alertmanager]# ls

alertmanager.yml alertmanager.yml.bak

[root@k8s-node2 ~]# cat /etc/alertmanager/alertmanager.yml

[root@k8s-node2 alertmanager]# more alertmanager.yml

global:

  smtp_smarthost: 'smtp.qq.com:25'

  smtp_from: '[email protected]'

  smtp_auth_username: '[email protected]'

  smtp_auth_password: '******'

  smtp_require_tls: false 

route:

  receiver: mail   

receivers:

- name: 'mail'

  email_configs:

  - to: '[email protected]'

[root@k8s-node2 alertmanager]# 

(4) Start Alertmanager

[root@k8s-node2 alertmanager]# alertmanager --config.file alertmanager.yml

image

image

(5) in the P rometheus adding the A lertmanage 

# Alertmanager configuration

alerting:

  alertmanagers:

  - static_configs:

    - targets:

       - 192.168.20.43:9093

(6) In the P rometheus add the A lertmanage monitor

 - job_name: 'alertmanager'

    static_configs:

    - targets: ['192.168.20.43:9093']

image

(7) Add alarm rules in P rometheus

groups:

- name: node-up

  rules:

  - alert: node-up

    expr: up{job="k8s-node1"} == 0

    for: 15s

    labels:

      severity: 1

      team: node

    annotations:

      summary: "{{ $labels.instance }}  has stopped running for more than  15s ! "

(8) Add the alarm rules to the P rometheus configuration file

rule_files:

   - "rules/*_rules.yml"

   - "rules/*_alerts.yml"

(9) View configuration rules

image

(10) Test: Stop the k8s-node1 node and see if there is an alarm

image


image

Prompt Pending(1)

image

(11)  View the alarm Alertmanager

image.png

(12)  Check email alarm

image.png

Prometheus+Grafana+Alertmanager + Email alert configuration completed


↓↓ Click "Read the original text" [Join the DevOps operation and maintenance team ]

Related Reading:

1. Deploy Prometheus in two ways

2. Deploy Prometheus+Grafana

Please share to the circle of friends, scan the code and follow

image


Guess you like

Origin blog.51cto.com/15127516/2657702