prometheus监控系统搭建

prometheus监控系统搭建
其他参考https://blog.csdn.net/weixin_43815140/article/details/119730821

服务端安装

>服务端使用docker部署prometheus、grafana

准备文件

mkdir -p /data/docker/prometheus/server/
chmod -R 755 /data/docker/prometheus/server/
mkdir -p /data/docker/prometheus/grafana/
vi /data/docker/prometheus/server/prometheus.yml

global:
alerting:
alertmanagers:
- static_configs:
- targets:
rule_files:
scrape_configs:
- job_name: "prometheus"
static_configs:
- targets: ["localhost:9090"]
- job_name: 'node_exporter-199'
scrape_interval: 10s
static_configs:
- targets: ['192.168.2.199:9100'] #主机 192.168.2.199:9100

创建prometheus容器

docker run --name prometheus -p 9090:9090 --restart=always
-v /data/docker/prometheus/server/prometheus.yml:/etc/prometheus/prometheus.yml
-v /data/docker/prometheus/server/rules.yml:/etc/prometheus/rules.yml
-itd prom/prometheus
--config.file=/etc/prometheus/prometheus.yml
--web.enable-lifecycle

创建grafana容器获取到grafana.ini后删除容器

docker run --name=grafana -p 3000:3000 -itd grafana/grafana
docker cp grafana:/etc/grafana/grafana.ini /data/docker/prometheus/grafana/
docker rm -f grafana
chmod 777 /data/docker/prometheus/*

创建正式的grafana容器

docker run -p 3000:3000 --name grafana --restart=always
-v /data/docker/prometheus/grafana/grafana.ini:/etc/grafana/grafana.ini
-v /data/docker/prometheus/grafana/data:/var/lib/grafana
-itd grafana/grafana

测试

浏览器访问：http://192.168.2.199:9090

浏览器访问：http://192.168.2.199:3000

被监控端安装

https://prometheus.io/docs/instrumenting/exporters/
根据需要选择监控主机资源、mysql、redis等对应的exporter。
此处以centos7系统监控为例

安装node_exporter监控主机

centos7：
https://github.com/prometheus/node_exporter
curl -Lo /etc/yum.repos.d/_copr_ibotty-prometheus-exporters.repo https://copr.fedorainfracloud.org/coprs/ibotty/prometheus-exporters/repo/epel-7/ibotty-prometheus-exporters-epel-7.repo
yum install node_exporter -y
systemctl start node_exporter && systemctl enable node_exporter
模板推荐 16098

其他主机介绍：
win主机监控 https://github.com/prometheus-community/windows_exporter/releases
#win主机模板 https://grafana.com/grafana/dashboards/10467

安装cadvisor监控主机上的docker容器

docker run -v /:/rootfs:ro -v /var/run:/var/run/:rw -v /sys:/sys:ro -v /var/lib/docker:/var/lib/docker:ro -p 18001:8080 --detach=true --name=cadvisor google/cadvisor
模板id 1566 893 10619 11600 395 193

安装mysqld_exporter监控主机上的mysql

下载地址
https://github.com/prometheus/mysqld_exporter/releases

mysql创建账号并授权
CREATE USER 'exporter'@'localhost' IDENTIFIED BY 'xxx'; #mysql5.6不能用WITH MAX_USER_CONNECTIONS 3,后面手动限制下连接数
GRANT PROCESS, REPLICATION CLIENT, SELECT ON . TO 'exporter'@'localhost';

创建配置/mysqld_exporter.my.cnf
[client]
user=exporter
password=xxx
host=localhost
port=3306

运行：
./mysqld_exporter --config.my-cnf=/mysqld_exporter.my.cnf

模板id ：

配置

grafanas设置数据源为prometheus ，docekr部署的注意下图ip

prometheuss设置exporters
vim /data/docker/prometheus/server/prometheus.yml
添加如下：
- job_name: 'node_exporter-1'
scrape_interval: 10s
static_configs:
- targets: ['192.168.2.xx:9100']

重启prometheuss容器

docker restart prometheuss

grafanas导入模板

下图输入位置，输入8919,8919是别人做的中文的主机监控模板，
https://starsl.cn/article/8919.html

推荐使用id为16098的模板，效果直观，对应效果图如下