cadvisor

cadvisor之前版本在kubelet 中集成，1.12后需要单独安装。

cadvisor 指标均以container开头

container_last_seen 最后一次成功抓取的时间戳

docker pull google/cadvisor-canary:latest

v0.32

VERSION=v0.36.0 # use the latest release version from https://github.com/google/cadvisor/releases
sudo docker run \
  --volume=/:/rootfs:ro \
  --volume=/var/run:/var/run:rw \
  --volume=/sys:/sys:ro \
  --volume=/var/lib/docker/:/var/lib/docker:ro \
  --volume=/dev/disk/:/dev/disk:ro \
  --publish=8080:8080 \
  --detach=true \
  --name=cadvisor \
  --privileged \
  --device=/dev/kmsg \
google/cadvisor-canary:latest

修改prometheus 配置

atic_configs:
  - targets:
    - "localhost:8080"
  metric_relabel_configs:
  - source_labels: ["__name__"]
    regex: "(container_tasks_state|container_memory_failures_total)"
    action: drop 
  - source_labels: ["id"]
    regex: "/docker/(.*)"
    replacement: $1
    action: keep
  - source_labels: ["id"]
    regex: "/docker/(.*)"
    action: replace
    target_label: "container_id"