percona toolkit 简介
os: centos 7.4
db: mysql 5.7
software: toolkit 3.0.8
percona toolkit 是一款percona公司推出的优秀的开源的mysql分析工具。
下载
https://www.percona.com/software/database-tools/percona-toolkit
https://www.percona.com/downloads/percona-toolkit/LATEST/
提供git支持
https://github.com/percona/percona-toolkit.git
文档
https://www.percona.com/doc/percona-toolkit/LATEST/index.html
https://www.percona.com/doc/percona-toolkit/3.0/index.html
安装
主要有几种方式
1)yum Repositories方式
yum install http://www.percona.com/downloads/percona-release/redhat/0.1-4/percona-release-0.1-4.noarch.rpm
yum list|grep -i percona
yum install percona-toolkit.x86_64
2)手动rpm包安装
percona-toolkit-3.0.8-1.el7.x86_64.rpm
percona-toolkit-3.0.8-r283ac9a-el7-x86_64-bundle.tar
3)二进制的方式
percona-toolkit-3.0.8_x86_64.tar.gz
4)源码编译
percona-toolkit-3.0.8.tar.gz
5)git方式，越来越多的项目提供git支持了
https://github.com/percona/percona-toolkit.git
这里使用手动rpm方式
# cd /tmp/toolkit
# tar -xvf ./percona-toolkit-3.0.8-r283ac9a-el7-x86_64-bundle.tartoolkit工具是使用perl语言编写和执行的，所以需要系统中有perl环境。
依赖包检查命令为：
# rpm -qa perl-DBI perl-DBD-MySQL perl-Time-HiRes perl-IO-Socket-SSL
# yum install perl-DBI
# yum install perl-DBD-MySQL
# yum install perl-Time-HiRes
# yum install perl-IO-Socket-SSL# rpm -ivh ./percona-toolkit-3.0.8-1.el7.x86_64.rpm
warning: ./percona-toolkit-3.0.8-1.el7.x86_64.rpm: Header V4 DSA/SHA1 Signature, key ID cd2efd2a: NOKEY
error: Failed dependencies:
perl(Term::ReadKey) is needed by percona-toolkit-3.0.8-1.el7.x86_64
# yum list |grep -i readkey
perl-TermReadKey.x86_64 2.30-20.el7 base
# yum install perl-TermReadKey.x86_64
# rpm -ivh ./percona-toolkit-3.0.8-1.el7.x86_64.rpm
warning: ./percona-toolkit-3.0.8-1.el7.x86_64.rpm: Header V4 DSA/SHA1 Signature, key ID cd2efd2a: NOKEY
Preparing... ################################# [100%]
Updating / installing...
1:percona-toolkit-3.0.8-1.el7 ################################# [100%]检查下
# rpm -ql percona-toolkit-3.0.8
/usr/bin/pt-align
/usr/bin/pt-archiver
/usr/bin/pt-config-diff
/usr/bin/pt-deadlock-logger
/usr/bin/pt-diskstats
/usr/bin/pt-duplicate-key-checker
/usr/bin/pt-fifo-split
/usr/bin/pt-find
/usr/bin/pt-fingerprint
/usr/bin/pt-fk-error-logger
/usr/bin/pt-heartbeat
/usr/bin/pt-index-usage
/usr/bin/pt-ioprofile
/usr/bin/pt-kill
/usr/bin/pt-mext
/usr/bin/pt-mongodb-query-digest
/usr/bin/pt-mongodb-summary
/usr/bin/pt-mysql-summary
/usr/bin/pt-online-schema-change
/usr/bin/pt-pmp
/usr/bin/pt-query-digest
/usr/bin/pt-show-grants
/usr/bin/pt-sift
/usr/bin/pt-slave-delay
/usr/bin/pt-slave-find
/usr/bin/pt-slave-restart
/usr/bin/pt-stalk
/usr/bin/pt-summary
/usr/bin/pt-table-checksum
/usr/bin/pt-table-sync
/usr/bin/pt-table-usage
/usr/bin/pt-upgrade
/usr/bin/pt-variable-advisor
/usr/bin/pt-visual-explain
/usr/share/doc/percona-toolkit-3.0.8
/usr/share/doc/percona-toolkit-3.0.8/COPYING
/usr/share/doc/percona-toolkit-3.0.8/Changelog
/usr/share/doc/percona-toolkit-3.0.8/INSTALL
/usr/share/doc/percona-toolkit-3.0.8/README.md
/usr/share/man/man1/percona-toolkit.1p.gz
/usr/share/man/man1/pt-align.1p.gz
/usr/share/man/man1/pt-archiver.1p.gz
/usr/share/man/man1/pt-config-diff.1p.gz
/usr/share/man/man1/pt-deadlock-logger.1p.gz
/usr/share/man/man1/pt-diskstats.1p.gz
/usr/share/man/man1/pt-duplicate-key-checker.1p.gz
/usr/share/man/man1/pt-fifo-split.1p.gz
/usr/share/man/man1/pt-find.1p.gz
/usr/share/man/man1/pt-fingerprint.1p.gz
/usr/share/man/man1/pt-fk-error-logger.1p.gz
/usr/share/man/man1/pt-heartbeat.1p.gz
/usr/share/man/man1/pt-index-usage.1p.gz
/usr/share/man/man1/pt-ioprofile.1p.gz
/usr/share/man/man1/pt-kill.1p.gz
/usr/share/man/man1/pt-mext.1p.gz
/usr/share/man/man1/pt-mysql-summary.1p.gz
/usr/share/man/man1/pt-online-schema-change.1p.gz
/usr/share/man/man1/pt-pmp.1p.gz
/usr/share/man/man1/pt-query-digest.1p.gz
/usr/share/man/man1/pt-show-grants.1p.gz
/usr/share/man/man1/pt-sift.1p.gz
/usr/share/man/man1/pt-slave-delay.1p.gz
/usr/share/man/man1/pt-slave-find.1p.gz
/usr/share/man/man1/pt-slave-restart.1p.gz
/usr/share/man/man1/pt-stalk.1p.gz
/usr/share/man/man1/pt-summary.1p.gz
/usr/share/man/man1/pt-table-checksum.1p.gz
/usr/share/man/man1/pt-table-sync.1p.gz
/usr/share/man/man1/pt-table-usage.1p.gz
/usr/share/man/man1/pt-upgrade.1p.gz
/usr/share/man/man1/pt-variable-advisor.1p.gz
/usr/share/man/man1/pt-visual-explain.1p.gz可以看到工具位于/usr/bin目录下，以pt-开头
下面逐个介绍下，其实最重要的还是看官方文档
https://www.percona.com/doc/percona-toolkit/3.0/index.html
所有的命令都可以通过 pt-xxx –help 来查看具体的使用
/usr/bin/pt-align
格式化输出/usr/bin/pt-archiver
将mysql数据库中表的记录归档到另外一个表或者文件
该工具具只是归档旧的数据，对线上数据的OLTP查询影响比较小。/usr/bin/pt-deadlock-logger
检测mysql的死锁
# pt-deadlock-logger h=localhost/usr/bin/pt-diskstats
GNU/linux 的磁盘监控，比iostat更详细
# pt-diskstats
#ts device rd_s rd_avkb rd_mb_s rd_mrg rd_cnc rd_rt wr_s wr_avkb wr_mb_s wr_mrg wr_cnc wr_rt busy in_prg io_s qtime stime
1.0 sda 0.0 0.0 0.0 0% 0.0 0.0 0.0 0.0 0.0 0% 0.0 0.0 0% 0 0.0 0.0 0.0
1.0 sda2 0.0 0.0 0.0 0% 0.0 0.0 0.0 0.0 0.0 0% 0.0 0.0 0% 0 0.0 0.0 0.0
1.0 dm-0 0.0 0.0 0.0 0% 0.0 0.0 0.0 0.0 0.0 0% 0.0 0.0 0% 0 0.0 0.0 0.0/usr/bin/pt-duplicate-key-checker
在表中查找重复的索引和外键
# pt-duplicate-key-checker -hlocalhost
# ########################################################################
# Summary of indexes
# ########################################################################
# Total Indexes 55/usr/bin/pt-fifo-split
模拟切割文件并通过管道传递给先入先出队列而不用真正的切割文件/usr/bin/pt-find
类似 GNU/linux 的find 命令，查找mysql的表并执行命令
# pt-find --engine InnoDB
`mysql`.`engine_cost`
`mysql`.`gtid_executed`
`mysql`.`help_category`
`mysql`.`help_keyword`
`mysql`.`help_relation`
`mysql`.`help_topic`
`mysql`.`innodb_index_stats`
`mysql`.`innodb_table_stats`
`mysql`.`plugin`
`mysql`.`server_cost`
`mysql`.`servers`
`mysql`.`slave_master_info`
`mysql`.`slave_relay_log_info`
`mysql`.`slave_worker_info`
`mysql`.`time_zone`
`mysql`.`time_zone_leap_second`
`mysql`.`time_zone_name`
`mysql`.`time_zone_transition`
`mysql`.`time_zone_transition_type`
`sys`.`sys_config`/usr/bin/pt-fingerprint
生成查询标识。主要将将sql查询生成queryID，pt-query-digest中的ID即是通过此工具来完成的。
类似于Oracle中的SQL_ID，涉及绑定变量，字面量等
# pt-fingerprint --query "select user, host from users where user = 'root'"
select user, host from users where user = ?/usr/bin/pt-fk-error-logger
将外键相关的错误信息记录到日志或表
# pt-fk-error-logger h=localhost --iterations 1 --dest h=localhost,D=peiybdb1,t=fke/usr/bin/pt-heartbeat
监控mysql复制架构的延迟
Monitor replication lag on slave:
# pt-heartbeat -D test --monitor -h slave-server
Check slave lag once and exit (using optional DSN to specify slave host):
# pt-heartbeat -D test --check h=slave-server/usr/bin/pt-index-usage
# pt-index-usage /var/log/mysql-slow.log --host localhost/usr/bin/pt-ioprofile
对某个pid附加一个strace进程进行IO分析
# pt-ioprofile
Wed Mar 28 11:44:25 CST 2018
Tracing process ID 26153
total filename/usr/bin/pt-kill
Kill掉符合指定条件mysql语句
# pt-kill --busy-time 60 --kill
# pt-kill --busy-time 60 --print/usr/bin/pt-mext
Get output from mysqladmin:
# pt-mext -r -- mysqladmin ext -i10 -c3
Get output from a file:
# pt-mext -r -- cat mysqladmin-output.txt/usr/bin/pt-mongodb-query-digest
/usr/bin/pt-mongodb-summary
/usr/bin/pt-online-schema-change
/usr/bin/pt-pmp
/usr/bin/pt-query-digest
/usr/bin/pt-show-grants
/usr/bin/pt-sift
/usr/bin/pt-slave-delay
/usr/bin/pt-slave-find
/usr/bin/pt-slave-restart
/usr/bin/pt-stalk
/usr/bin/pt-table-checksum
/usr/bin/pt-table-sync
/usr/bin/pt-table-usage
/usr/bin/pt-upgrade
/usr/bin/pt-visual-explain
常用
/usr/bin/pt-summary
# pt-summary/usr/bin/pt-mysql-summary
在尾部也提供当前实例的的配置文件的信息
# pt-mysql-summary --user=root/usr/bin/pt-config-diff
比较服务器的参数文件和服务参数
至少要有2个配置源需要指定，可以用于迁移或升级前后配置文件进行对比
# pt-config-diff /etc/my.cnf h=localhost
1 config difference
Variable /etc/my.cnf node1
========================= =========== =======
binlog_cache_size 16777216 4194304
/usr/bin/pt-variable-advisor
分析MySQL的变量(my.cnf)，并对可能存在的问题提出建议
# pt-variable-advisor --user=root
# WARN delay_key_write: MyISAM index blocks are never flushed until necessary.
# WARN key_buffer_size: The key buffer size is set to its default value, which is not good for most production systems.
# NOTE max_binlog_size: The max_binlog_size is smaller than the default of 1GB.
# WARN max_connections: If the server ever really has more than a thousand threads running, then the system is likely to spend more time scheduling threads than really doing useful work.
# NOTE sort_buffer_size-1: The sort_buffer_size variable should generally be left at its default unless an expert determines it is necessary to change it.
# NOTE innodb_data_file_path: Auto-extending InnoDB files can consume a lot of disk space that is very difficult to reclaim later.
# NOTE innodb_flush_method: Most production database servers that use InnoDB should set innodb_flush_method to O_DIRECT to avoid double-buffering, unless the I/O system is very low performance.
# WARN myisam_recover_options: myisam_recover_options should be set to some value such as BACKUP,FORCE to ensure that table corruption is noticed.
