MySQL/MariaDB数据库的性能测试

　　　 　　MySQL/MariaDB数据库的性能测试

　　　　　　　　　　　　　　　　　　　　　　　　作者：尹正杰 

版权声明：原创作品，谢绝转载！否则将追究法律责任。

 

 

一.数据库服务衡量指标

qps: 
　　query per second（每秒支持多少查询）

tps: 
　　transaction per second（每秒支持多少个事务性能）

 

二.压力测试工具

mysqlslap:
　　Mariadb自带的测试脚本

Sysbench：功能强大
　　https://github.com/akopytov/sysbench

tpcc-mysql

MySQL Benchmark Suite

MySQL super-smack

MyBench

 

三.Mysqlslap使用案例

1>.Mysqlslap概述

Mysqlslap：
　　来自于mariadb包，测试的过程默认生成一个mysqlslap的schema,生成测试表t1，查询和插入测试数据，mysqlslap库自动生成，如果已经存在则先删除。用--only-print来打印实际的测试过程，整个测试完成后不会在数据库中留下痕迹

使用格式：
　　mysqlslap [options]

2>.Mysqlslap常用参数 [options] 说明：

--auto-generate-sql, -a 
　　自动生成测试表和数据，表示用mysqlslap工具自己生成的SQL脚本来测试并发压力
　　
--auto-generate-sql-load-type=type 
　　测试语句的类型。代表要测试的环境是读操作还是写操作还是两者混合的。取值包括：read，key，write，update和mixed(默认)

--auto-generate-sql-add-auto-increment 
　　代表对生成的表自动添加auto_increment列，从5.1.18版本开始支持

--number-char-cols=N, -x N 
　　自动生成的测试表中包含多少个字符类型的列，默认1

--number-int-cols=N, -y N 
　　自动生成的测试表中包含多少个数字类型的列，默认1

--number-of-queries=N 
　　总的测试查询次数(并发客户数×每客户查询次数)

--query=name,-q 
　　使用自定义脚本执行测试，例如可以调用自定义的存储过程或者sql语句来执行测试

--create-schema 
　　代表自定义的测试库名称，测试的schema

--commint=N 
　　多少条DML后提交一次

--compress, -C 
　　如服务器和客户端都支持压缩，则压缩信息

--concurrency=N, -c N 
　　表示并发量，即模拟多少个客户端同时执行select。可指定多个值，以逗号或者--delimiter参数指定值做为分隔符
　　如：--concurrency=100,200,500

--engine=engine_name, -e engine_name 
　　代表要测试的引擎，可以有多个，用分隔符隔开。例如：--engines=myisam,innodb

--iterations=N, -i N 
　　测试执行的迭代次数，代表要在不同并发环境下，各自运行测试多少次

--only-print 
　　只打印测试语句而不实际执行。

--detach=N 
　　执行N条语句后断开重连

--debug-info, -T 
　　打印内存和CPU的相关信息

[root@node103.yinzhengjie.org.cn ~]# mysqlslap --help
mysqlslap  Ver 1.0 Distrib 5.5.64-MariaDB, for Linux (x86_64)
Copyright (c) 2005, 2018, Oracle, MariaDB Corporation Ab and others.

Run a query multiple times against the server.

Usage: mysqlslap [OPTIONS]

Default options are read from the following files in the given order:
/etc/mysql/my.cnf /etc/my.cnf ~/.my.cnf 
The following groups are read: mysqlslap client client-server client-mariadb
The following options may be given as the first argument:
--print-defaults          Print the program argument list and exit.
--no-defaults             Don't read default options from any option file.
The following specify which files/extra groups are read (specified before remaining options):
--defaults-file=#         Only read default options from the given file #.
--defaults-extra-file=#   Read this file after the global files are read.
--defaults-group-suffix=# Additionally read default groups with # appended as a suffix.

  -?, --help          Display this help and exit.
  -a, --auto-generate-sql 
                      Generate SQL where not supplied by file or command line.
  --auto-generate-sql-add-autoincrement 
                      Add an AUTO_INCREMENT column to auto-generated tables.
  --auto-generate-sql-execute-number=# 
                      Set this number to generate a set number of queries to
                      run.
  --auto-generate-sql-guid-primary 
                      Add GUID based primary keys to auto-generated tables.
  --auto-generate-sql-load-type=name 
                      Specify test load type: mixed, update, write, key, or
                      read; default is mixed.
  --auto-generate-sql-secondary-indexes=# 
                      Number of secondary indexes to add to auto-generated
                      tables.
  --auto-generate-sql-unique-query-number=# 
                      Number of unique queries to generate for automatic tests.
  --auto-generate-sql-unique-write-number=# 
                      Number of unique queries to generate for
                      auto-generate-sql-write-number.
  --auto-generate-sql-write-number=# 
                      Number of row inserts to perform for each thread (default
                      is 100).
  --commit=#          Commit records every X number of statements.
  -C, --compress      Use compression in server/client protocol.
  -c, --concurrency=name 
                      Number of clients to simulate for query to run.
  --create=name       File or string to use create tables.
  --create-schema=name 
                      Schema to run tests in.
  --csv[=name]        Generate CSV output to named file or to stdout if no file
                      is named.
  -#, --debug[=#]     This is a non-debug version. Catch this and exit.
  --debug-check       Check memory and open file usage at exit.
  -T, --debug-info    Print some debug info at exit.
  --default-auth=name Default authentication client-side plugin to use.
  -F, --delimiter=name 
                      Delimiter to use in SQL statements supplied in file or
                      command line.
  --detach=#          Detach (close and reopen) connections after X number of
                      requests.
  -e, --engine=name   Comma separated list of storage engines to use for
                      creating the table. The test is run for each engine. You
                      can also specify an option for an engine after a `:',
                      like memory:max_row=2300
  -h, --host=name     Connect to host.
  --init-command=name SQL Command to execute when connecting to MySQL server.
                      Will automatically be re-executed when reconnecting.
  -i, --iterations=#  Number of times to run the tests.
  --no-drop           Do not drop the schema after the test.
  -x, --number-char-cols=name 
                      Number of VARCHAR columns to create in table if
                      specifying --auto-generate-sql.
  -y, --number-int-cols=name 
                      Number of INT columns to create in table if specifying
                      --auto-generate-sql.
  --number-of-queries=# 
                      Limit each client to this number of queries (this is not
                      exact).
  --only-print        Do not connect to the databases, but instead print out
                      what would have been done.
  -p, --password[=name] 
                      Password to use when connecting to server. If password is
                      not given it's asked from the tty.
  --plugin-dir=name   Directory for client-side plugins.
  -P, --port=#        Port number to use for connection.
  --post-query=name   Query to run or file containing query to execute after
                      tests have completed.
  --post-system=name  system() string to execute after tests have completed.
  --pre-query=name    Query to run or file containing query to execute before
                      running tests.
  --pre-system=name   system() string to execute before running tests.
  --protocol=name     The protocol to use for connection (tcp, socket, pipe,
                      memory).
  -q, --query=name    Query to run or file containing query to run.
  -s, --silent        Run program in silent mode - no output.
  -S, --socket=name   The socket file to use for connection.
  --ssl               Enable SSL for connection (automatically enabled with
                      other flags).
  --ssl-ca=name       CA file in PEM format (check OpenSSL docs, implies
                      --ssl).
  --ssl-capath=name   CA directory (check OpenSSL docs, implies --ssl).
  --ssl-cert=name     X509 cert in PEM format (implies --ssl).
  --ssl-cipher=name   SSL cipher to use (implies --ssl).
  --ssl-key=name      X509 key in PEM format (implies --ssl).
  --ssl-verify-server-cert 
                      Verify server's "Common Name" in its cert against
                      hostname used when connecting. This option is disabled by
                      default.
  -u, --user=name     User for login if not current user.
  -v, --verbose       More verbose output; you can use this multiple times to
                      get even more verbose output.
  -V, --version       Output version information and exit.

Variables (--variable-name=value)
and boolean options {FALSE|TRUE}      Value (after reading options)
------------------------------------- ------------------------------------
auto-generate-sql                     FALSE
auto-generate-sql-add-autoincrement   FALSE
auto-generate-sql-execute-number      0
auto-generate-sql-guid-primary        FALSE
auto-generate-sql-load-type           mixed
auto-generate-sql-secondary-indexes   0
auto-generate-sql-unique-query-number 10
auto-generate-sql-unique-write-number 10
auto-generate-sql-write-number        100
commit                                0
compress                              FALSE
concurrency                           (No default value)
create                                (No default value)
create-schema                         mysqlslap
debug-check                           FALSE
debug-info                            FALSE
default-auth                          (No default value)
delimiter                             

detach                                0
engine                                (No default value)
host                                  (No default value)
init-command                          (No default value)
iterations                            1
no-drop                               FALSE
number-char-cols                      (No default value)
number-int-cols                       (No default value)
number-of-queries                     0
only-print                            FALSE
plugin-dir                            (No default value)
port                                  3306
post-query                            (No default value)
post-system                           (No default value)
pre-query                             (No default value)
pre-system                            (No default value)
query                                 (No default value)
silent                                FALSE
socket                                (No default value)
ssl                                   FALSE
ssl-ca                                (No default value)
ssl-capath                            (No default value)
ssl-cert                              (No default value)
ssl-cipher                            (No default value)
ssl-key                               (No default value)
ssl-verify-server-cert                FALSE
user                                  (No default value)
verbose                               (No default value)
[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

3>.单线程测试

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -a -uroot -pyinzhengjie
Benchmark
    Average number of seconds to run all queries: 0.003 seconds
    Minimum number of seconds to run all queries: 0.003 seconds
    Maximum number of seconds to run all queries: 0.003 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

4>.多线程测试(使用–concurrency来模拟并发连接)

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -a -uroot -pyinzhengjie -c 100
Benchmark
    Average number of seconds to run all queries: 0.653 seconds
    Minimum number of seconds to run all queries: 0.653 seconds
    Maximum number of seconds to run all queries: 0.653 seconds
    Number of clients running queries: 100
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 

5>.迭代测试(用于需要多次执行测试得到平均值)

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -a -uroot -pyinzhengjie -i 10
Benchmark
    Average number of seconds to run all queries: 0.002 seconds
    Minimum number of seconds to run all queries: 0.002 seconds
    Maximum number of seconds to run all queries: 0.003 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -a -uroot -pyinzhengjie --auto-generate-sql-add-autoincrement
Benchmark
    Average number of seconds to run all queries: 0.002 seconds
    Minimum number of seconds to run all queries: 0.002 seconds
    Maximum number of seconds to run all queries: 0.002 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -a -uroot -pyinzhengjie -a --auto-generate-sql-load-type=read
Benchmark
    Average number of seconds to run all queries: 0.001 seconds
    Minimum number of seconds to run all queries: 0.001 seconds
    Maximum number of seconds to run all queries: 0.001 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -a -uroot -pyinzhengjie -a auto-generate-sql-secondary-indexes=3
Benchmark
    Average number of seconds to run all queries: 0.003 seconds
    Minimum number of seconds to run all queries: 0.003 seconds
    Maximum number of seconds to run all queries: 0.003 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie -a --auto-generate-sql-write-number=1000
Benchmark
    Average number of seconds to run all queries: 0.007 seconds
    Minimum number of seconds to run all queries: 0.007 seconds
    Maximum number of seconds to run all queries: 0.007 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie --create-schema mysql -q "select count(*) from user"
Benchmark
    Average number of seconds to run all queries: 0.000 seconds
    Minimum number of seconds to run all queries: 0.000 seconds
    Maximum number of seconds to run all queries: 0.000 seconds
    Number of clients running queries: 1
    Average number of queries per client: 1

[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie -a -e innodb
Benchmark
    Running for engine innodb
    Average number of seconds to run all queries: 0.003 seconds
    Minimum number of seconds to run all queries: 0.003 seconds
    Maximum number of seconds to run all queries: 0.003 seconds
    Number of clients running queries: 1
    Average number of queries per client: 0

[root@node103.yinzhengjie.org.cn ~]# 

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie -a --number-of-queries=10
Benchmark
    Average number of seconds to run all queries: 0.003 seconds
    Minimum number of seconds to run all queries: 0.003 seconds
    Maximum number of seconds to run all queries: 0.003 seconds
    Number of clients running queries: 1
    Average number of queries per client: 10

[root@node103.yinzhengjie.org.cn ~]# 

6>.测试同时不同的存储引擎的性能进行对比

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie -a --concurrency=50,100 --number-of-queries 1000 --iterations=5 --engine=myisam,innodb --debug-infoBenchmark
    Running for engine myisam
    Average number of seconds to run all queries: 0.081 seconds
    Minimum number of seconds to run all queries: 0.080 seconds
    Maximum number of seconds to run all queries: 0.083 seconds
    Number of clients running queries: 50
    Average number of queries per client: 20

Benchmark
    Running for engine myisam
    Average number of seconds to run all queries: 0.183 seconds
    Minimum number of seconds to run all queries: 0.081 seconds
    Maximum number of seconds to run all queries: 0.583 seconds
    Number of clients running queries: 100
    Average number of queries per client: 10

Benchmark
    Running for engine innodb
    Average number of seconds to run all queries: 0.110 seconds
    Minimum number of seconds to run all queries: 0.097 seconds
    Maximum number of seconds to run all queries: 0.130 seconds
    Number of clients running queries: 50
    Average number of queries per client: 20

Benchmark
    Running for engine innodb
    Average number of seconds to run all queries: 0.118 seconds
    Minimum number of seconds to run all queries: 0.111 seconds
    Maximum number of seconds to run all queries: 0.126 seconds
    Number of clients running queries: 100
    Average number of queries per client: 10


User time 0.77, System time 0.46
Maximum resident set size 10628, Integral resident set size 0
Non-physical pagefaults 13187, Physical pagefaults 0, Swaps 0
Blocks in 0 out 0, Messages in 0 out 0, Signals 0
Voluntary context switches 46331, Involuntary context switches 29
[root@node103.yinzhengjie.org.cn ~]# 

7>.执行一次测试，分别50和100个并发，执行1000次总查询

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie -a --concurrency=50,100 --number-of-queries 1000 --debug-info
Benchmark
    Average number of seconds to run all queries: 0.197 seconds
    Minimum number of seconds to run all queries: 0.197 seconds
    Maximum number of seconds to run all queries: 0.197 seconds
    Number of clients running queries: 50
    Average number of queries per client: 20

Benchmark
    Average number of seconds to run all queries: 0.121 seconds
    Minimum number of seconds to run all queries: 0.121 seconds
    Maximum number of seconds to run all queries: 0.121 seconds
    Number of clients running queries: 100
    Average number of queries per client: 10


User time 0.10, System time 0.05
Maximum resident set size 9744, Integral resident set size 0
Non-physical pagefaults 3967, Physical pagefaults 0, Swaps 0
Blocks in 0 out 0, Messages in 0 out 0, Signals 0
Voluntary context switches 5373, Involuntary context switches 15
[root@node103.yinzhengjie.org.cn ~]# 
[root@node103.yinzhengjie.org.cn ~]# 

8>.50和100个并发分别得到一次测试结果(Benchmark)，并发数越多，执行完所有查询的时间越长。为了准确起见，可以多迭代测试几次

[root@node103.yinzhengjie.org.cn ~]# mysqlslap -uroot -pyinzhengjie -a --concurrency=50,100 --number-of-queries 1000 --iterations=5 --debug-info
Benchmark
    Average number of seconds to run all queries: 0.201 seconds
    Minimum number of seconds to run all queries: 0.098 seconds
    Maximum number of seconds to run all queries: 0.595 seconds
    Number of clients running queries: 50
    Average number of queries per client: 20

Benchmark
    Average number of seconds to run all queries: 0.123 seconds
    Minimum number of seconds to run all queries: 0.113 seconds
    Maximum number of seconds to run all queries: 0.138 seconds
    Number of clients running queries: 100
    Average number of queries per client: 10


User time 0.38, System time 0.27
Maximum resident set size 10600, Integral resident set size 0
Non-physical pagefaults 8716, Physical pagefaults 0, Swaps 0
Blocks in 0 out 0, Messages in 0 out 0, Signals 0
Voluntary context switches 26126, Involuntary context switches 19
[root@node103.yinzhengjie.org.cn ~]#