Logical-physical test backup MySQL

Logical-physical test backup MySQL

table of Contents

Logical backup
mysqldump Common backup
mysqlpump parallel backup
mysqlpump compression parallel backup
mydumper parallel backup
mydumper parallel compressed backup
Summary
physical backup
xtrabackup compressed backup
xtrabackup parallel compressed backup
innobackupex parallel compressed backup
innobackupex xbstream streaming backup
innobackupex xbstream streaming compressed parallel backup
streaming backup innobackupex tar
innobackupex tar stream compressed backup
innobackupex tar parallel flow type compression backup
Summary

Logical backup
mysqldump normal backup

<font style="vertical-align: inherit;"><font style="vertical-align: inherit;">time mysqldump -uadmin -padmin -h127.0.0.1 -p3306 --routines --set-gtid-purged = off --triggers --events --single-transaction --master-data = 2 --all-databases> /data/compressed/backup.sql</font></font>

real 0m19.349s 
user 0m3.879s 
sys 0m0.951s

du -sh /data/compressed/ && rm -rf /data/compressed/*

362M / data / compression /

mysqlpump Parallel backup

<font style="vertical-align: inherit;"><font style="vertical-align: inherit;">time mysqlpump -uadmin -padmin -h127.0.0.1 -p3306 --set-gtid-purged = off --triggers --default-parallelism = 4 --routines --events --single-transaction --all-databases> /data/compressed/backup.sql</font></font>

The real 0m7.714s
user 0m7.149s
SYS 0m0.611s

du -sh /data/compressed/

213M / data / compression /

时间lz4_decompress /data/compressed/backup.sql /data/backup.sql 
ll -h /data/backup.sql 
-rw -r - r-- 1 root root 363m sep 16 19:53 /data/backup.sql

mydumper Parallel backup

<font style="vertical-align: inherit;"><font style="vertical-align: inherit;">time mydumper -u admin -p admin -h 127.0.0.1 -p 3306 --routines --triggers -t 4 --events -o / data / compressed</font></font>

The real 0m7.582s
user 0m1.810s
SYS 0m0.715s

du -sh /data/compressed/

119 m / data / compression /

note

mydumper备份mysql gtid单独存放在元文件里

cat / data / compressed / metadata 
start dump：2018-09-16 17:33:32 
show master status：
log：mysql-bin.000002 
pos：47557983 
gtid：898db7fe-f80a-11e7-b8d4-fa163efd7144：1-75

完成转储：2018-09-16 17:33:45

summary

对2.3g datadir分别进行逻辑备份，占用时间最短的是mysqlpump并行备份（7s）;占用空间最小的是mydumper并行压缩备份（119m），对于数据库较小可以采用mysqldpump或mydumper并行备份，备份速度都要优于mysqldump的。

物理备份
xtrabackup --version 
xtrabackup版本2.4.8

ll / usr / bin / innobackupex lrwxrwxrwx 
。1 root root 10 jan 22 2018 / usr / bin / innobackupex - > xtrabackup 
innobackupex是xtrabackup的软链接，在percona-xtrabackup8.0版本中被移除

du -sh /opt/mysql/data/3306/

2.3g / opt / mysql / data / 3306 /

xtrabackup压缩备份
？
1
time xtrabackup --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock   --backup --compress --target-dir=/data/compressed/
真正的0m44.597s 
用户0m4.905s 
sys 0m1.562s

du -sh /data/compressed/
675m /数据/压缩/

yum -y install qpress

time xtrabackup --decompress --target-dir = / data / compressed / 
real 0m28.961s 
user 0m4.767s 
sys 0m5.995s

xtrabackup并行压缩备份
？
1
time xtrabackup --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock   --backup --compress --compress-threads=4 --parallel=4 --target-dir=/data/compressed/

The real 0m31.813s
user 0m5.159s
SYS 0m1.803s

du -sh /data/compressed/

673m / data / compression /

time xtrabackup --decompress --parallel=4 --target-dir=/data/compressed/

The real 0m24.684s
user 0m5.384s
SYS 0m8.028s

innobackupex并行压缩备份
？
1
time /usr/bin/innobackupex  --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock    --compress --compress-threads=4 --parallel=4  /data/compressed/

The real 0m29.864s
user 0m4.680s
SYS 0m1.460s

innobackupex xbstream流式备份
mkdir -p /data/backup<font></font>
time innobackupex --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock  --stream=xbstream /data/backup/ > /data/backup/backup.xbstream

The real 0m42.509s
user 0m0.947s
SYS 0m2.642s

du -ch /data/backup/

1.9g / data / backup /
A total of 1.9g

time xbstream -x</data/backup/backup.xbstream -c /backup

The real 0m28.451s
user 0m0.308s
SYS 0m13.889s

innobackupex xbstream flow parallel backup compression

time innobackupex --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock  --stream=xbstream --compress   --compress-threads=4  --parallel=4  /data/backup/ > /data/backup/backup.xbstream

The real 0m35.992s
user 0m4.988s
SYS 0m1.909s

du -sh /data/backup/

672M / Data / Backup /
innobackupex the tar stream backup

time innobackupex  --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock --stream=tar /data/backup/ > /data/backup/out.tar

The actual 0m40.338s
user 0m0.641s
SYS 0m2.726s
du -SH / Data / Backup /
1.9 g of / Data / Backup /

innobackupex tar stream backup compression

time innobackupex  --defaults-file=/opt/mysql/etc/3306/my.cnf  -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock --stream=tar /data/backup/  | gzip > /data/backup/out.tar.gz

The real 1m47.964s
user 1m19.120s
SYS 0m2.883s

du -ch /data/backup/
476m / data / backup /

innobackupex tar流式压缩并行备份
并行备份无效
time innobackupex  --defaults-file=/opt/mysql/etc/3306/my.cnf   --parallel=4   -uadmin -padmin --socket=/opt/mysql/data/3306/mysqld.sock --stream=tar /data/backup/  | gzip > /data/backup/out.tar.gz

The real 1m50.192s
user 1m18.925s
SYS 0m2.768s

xtrabackup: Use O_DIRECT
InnoDB: number of pools:. 1
xtrabackup: warning: - "Parallel" option to have no effect upon "the tar" streaming format. You can use the 'xbstream' format.

Summary
of 2.3g datadir were physical backup, the backup takes the shortest parallel backup compression innobackupex (30s) and a parallel backup compression xtrabackup (31S), followed by compression innobackupex xbstream flow parallel backup (35S); minimal backup space innobackupex tar stream is compressed backup (476m), innobackupex tar stream backup does not support parallel backup

When the backup time more concerned, recommended xtrabackup / innobackupex parallel backup compression, if more concerned about the size of backup space occupied, compressed streaming recommended innobackupex tar backup
physical backup data volume for

Reference
percona xtrabackup - Documents