MySQL性能调优 读写分离

其他 2019-04-28 14:10:32 阅读次数: 0
Top

NSD DBA2 DAY02

  1. 案例1：MySQL性能优化
  2. 案例2：实现MySQL读写分离

1 案例1：MySQL性能优化

1.1 问题

  • 练习相关优化选项
  • 启用慢查询日志
  • 查看各种系统变量、状态变量

1.2 步骤

实现此案例需要按照如下步骤进行。

步骤一：mysql性能优化

1）查看服务运行时的参数配置

  1. mysql> show variables\G;
  2. ......
  3. *************************** 171. row ***************************
  4. Variable_name: innodb_log_file_size
  5. Value: 50331648
  6. *************************** 172. row ***************************
  7. Variable_name: innodb_log_files_in_group
  8. Value: 2
  9. *************************** 173. row ***************************
  10. Variable_name: innodb_log_group_home_dir
  11. Value: ./
  12. *************************** 174. row ***************************
  13. Variable_name: innodb_log_write_ahead_size
  14. Value: 8192
  15. *************************** 175. row ***************************
  16. Variable_name: innodb_lru_scan_depth
  17. Value: 1024
  18. *************************** 176. row ***************************
  19. Variable_name: innodb_max_dirty_pages_pct
  20. Value: 75.000000
  21. *************************** 177. row ***************************
  22. Variable_name: innodb_max_dirty_pages_pct_lwm
  23. Value: 0.000000
  24. *************************** 178. row ***************************
  25. Variable_name: innodb_max_purge_lag
  26. Value: 0
  27. ......
  29. mysql> show variables like "%innodb%";
  30. +------------------------------------------+------------------------+
  31. | Variable_name | Value |
  32. +------------------------------------------+------------------------+
  33. | ignore_builtin_innodb | OFF |
  34. | innodb_adaptive_flushing | ON |
  35. | innodb_adaptive_flushing_lwm | 10 |
  36. | innodb_adaptive_hash_index | ON |
  37. | innodb_adaptive_hash_index_parts | 8 |
  38. | innodb_adaptive_max_sleep_delay | 150000 |
  39. ......
  40. ......
  41. | innodb_undo_log_truncate | OFF |
  42. | innodb_undo_logs | 128 |
  43. | innodb_undo_tablespaces | 0 |
  44. | innodb_use_native_aio | ON |
  45. | innodb_version | 5.7.17 |
  46. | innodb_write_io_threads | 4 |
  47. +------------------------------------------+------------------------+
  48. 134 rows in set (0.01 sec)

2）并发连接数量

查看当前已经使用的连接数

  1. mysql> flush status;
  2. Query OK, 0 rows affected (0.00 sec)
  3. mysql> show global status like "Max_used_connections";
  4. +----------------------+-------+
  5. | Variable_name | Value |
  6. +----------------------+-------+
  7. | Max_used_connections | 3 |
  8. +----------------------+-------+
  9. 1 row in set (0.00 sec)

查看默认的最大连接数

  1. mysql> show variables like "max_connections%";
  2. +-----------------+-------+
  3. | Variable_name | Value |
  4. +-----------------+-------+
  5. | max_connections | 151 |
  6. +-----------------+-------+
  7. 1 row in set (0.00 sec)

3）连接超时时间

  1. mysql> show variables like "%timeout%";
  2. +-----------------------------+----------+
  3. | Variable_name | Value |
  4. +-----------------------------+----------+
  5. | connect_timeout | 10 |
  6. | delayed_insert_timeout | 300 |
  7. | have_statement_timeout | YES |
  8. | innodb_flush_log_at_timeout | 1 |
  9. | innodb_lock_wait_timeout | 50 |
  10. | innodb_rollback_on_timeout | OFF |
  11. | interactive_timeout | 28800 |
  12. | lock_wait_timeout | 31536000 |
  13. | net_read_timeout | 30 |
  14. | net_write_timeout | 60 |
  15. | rpl_stop_slave_timeout | 31536000 |
  16. | slave_net_timeout | 60 |
  17. | wait_timeout | 28800 |
  18. +-----------------------------+----------+
  19. 13 rows in set (0.00 sec)

4）允许保存在缓存中被重用的线程数量

  1. mysql> show variables like "thread_cache_size";
  2. +-------------------+-------+
  3. | Variable_name | Value |
  4. +-------------------+-------+
  5. | thread_cache_size | 9 |
  6. +-------------------+-------+
  7. 1 row in set (0.00 sec)

5）用于MyISAM引擎的关键索引缓存大小

  1. mysql> show variables like "key_buffer_size";
  2. +-----------------+---------+
  3. | Variable_name | Value |
  4. +-----------------+---------+
  5. | key_buffer_size | 8388608 |
  6. +-----------------+---------+
  7. 1 row in set (0.00 sec)

6）为每个要排序的线程分配此大小的缓存空间

  1. mysql> show variables like "sort_buffer_size";
  2. +------------------+--------+
  3. | Variable_name | Value |
  4. +------------------+--------+
  5. | sort_buffer_size | 262144 |
  6. +------------------+--------+
  7. 1 row in set (0.00 sec)

7）为顺序读取表记录保留的缓存大小

  1. mysql> show variables like "read_buffer_size";
  2. +------------------+--------+
  3. | Variable_name | Value |
  4. +------------------+--------+
  5. | read_buffer_size | 131072 |
  6. +------------------+--------+
  7. 1 row in set (0.01 sec)

8）为所有线程缓存的打开的表的数量

  1. mysql> show variables like "table_open_cache";
  2. +------------------+-------+
  3. | Variable_name | Value |
  4. +------------------+-------+
  5. | table_open_cache | 2000 |
  6. +------------------+-------+
  7. 1 row in set (0.00 sec)

步骤二：SQL查询优化

1）常用日志种类及选项，如图-1所示：

图-1

记录慢查询，图-2所示：

启用慢查询日志

  1. [root@master10 ~]# vim /etc/my.cnf
  2. ...
  3. slow_query_log=1
  4. slow_query_log_file=mysql-slow.log
  5. long_query_time=5
  6. log_queries_not_using_indexes=1
  7. ...
  8. [root@master10 ~]# systemctl restart mysqld

2）查看慢查询日志

  1. [root@master10 ~]# mysqldumpslow /var/lib/mysql/mysql-slow.log
  3. Reading mysql slow query log from /var/lib/mysql/mysql-slow.log
  4. Count: 1 Time=0.00s (0s) Lock=0.00s (0s) Rows=0.0 (0), 0users@0hosts

查看缓存的大小

  1. mysql> show variables like "query_cache%";
  2. +------------------------------+---------+
  3. | Variable_name | Value |
  4. +------------------------------+---------+
  5. | query_cache_limit | 1048576 |
  6. | query_cache_min_res_unit | 4096 |
  7. | query_cache_size | 1048576 |
  8. | query_cache_type | OFF |
  9. | query_cache_wlock_invalidate | OFF |
  10. +------------------------------+---------+
  11. 5 rows in set (0.00 sec)

3）查看当前的查询缓存统计

  1. mysql> show global status like "qcache%";
  2. +-------------------------+---------+
  3. | Variable_name | Value |
  4. +-------------------------+---------+
  5. | Qcache_free_blocks | 1 |
  6. | Qcache_free_memory | 1031832 |
  7. | Qcache_hits | 0 |
  8. | Qcache_inserts | 0 |
  9. | Qcache_lowmem_prunes | 0 |
  10. | Qcache_not_cached | 40 |
  11. | Qcache_queries_in_cache | 0 |
  12. | Qcache_total_blocks | 1 |
  13. +-------------------------+---------+
  14. 8 rows in set (0.00 sec)

2 案例2：实现MySQL读写分离

2.1 问题

  • 搭建一主一从结构
  • 配置maxscale代理服务器
  • 测试分离配置

2.2 方案

使用4台RHEL 7虚拟机，如图-1所示。其中192.168.4.10和192.168.4.20，分别提供读、写服务，均衡流量，通过主从复制保持数据一致性，由MySQL代理192.168.4.100面向客户端，收到SQL写请求时，交给服务器A处理，收到SQL读请求时，交给服务器B处理。linux客户机用于测试配置，可以使用真机代替

图－1

2.3 步骤

实现此案例需要按照如下步骤进行。

步骤一：搭建主从

1）搭建一主一从结构，主库192.168.4.10上面操作

  1. [root@master10 ~]# vim /etc/my.cnf
  2. [mysqld]
  3. server_id=10    //指定服务器ID号
  4. log-bin=master10        //启用binlog日志，并指定文件名前缀
  5. ...
  6. [root@master10 ~]# systemctl restart mysqld        //重启mysqld

2）从库192.168.4.20上面操作

  1. [mysqld]
  2. server_id=20            //指定服务器ID号，不要与Master的相同
  3. log-bin=slave20        //启动SQL日志，并指定文件名前缀
  4. read_only=1            //只读模式
  5. ...
  6. [root@slave20 ~]# systemctl restart mysqld

3）主库授权一个用户并查看master的状态

  1. [root@master10 ~]# mysql -u root -p123456
  2. mysql> grant all on *.* to 'replicater'@'%' identified by '123456';
  3. Query OK, 0 rows affected, 1 warning (0.00 sec)
  4. mysql> show master status;
  5. +-----------------+----------+--------------+------------------+-------------------+
  6. | File | Position | Binlog_Do_DB | Binlog_Ignore_DB | Executed_Gtid_Set |
  7. +-----------------+----------+--------------+------------------+-------------------+
  8. | master10.000002 | 449 | | | |
  9. +-----------------+----------+--------------+------------------+-------------------+
  10. 1 row in set (0.00 sec)

4）从库通过CHANGE MASTER语句指定MASTER服务器的IP地址、同步用户名/密码、起始日志文件、偏移位置（参考MASTER上的状态输出）

  1. [root@slave20 ~]# mysql -u root -p123456
  2. mysql> change master to master_host='192.168.4.10',
  3. -> master_user='replicater',
  4. -> master_password='123456',
  5. -> master_log_file='master10.000002',
  6. -> master_log_pos=738;
  7. Query OK, 0 rows affected, 2 warnings (0.01 sec)
  9. mysql> start slave;
  10. Query OK, 0 rows affected (0.01 sec)
  12. mysql> show slave status\G;
  13. *************************** 1. row ***************************
  14. Slave_IO_State: Waiting for master to send event
  15. Master_Host: 192.168.4.10
  16. Master_User: replicater
  17. Master_Port: 3306
  18. Connect_Retry: 60
  19. Master_Log_File: master10.000002
  20. Read_Master_Log_Pos: 738
  21. Relay_Log_File: slave20-relay-bin.000002
  22. Relay_Log_Pos: 319
  23. Relay_Master_Log_File: master10.000002
  24. Slave_IO_Running: Yes
  25. Slave_SQL_Running: Yes
  26. Replicate_Do_DB:
  27. Replicate_Ignore_DB:
  28. Replicate_Do_Table:
  29. Replicate_Ignore_Table:
  30. Replicate_Wild_Do_Table:
  31. Replicate_Wild_Ignore_Table:
  32. Last_Errno: 0
  33. Last_Error:
  34. Skip_Counter: 0
  35. Exec_Master_Log_Pos: 738
  36. Relay_Log_Space: 528
  37. Until_Condition: None
  38. Until_Log_File:
  39. Until_Log_Pos: 0
  40. Master_SSL_Allowed: No
  41. Master_SSL_CA_File:
  42. Master_SSL_CA_Path:
  43. Master_SSL_Cert:
  44. Master_SSL_Cipher:
  45. Master_SSL_Key:
  46. Seconds_Behind_Master: 0
  47. Master_SSL_Verify_Server_Cert: No
  48. Last_IO_Errno: 0
  49. Last_IO_Error:
  50. Last_SQL_Errno: 0
  51. Last_SQL_Error:
  52. Replicate_Ignore_Server_Ids:
  53. Master_Server_Id: 10
  54. Master_UUID: 95ada2c2-bb24-11e8-abdb-525400131c0f
  55. Master_Info_File: /var/lib/mysql/master.info
  56. SQL_Delay: 0
  57. SQL_Remaining_Delay: NULL
  58. Slave_SQL_Running_State: Slave has read all relay log; waiting for more updates
  59. Master_Retry_Count: 86400
  60. Master_Bind:
  61. Last_IO_Error_Timestamp:
  62. Last_SQL_Error_Timestamp:
  63. Master_SSL_Crl:
  64. Master_SSL_Crlpath:
  65. Retrieved_Gtid_Set:
  66. Executed_Gtid_Set:
  67. Auto_Position: 0
  68. Replicate_Rewrite_DB:
  69. Channel_Name:
  70. Master_TLS_Version:
  71. 1 row in set (0.00 sec)

5）测试，主库创建aa库

  1. mysql> create database aa;
  2. Query OK, 1 row affected (0.00 sec)
  4. mysql> show databases;
  5. +--------------------+
  6. | Database |
  7. +--------------------+
  8. | information_schema |
  9. | aa |
  10. | mysql |
  11. | performance_schema |
  12. | sys |
  13. +--------------------+
  14. 5 rows in set (0.00 sec)

6）从库上面查看，有aa库

  1. mysql> show databases;
  3. +--------------------+
  4. | Database |
  5. +--------------------+
  6. | information_schema |
  7. | aa |
  8. | mysql |
  9. | performance_schema |
  10. | sys |
  11. +--------------------+
  12. 5 rows in set (0.00 sec)

步骤二：实现mysql读写分离

1）配置数据读写分离服务器192.168.4.100

环境准备关闭防火墙和SElinux，保证yum源可以正常使用

  1. [root@maxscale ~]# cd mysql/
  2. [root@maxscale mysql]# ls
  3. maxscale-2.1.2-1.rhel.7.x86_64.rpm
  4. [root@maxscale mysql]# rpm -ivh maxscale-2.1.2-1.rhel.7.x86_64.rpm         
  5. //安装maxscale
  6. warning: maxscale-2.1.2-1.rhel.7.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID 8167ee24: NOKEY
  7. Preparing... ################################# [100%]
  8. Updating / installing...
  9. 1:maxscale-2.1.2-1 ################################# [100%]

2）配置maxscale

  1. [root@maxscale mysql]# vim /etc/maxscale.cnf.template
  2. [maxscale]
  3. threads=auto            //运行的线程的数量
  5. [server1]            //定义数据库服务器
  6. type=server
  7. address=192.168.4.10        //数据库服务器的ip
  8. port=3306
  9. protocol=MySQLBackend        //后端数据库
  13. [server2]
  14. type=server
  15. address=192.168.4.20
  16. port=3306
  17. protocol=MySQLBackend
  21. [MySQL Monitor]                //定义监控的数据库服务器
  22. type=monitor
  23. module=mysqlmon
  24. servers=server1, server2        //监控的数据库列表，不能写ip
  25. user=scalemon                    //监视数据库服务器时连接的用户名scalemon
  26. passwd=123456                    //密码123456
  27. monitor_interval=10000        //监视的频率 单位为秒
  31. #[Read-Only Service]        //不定义只读服务器
  32. #type=service
  33. #router=readconnroute
  34. #servers=server1
  35. #user=myuser
  36. #passwd=mypwd
  37. #router_options=slave
  41. [Read-Write Service]            //定义读写分离服务
  42. type=service
  43. router=readwritesplit
  44. servers=server1, server2
  45. user=maxscaled            //用户名 验证连接代理服务时访问数据库服务器的用户是否存在
  46. passwd=123456                //密码
  47. max_slave_connections=100%
  51. [MaxAdmin Service]        //定义管理服务
  52. type=service
  53. router=cli
  57. #[Read-Only Listener]        //不定义只读服务使用的端口号
  58. #type=listener
  59. #service=Read-Only Service
  60. #protocol=MySQLClient
  61. #port=4008
  65. [Read-Write Listener]            //定义读写服务使用的端口号
  66. type=listener
  67. service=Read-Write Service
  68. protocol=MySQLClient
  69. port=4006
  73. [MaxAdmin Listener]        //管理服务使用的端口号
  74. type=listener
  75. service=MaxAdmin Service
  76. protocol=maxscaled
  77. socket=default
  78. port=4099     //手动添加，不指定时使用的是默认端口在启动服务以后可以知道默认端口是多少

3）根据配置文件的设置，在数据库服务器上添加授权用户（主库执行，从库查看）

  1. mysql> grant replication slave,replication client on *.* to scalemon@'%' identified by "123456";            //监控数据库服务器时，连接数据库服务器的用户
  2. Query OK, 0 rows affected, 1 warning (0.00 sec)
  4. mysql> grant select on mysql.* to maxscaled@"%" identified by "123456";
  5. //验证 访问数据时，连接数据库服务器使用的用户，是否在数据库服务器上存在的，连接用户
  6. Query OK, 0 rows affected, 1 warning (0.01 sec)

4）查看授权用户

在主库上面查看

  1. mysql> select user,host from mysql.user where user in ("scalemon","maxscaled");
  2. +-----------+------+
  3. | user | host |
  4. +-----------+------+
  5. | maxscaled | % |
  6. | scalemon | % |
  7. +-----------+------+
  8. 2 rows in set (0.00 sec)

在从库上面查看

  1. mysql> select user,host from mysql.user where user in ("scalemon","maxscaled");
  2. +-----------+------+
  3. | user | host |
  4. +-----------+------+
  5. | maxscaled | % |
  6. | scalemon | % |
  7. +-----------+------+
  8. 2 rows in set (0.00 sec)

测试授权用户

  1. [root@maxscale mysql]# mysql -h 192.168.4.10 -u scalemon -p123456
  2. [root@maxscale mysql]# mysql -h 192.168.4.20 -u scalemon -p123456
  3. [root@maxscale mysql]# mysql -h 192.168.4.10 -u maxscaled -p123456
  4. [root@maxscale mysql]# mysql -h 192.168.4.20 -u maxscaled -p123456

5）启动服务

  1. [root@maxscale ~]# maxscale -f /etc/maxscale.cnf
  2. [root@maxscale ~]# ps -C maxscale        //查看进程
  3. PID TTY TIME CMD
  4. 17930 ? 00:00:00 maxscale
  5. [root@maxscale ~]# netstat -antup | grep maxscale //查看端口
  6. tcp6 0 0 :::4099 :::* LISTEN 17930/maxscale
  7. tcp6 0 0 :::4006 :::* LISTEN 17930/maxscale

6）测试，在本机访问管理端口查看监控状态

maxadmin -P端口 -u用户名 -p密码

  1. [root@maxscale ~]# maxadmin -P4099 -uadmin -pmariadb
  2. MaxScale>
  3. MaxScale> list servers
  4. Servers.
  5. -------------------+-----------------+-------+-------------+--------------------
  6. Server | Address | Port | Connections | Status
  7. -------------------+-----------------+-------+-------------+--------------------
  8. server1 | 192.168.4.10 | 3306 | 0 | Master, Running
  9. server2 | 192.168.4.20 | 3306 | 0 | Slave, Running
  10. -------------------+-----------------+-------+-------------+--------------------

7）在客户端访问读写分离服务器（没有mysql命令可以安装）

mysql -h读写分离服务ip -P4006 -u用户名 -p密码

  1. [root@slave53 ~]# mysql -h192.168.4.100 -P4006 -ureplicater -p123456
  2. mysql> select @@hostname;            //查看当前主机名
  3. +------------+
  4. | @@hostname |
  5. +------------+
  6. | slave20 |
  7. +------------+
  8. 1 row in set (0.00 sec)
  9. mysql> create table t2(id int(4) );
  10. Query OK, 0 rows affected (0.02 sec)
  12. mysql> insert into aa.t2 values(777);
  13. Query OK, 1 row affected (0.01 sec)

在主库上面查看

  1. mysql> use aa
  2. mysql> select * from t2;
  3. +------+
  4. | id |
  5. +------+
  6. | 777 |
  7. +------+
  8. 1 row in set (0.00 sec)

从库（主库同步到从库）

  1. mysql> use aa
  2. mysql> select * from t2;
  3. +------+
  4. | id |
  5. +------+
  6. | 777 |
  7. +------+
  8. 1 row in set (0.00 sec)

猜你喜欢

转载自www.cnblogs.com/tiki/p/10783527.html
今日推荐
开源日报 | Chrome内置Gemini的意义不在于Gemini；中国AI追随之路的五大误区；ECharts创始人“下海”养鱼；谷歌I/O开发者大会什么都有，只是没有惊喜
微软回应中国区AI团队“打包赴美”传闻
基于大语言模型的开源知识库问答系统 MaxKB GitHub Star 数量突破 5,000 个！
美国拟限制 AI 大模型出口中国和俄罗斯
苹果将与 OpenAI 达成协议，将 ChatGPT 应用于 iPhone
openKylin 社区生态委员会第六次会议圆满召开
阿里云正式发布通义千问 2.5
Python 3.13 发布首个 Beta：实验性自由线程模式和 JIT、改进交互式解释器
Stack Overflow 拿我的代码去训练 AI 大模型，还封了我的账号
Pop!_OS 的 COSMIC 桌面完成 App Store 上架工作
《2024 年一季度互联网投融资运行情况》研究报告
报告：Django 仍然是 74% 开发者的首选
周排行
返回指定时间格式
fopen函数中的mode参数
Java 单例模式探讨
Flex remoteobject工作原理探讨
寻找mplayer的便捷安装方法
30天了解30种技术系列---(26)MySQL自动化运维工具Inception
关于Jboss/Tomcat/Jetty的JNDI定义123
程序减肥，strip，eu-strip 及其符号表
AsyncTask、View.post(Runnable)、ViewTreeObserver三种方式总结frame animation自动启动
Json和Bean的互相转换
每日归档
更多
2024-05-15(24)
2024-05-14(0)
2024-05-13(18)
2024-05-12(0)
2024-05-11(38)
2024-05-10(38)
2024-05-09(35)
2024-05-08(42)
2024-05-07(14)
2024-05-06(40)

代码天地 © 2018 codetd.com

境外服务器   最新电视剧2022