Reference Documents
https://github.com/sysown/proxysql
http://www.fordba.com/mysql_proxysql_rw_split.html
https://www.cnblogs.com/zhoujinyi/p/6829983.htmlTencent cloud main cdb library can provide read-only VIP + VIP from a form library, you need to maintain two VIP use and when this development can not be automatically read and write separation, proxysql combination clb and cdb to read and write the automatic separation plan based on the status quo.
Architecture is as follows:
App - CLB four --proxysql-- read from main vip vip +
A .ProxySQL deployment
1. Download and install Start
[root@VM_8_24_centos ~]# wget https://github.com/sysown/proxysql/releases/download/v2.0.8/proxysql-2.0.8-1-centos7.x86_64.rpm
[root@VM_8_24_centos ~]# rpm -ivh proxysql-2.0.8-1-centos7.x86_64.rpm
[root@VM_8_24_centos ~]# systemctl start proxysql
[root@VM_8_24_centos ~]# systemctl enable proxysql
[root@VM_8_24_centos ~]# netstat -tulpn |grep 603
tcp 0 0 0.0.0.0:6032 0.0.0.0:* LISTEN 26063/proxysql
tcp 0 0 0.0.0.0:6033 0.0.0.0:* LISTEN 26063/proxysql 2. landing test
[root@VM_8_24_centos ~]# mysql -uadmin -padmin -h 127.0.0.1 -P6032
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.5.30 (ProxySQL Admin Module)
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MySQL [(none)]> show databases;
+-----+---------------+-------------------------------------+
| seq | name | file |
+-----+---------------+-------------------------------------+
| 0 | main | |
| 2 | disk | /var/lib/proxysql/proxysql.db |
| 3 | stats | |
| 4 | monitor | |
| 5 | stats_history | /var/lib/proxysql/proxysql_stats.db |
+-----+---------------+-------------------------------------+
5 rows in set (0.01 sec)
MySQL [(none)]> Two .ProxySQL Configuration
1. Architectural
node1 (vip 192.168.0.9:3306), MySQL Master
node2 (vip 192.168.0.42:3306), MySQL Slave
prxoy (192.168.8.24:6033), proxysql
CLB (vip 192.168.9.27:6033), CLB proxysql
App (192.168.0.26), mysql client
Add the 2.proxysql mysql database information from the master
performed on proxysql, the primary database is done writing master node into the group 0, salve node in a group do read into the
syntax is as follows:
insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,max_replication_lag,comment) values(0,'192.168.0.9',3306,1,2000,10,'TESTuser');
insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,max_replication_lag,comment) values(1,'192.168.0.42',3306,1,2000,10,'TESTuser');
select * from mysql_servers;example:
MySQL [(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,ax_replication_lag,comment) values(0,'192.168.0.9',3306,1,2000,10,'TESTuser');
Query OK, 1 row affected (0.00 sec)
MySQL [(none)]> insert into mysql_servers(hostgroup_id,hostname,port,weight,max_connections,ax_replication_lag,comment) values(1,'192.168.0.42',3306,1,2000,10,'TESTuser');
Query OK, 1 row affected (0.00 sec)
MySQL [(none)]> select * from mysql_servers;
+--------------+-----------+------+--------+--------+-------------+-----------------+--------------------+---------+----------------+---------+
| hostgroup_id | hostname | port | status | weight | compression | max_connections | max_relication_lag | use_ssl | max_latency_ms | comment |
+--------------+-----------+------+--------+--------+-------------+-----------------+--------------------+---------+----------------+---------+
| 0 | 192.168.0.9 | 3306 | ONLINE | 1 | 0 | 2000 | 10 | 0 | 0 | TESTuser |
| 1 | 192.168.0.42 | 3306 | ONLINE | 1 | 0 | 2000 | 10 | 0 | 0 | TESTuser |
+--------------+-----------+------+--------+--------+-------------+-----------------+--------------------+---------+----------------+---------+
2 rows in set (0.01 sec)Add the 3.mysql main library proxysql account monitoring and application operations account
on mysql master execution, attention to application operations account to grant permission in accordance with the actual situation, it's best delegated to proxysql host
syntax is as follows:
grant usage on *.* to 'proxysql'@'192.168.8.24' identified by 'ProxySQL@20191226';
grant select, insert, update, delete ON *.* TO 'testuser'@'192.168.8.24' identified by 'TESTuser@20191226';
flush privileges;
select host,user from mysql.user;example:
MySQL [(none)]> grant usage on *.* to 'proxysql'@'192.168.8.24' identified by 'ProxySQL@20191226';
Query OK, 0 rows affected, 1 warning (0.00 sec)
MySQL [(none)]> grant select, insert, update, delete ON *.* TO 'testuser'@'192.168.8.24' identified by 'TESTuser@20191226';
Query OK, 0 rows affected, 1 warning (0.00 sec)
MySQL [(none)]> flush privileges;
Query OK, 0 rows affected (0.00 sec)
MySQL [(none)]> select host,user from mysql.user;
+-----------+------------------+
| host | user |
+-----------+------------------+
| % | TESTuser_data_servic |
| % | TESTuser_rule_rw |
| 192.168.8.24 | proxysql |
| 192.168.8.24 | testuser |
| 127.0.0.1 | root |
| localhost | mysql.sys |
| localhost | root |
+-----------+------------------+
7 rows in set (0.01 sec)Add applications operating on 4.proxysql account
on proxysql execution, attention to the main application account is authorized hostgroup, where 0 is the
syntax is as follows:
insert into mysql_users(username,password,default_hostgroup) values ('testuser','TESTuser@20191226',0);
select * from mysql_users;example:
MySQL [(none)]> insert into mysql_users(username,password,default_hostgroup) values ('testuser','TESTuser@20191226',0);
Query OK, 1 row affected (0.00 sec)
MySQL [(none)]> select * from mysql_users;
+----------+---------------+--------+---------+-------------------+----------------+---------------+------------------------+--------------+---------+----------+-----------------+
| username | password | active | use_ssl | default_hostgroup | default_schema | schema_locked | transaction_persistent | fast_forward | backend | frontend | max_connections |
+----------+---------------+--------+---------+-------------------+----------------+---------------+------------------------+--------------+---------+----------+-----------------+
| testuser | TESTuser@20191226 | 1 | 0 | 0 | NULL | 0 | 1 | 0 | 1 | 1 | 10000 |
+----------+---------------+--------+---------+-------------------+----------------+---------------+------------------------+--------------+---------+----------+-----------------+
1 row in set (0.00 sec)Note: If a password is set mysql_users clear text, where you can use the command to save converted hash value of the password
The syntax is as follows:
save mysql users to mem;example:
MySQL [(none)]> save mysql users to mem;
Query OK, 0 rows affected (0.00 sec)
MySQL [(none)]> select username,password from mysql_users;
+----------+-------------------------------------------+
| username | password |
+----------+-------------------------------------------+
| testuser | *59D7241B6C5F951F331FF88505C582CBCD42482F |
+----------+-------------------------------------------+
1 row in set (0.00 sec)5. Set Monitor account
the proxysql operation, the account number and password account password mysql primary database consistent
syntax is as follows:
update global_variables set variable_value='proxysql' where variable_name='mysql-monitor_username';
update global_variables set variable_value='ProxySQL@20191226' where variable_name='mysql-monitor_password';example:
MySQL [(none)]> update global_variables set variable_value='proxysql' where variable_name='mysql-monitor_username';
Query OK, 1 row affected (0.00 sec)
MySQL [(none)]> update global_variables set variable_value='ProxySQL@20191226' where variable_name='mysql-monitor_password';
Query OK, 1 row affected (0.00 sec)6. Application to line
the operation proxysql
syntax is as follows:
load mysql servers to runtime;
load mysql users to runtime;
load mysql variables to runtime;example:
MySQL [(none)]> load mysql servers to runtime;
Query OK, 0 rows affected (0.01 sec)
MySQL [(none)]> load mysql users to runtime;
Query OK, 0 rows affected (0.00 sec)
MySQL [(none)]> load mysql variables to runtime;
Query OK, 0 rows affected (0.00 sec)7. persistence
operations on proxysql
syntax is as follows:
save mysql servers to disk;
save mysql users to disk;
save mysql variables to disk;example:
MySQL [(none)]> save mysql servers to disk;
Query OK, 0 rows affected (0.07 sec)
MySQL [(none)]> save mysql users to disk;
Query OK, 0 rows affected (0.04 sec)
MySQL [(none)]> save mysql variables to disk;
Query OK, 97 rows affected (0.02 sec)The automatic configuration separate read and write
operations on proxysql, define routing rules, such as: sending to the other slave select * from tb for update to select all of the other statements sent to the master.
The syntax is as follows:
insert into mysql_query_rules(active,match_pattern,destination_hostgroup,apply) values(1,'^SELECT.*FOR UPDATE$',0,1);
insert into mysql_query_rules(active,match_pattern,destination_hostgroup,apply) values(1,'^SELECT',1,1);
load mysql query rules to runtime;
save mysql query rules to disk;example:
MySQL [(none)]> insert into mysql_query_rules(active,match_pattern,destination_hostgroup,apply) values(1,'^SELECT.*FOR UPDATE$',0,1);
Query OK, 1 row affected (0.00 sec)
MySQL [(none)]> insert into mysql_query_rules(active,match_pattern,destination_hostgroup,apply) values(1,'^SELECT',1,1);
Query OK, 1 row affected (0.00 sec)
MySQL [(none)]> load mysql query rules to runtime;
Query OK, 0 rows affected (0.01 sec)
MySQL [(none)]> save mysql query rules to disk;
Query OK, 0 rows affected (0.10 sec)Description: active Indicates whether to enable the sql routing entries, match_pattern is our regular matches, destination_hostgroup mean that we want the class to which mysql sql forwarded to the above, apply to 1 indicates that after the regular match, will no longer accept other matches, directly forwarding.
9. The test results clients
connect to the database through the client interface to access terminal proxysql (6033)
[root@VM_8_24_centos ~]# mysql -utestuser -pTESTuser@20191226 -h 127.0.0.1 -P6033
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.5.30 (ProxySQL)
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MySQL [(none)]> show databases;
+-------------------------+
| Database |
+-------------------------+
| information_schema |
| mysql |
| performance_schema |
| TESTuser_data_services_dev |
| TESTuser_data_services_test |
| TESTuser_rule |
+-------------------------+
7 rows in set (0.01 sec)
MySQL [(none)]> use TESTuser_rule;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
MySQL [TESTuser_rule]> show tables;
+-------------------------------+
| Tables_in_TESTuser_rule |
+-------------------------------+
| organ_1_b_12 |
| organ_1_b_13 |
| organ_1_b_14 |
| organ_1_b_15 |
| organ_1_b_16 |
| organ_1_b_19 |
+-------------------------------+
6 rows in set (0.00 sec)
MySQL [TESTuser_rule]> select * from organ_1_b_12;
+----+--------------------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+---------+-----------+---------------------+
| id | t0 | t1 | t2 | t3 | t4 | t5 | t6 | t7 | t8 | t9 | t10 | t11 | t12 | t13 | t14 | t15 | t16 | t17 | t18 | t19 | user_id | nick_name | created |
+----+--------------------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+---------+-----------+---------------------+
| 1 | 513427199402063414 | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | 1 | admin | 2018-10-31 11:50:38 |
| 2 | 140502198811102244 | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | NULL | 1 | admin | 2018-10-31 14:35:36 |
+----+--------------------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+------+---------+-----------+---------------------+
2 rows in set (0.00 sec)10.proxysql statistical effect
through proxysql interface to normal operation data to see from the management interface statistics ProxySQL: The
syntax is as follows:
select Command,Total_Time_us,Total_cnt from stats_mysql_commands_counters where Total_cnt >0;example:
MySQL [(none)]> select Command,Total_Time_us,Total_cnt from stats_mysql_commands_counters where Total_cnt >0;
+---------+---------------+-----------+
| Command | Total_Time_us | Total_cnt |
+---------+---------------+-----------+
| SELECT | 5650 | 3 |
| SHOW | 7044 | 4 |
+---------+---------------+-----------+
2 rows in set (0.00 sec)View implementation of various types of SQL
syntax is as follows:
select * from stats_mysql_query_digest;example:
MySQL [(none)]> select * from stats_mysql_query_digest;
+-----------+--------------------+----------+--------------------+----------------------------------+------------+------------+------------+----------+----------+----------+
| hostgroup | schemaname | username | digest | digest_text | count_star | first_seen | last_seen | sum_time | min_time | max_time |
+-----------+--------------------+----------+--------------------+----------------------------------+------------+------------+------------+----------+----------+----------+
| 1 | TESTuser_rule | testuser | 0x504CF0771C9E548B | select * from organ_1_b_12 | 1 | 1577341448 | 1577341448 | 3746 | 3746 | 3746 |
| 0 | TESTuser_rule | testuser | 0x99531AEFF718C501 | show tables | 2 | 1577341415 | 1577341425 | 2252 | 669 | 1583 |
| 1 | information_schema | testuser | 0x620B328FE9D6D71A | SELECT DATABASE() | 1 | 1577341415 | 1577341415 | 1904 | 1904 | 1904 |
| 0 | information_schema | testuser | 0x02033E45904D3DF0 | show databases | 1 | 1577341374 | 1577341374 | 2326 | 2326 | 2326 |
| 0 | TESTuser_rule | testuser | 0x02033E45904D3DF0 | show databases | 1 | 1577341415 | 1577341415 | 2466 | 2466 | 2466 |
| 0 | information_schema | testuser | 0x226CD90D52A2BA0B | select @@version_comment limit ? | 1 | 1577341364 | 1577341364 | 0 | 0 | 0 |
+-----------+--------------------+----------+--------------------+----------------------------------+------------+------------+------------+----------+----------+----------+
6 rows in set (0.00 sec)11. solved by clb proxysql single point of failure and liabilities balanced
network clb 192.168.9.27 tcp 6033 port to port within 192.168.8.24 6033, other proxysql bind to.
[root@VM_0_26_centos ~]# mysql -utestuser -p -h 192.168.9.27 -P6033
Enter password:
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MySQL connection id is 2699
Server version: 5.5.30 (ProxySQL)
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MySQL [(none)]> show databases;
+-------------------------+
| Database |
+-------------------------+
| information_schema |
| mysql |
| performance_schema |
| TESTuser_data_services_dev |
| TESTuser_data_services_test |
| TESTuser_rule |
+-------------------------+
7 rows in set (0.01 sec)
MySQL [(none)]> select user,host from mysql.user;
+------------------+-----------+
| user | host |
+------------------+-----------+
| TESTuser_data_servic | % |
| TESTuser_rule_rw | % |
| proxysql | 192.168.8.24 |
| testuser | 192.168.8.24 |
| root | 127.0.0.1 |
| mysql.sys | localhost |
| root | localhost |
+------------------+-----------+
7 rows in set (0.01 sec)