Distributed relational database for easy data analysis to deal with ten billion scene Solutions

What MyCat that?

Definition and classification point of view, it is an open source distributed database system is a realization of the MySQL protocol server, front-end user can see it as a proxy database with MySQL client tools and command-line access, and its MySQL backend native protocol can communicate with a plurality MySQL server, JDBC protocol can also be used to communicate with the main server most databases, the core function library separate read and write sub-table points, i.e. a large table is divided into N small horizontal table in the back-end server in the MySQL database or other store. You can also specify multiple read-write library multiple libraries.

MyCat to the current version, is not a simple MySQL proxy, and its back-end can support MySQL, SQL Server, Oracle, DB2, PostgreSQL and other mainstream database, MongoDB also supports the storage of this new NoSQL way of the future will support for more types of storage. And in the end user's perspective, whether it is the kind of storage, in MyCat, the tables are a traditional database supports standard SQL statements manipulate the data, and this way, the front-end business systems, can significantly reduce difficult to develop, improve development speed.

MyCat can do?

Simple separate read and write, this time most simple configuration, separate read and write support, from the switching master

Sub-table and warehouses for more than 10 million of table fragmentation, up to 100 billion single-table fragmentation

Multi-tenant applications, each one library, but the application only connection Mycat, so as not to transform the program itself, multi-tenant of

Reporting system, by means of sub-table capabilities Mycat, handling large-scale statistical reports

Alternative Hbase, analysis of large data

As a simple and effective program in real-time massive data queries, such as 10 billion records often need to check out the query results in 3 seconds

MyCat Distributed architecture:
Distributed relational database for easy data analysis to deal with ten billion scene Solutions

Distributed relational database for easy data analysis scenarios to deal with ten billion plan
ten billion transverse slice data stored in the data analysis framework

the whole idea:

(1) the use of sub-libraries mycat sub-table of rules, lateral assessed ten billion data to different nodes;

(2) implemented on each node in a multi-primary backup, data backup and separate read and write;

(3) all write operations is first calculated according to rule mycat, the routing node to the designated write operation;

(4) After the polymerization will be apportioned to each query mycat up node calculation, and then aggregated process based on a result of the node;

(5) the use of visual data analysis tools NBI large and Mycat seamless connection;

(6) by NBI large data visualization analysis tools ( http://nbi.easydatavis.com:8033 ) drag and drop analysis provides, you can complete various types of analytical reports and data quick ten billion, second response user experience.

Guess you like

Origin blog.51cto.com/14465598/2430052