The words big data and cloud computing are always around . However, in fact, many people are always confused about the relationship between cloud computing and big data, so they always put "cloud computing" and "big data" together. Discuss together, but it is not.
To put it simply: cloud computing is the virtualization of hardware resources , and big data is the efficient processing of massive data. Although this explanation is not entirely appropriate, it can help people who are not familiar with the two names to quickly understand the difference. Of course, if the explanation is more vivid, cloud computing is equivalent to our computer and operating system , which virtualizes a large number of hardware resources and allocates them for use.
It can be said that big data is equivalent to a " database " of massive data. Looking at the development of the big data field, we can also see that the current development of big data has been developing in a direction similar to the experience of traditional databases. The development of big data provides enough space.
The overall architecture of big data consists of three layers: data storage , data processing and data analysis. The data must be stored in the storage layer first, and then the corresponding data model and data analysis indicator system are established according to the data requirements and goals to analyze the data to generate value.
And the intermediate timeliness is completed by the powerful parallel computing and distributed computing capabilities provided by the intermediate data processing layer. The three cooperate with each other, which allows big data to generate the ultimate value.
Regardless of the current development of cloud computing, the future trend is: cloud computing, as the bottom layer of computing resources, supports the upper layer of big data processing, and the development trend of big data is real-time interactive query efficiency and analysis capabilities, borrowing Google 's one. The words in a technical paper: "You can manipulate petabytes of data in Fabulous with one mouse click", it is really exciting.