Big data is an improvement, but we did not need to mythology, but no need to demonize. Big Data is a concept, but we also recognize the world to the current stage of the logical product.
Beginning last year, whether it is the Internet industry or other industries, large data word began to appear frequently.
The nature of things "concept" can always quickly spread in China's Internet circle, and there are many reasons, among them the overall atmosphere caused by: most Internet entrepreneurs all want to change the world through proactive innovation, by capital sought after, and ultimately cash. In this process, the concept quickly spread, packaging, name tags for a variety of products. The pragmatist only passive acceptance, lack of proper awareness and deeper research.
As can be seen from the figure, the concept of large data 2008 begins transmission after, trends in the search Baidu Baidu and Google "big data" and "Big Data" (lower panel PV weighting data, and to reflect equivalent to Google trend comparison):
This term big data, Baidu's Chinese search retrieved the explosive is far higher than Google in English.
This is the infamous Silicon Valley hype cycle (speculation period), is the heritage and development of the Internet industry in China is more powerful.
Joke: "The current big data in the country, is like a bunch of teenagers talking about" sex ", everyone likes to talk about, if they do not talk like normal, but only very few people really experienced. really experienced, but silent, just smiled. " The rapid development of the Internet industry, sooner or later these children will be adults, but so far, the vast majority of beneficiaries only those vendors name tag, like traders sell illegal publications adolescent children.
What in the end is big data?
That in the end what it is big data? Big Data is just a concept still has a real future?
First, the role of all the data, is to find the law.
Materialist dialectics said: the world is material, the material is in motion, the motion is regular, but the law can be mastered. Regardless of the earliest statistics, data analysis occurs on your computer, data mining, and big data now. We are exploring the world of the law, trying to understand the world through the law.
In the era of computers and the Internet does not appear, senior scientist laid the foundations of mathematics and statistics. After the computer appears, a substantial increase in computing power and data storage, sorting and data analysis capabilities are greatly increased. The emergence and development of the Internet, so that means to gather a wealth of further large increase in the amount of data. Through data to find the law of this game is constantly enriched.
This process, more and more data on the one hand, on the other hand more and more "small", how should we say: the evolution of this process can be simply described as "coverage of the whole sample" and "explore the value of micro data . " The essence is that the data models and sampling, because the technology can not get all the features of the object, all of the analog part can only be described by an abstract model of the object. The emergence of the computer and the Internet, the ability to access to information, and greatly enhance the analysis and data mining capabilities, to try to explore sample coverage is growing, and a description of the object itself more and more detailed.
For example, we want to know the quality of this car apples. Previously only a random sample of 100 to see if there is no appearance of vermin corrupted; now sampling 7000, each with more than 30 apple Apple data to describe the features and quality. After the sample does not require 100% of the data are acquired, and then each apple and 100 items of data characterizing the quality, or even the entire growth cycle data.
But regardless of statistics, data analysis, data mining, and present large data. Our mission has not changed from beginning to end: through the collection, collation, analysis data and other means, to find the law, to infer the nature and even predict the future.
Whether at any stage, there are limits to this task is, we can only speculate some, but not all objects of nature. In the technology developed to a certain stage can generate new technologies and methodologies can also be a step closer on speculation and prediction, out of this step can greatly improve productivity, which is the value of big data lies.
Correct view of Big Data
Data does not lie. But to accurately explain one thing, we need enough data and enough microscopic excavation. But the data, never enough. Such as basketball games, data and perception, it will go on forever intertwined. More and more data model, gives the impression of infinitely close to the result; but when the data or perceive any one party to dominate the world, talking about basketball, but also no longer has fun. And no matter how understanding the data, but also need coaching tactics designed to play certain players, team morale and motivation to win the game, the data itself will not "win."
Big data is an improvement, but we did not need to mythology, but no need to demonize. Big Data is a concept, but we also recognize the world to the current stage of the logical product. Rational look at big data, so good for the production and research services, more play our own innovation and initiative, will be more valuable.
Authors strongly recommend reading the article:
Big Data engineers must master the open source tools summary
Big Data senior teach you how to read a large data core technology
Top Big Data engineers need to master the skills
8 big factor data, machine learning and artificial intelligence for future development
