Speaking of big data, it is estimated we all feel only heard of the concept, but what is the specific thing, how definition, not a standard thing, because like many companies in our minds called big data companies, there are hundreds of business forms kind of feeling is not well understood, so I suggest to understand big data literally, in the Victor Meyer - Schoenberg and Kenny Basescu Kayah written in "the era of big data," mentions four characteristics of big data:
1. a large number of
The first feature of large data reflected as "big", from the first Map3 era, a tiny MB level Map3 to meet the needs of many people, but as time goes on, the storage unit from the past GB to TB, even now PB, EB level. Only data volume amounted to more than PB level, it can be called big data. 1PB equal 1024TB, 1TB equal 1024G, then 1PB data equal to 1024 * 1024 G's. With the rapid development of information technology, data to explode. Social networking (micro-blog, Twitter, Facebook), mobile network, a variety of intelligence tools, service tools, have become the source of the data. Commodity trading Taobao data generated nearly 400 million members every day about 20TB; face book log data about 10 million users daily production of more than 300TB. The urgent need for intelligent algorithms, powerful data processing platforms and new data processing techniques to statistics, analysis, forecasting and data such large-scale real-time processing.
2. High-speed
By algorithm is very fast data processing speed logic, the law of one second, it can quickly obtain information from various types of high-value data, which is also the traditional data mining techniques are essentially different. A large data very quickly, mainly through the Internet transmission. Everyone in life is inseparable from the Internet, which means that individuals are offering a lot of information to large data every single day. And these data are the need for timely treatment, because it takes a lot of capital to small historical data storage role is very worthwhile, for a platform, and perhaps save the data only in the past few days, or a month, then far data will be cleared up, or too costly. Based on this situation, there is a large data processing speed is very strict requirements, a large number of server resources to process and calculate data, many platforms need to do real-time analysis. Data generated all the time, who's faster, who have the advantage.
3. diverse
If only a single data, these data, there is no value, such as personal data only a single, or a single user to submit data, which can not be called big data. A wide range of data sources, determines the size of the data in the form of diversity. Such as the current Internet users, age, education, hobbies, personality and so everyone's not the same feature, this is the great diversity of data, of course, if extended to the whole country, the diversity of the data will be stronger, every regions, each period, there will be a wide variety of data diversity. Any form of data can have an effect, the most widely used is the recommendation system, such as Taobao, Netease cloud music, headlines today, these platforms will be analyzed by the log data to the user, thereby further recommended users like things. Log data is clearly structured data, there are some obvious structured data, such as images, audio, video, data causal relationship is weak, we need to be manually marked.
4. Value
This is the central feature of big data. According to Yi Ge understanding of product design data generated in the real world, a small proportion of valuable data. Compared to traditional small data, big data is that the greatest value through machine learning, artificial intelligence by various types of data from a large number of unrelated, dig out valuable data analysis and forecasting of future trends and patterns depth analysis or data mining methods, the discovery of new laws and new knowledge. If you have more than 1PB all 20 national - Internet data 35 young people of the time, then it naturally have commercial value, such as through the analysis of these data, we know that these people are interested in, then guide the development direction of the product and so on . If you have several million patients nationwide data, analyze these data can predict the occurrence of disease, the value of these are big data. Extensive use of big data, used in various fields such as agriculture, finance, health care, etc., which ultimately improve social governance, improve production efficiency, the effect of promoting scientific research.
Big Data has become the rules of the game in the last few years most of the industry, industry leaders, renowned scholars and other stakeholders agree on this point, with the large data continue to penetrate into our daily lives, the hype around big data is He turned to the true value of actual use.
If you learn just big data, you want to learn through this article on big data, I suggest that you can close out the pages, big data entry is easy to learn, to achieve high-paying system is absolutely necessary to learn, of course, if you think through the large data to improve your income, you can read a detailed article I recommend
Recommended Reading articles
What Big Data Engineer Ali in the interview process?
Big Data requires learning how to base?
Experience big data development engineer salary 30K summary?
