1.
Big data (big data) refers to the collection of data can not be captured, managed and treated with conventional software tools within a certain time frame, the new model requires processing in order to have greater decision-making power, strength and insight discovery process optimization capabilities of mass , high growth rates and diverse information assets.
Big Data era quietly come, it has revolutionized the development of information technology, and a profound impact on all aspects of social production and people's lives.
Big Data Era
Third surging wave of information technology, big data era fully open.
According to Kwok Se sodium IBM former CEO perspective, IT field for 15 years will usher in a major change intervals.
Wave of information technology problems occur behalf of the enterprise to solve time stamp
After the first wave of 1980 personal computer information processing Intel, AMD, IBM, Apple, etc.
Second Wave 1995 after years of Internet information transmission Yahoo, Google, Alibaba, etc.
Third Wave after 2010. Things, cloud computing and big data information explosion Amazon, Google, IBM and other
data to produce the way human society has gone through three stages:
Operational phase systems, user-generated content phase, phase-aware systems.
Development process big data:
Infancy:
1990s to the 21st century look, database technology is mature, sophisticated data mining theory, also known as data mining stage.
Maturity:
The first 10 years of the 21st century, large numbers of unstructured data, the traditional database processing difficult to deal with, also known as unstructured data phase. Google published two papers "Google File System" and "based on a simple cluster of data processing: MapReduce", its core technologies include distributed file system GFS, distributed computing framework MapReduce, distributed lock Chubby, and distributed database BigTable, big data research focus during this period was the performance, cloud computing, large data sets parallel computing algorithms, as well as open source distributed architecture (Hadoop).
Large-scale application period:
After 2010, after a large data base technology is mature, academia and the business community have begun to shift and Applied Research, 2013 Big Data technologies began to business, technology, health care, government, education, economy, transportation, logistics and social fields penetration, so 2013 is also known as the first year of big data.
Big Data's four characteristics:
1. The amount of data
2. The range of data types
3. Processing speed
4. Low density value