1. What is big data
Big data has become an important driving force for the Internet and other emerging fields to promote business innovation and value-added and enhance the core value of enterprises. It has become an important basic strategic resource of the country and is leading a new round of technological innovation. The strategic significance of big data technology lies not in mastering huge data information, but in professional processing of these meaningful data. In other words, if big data is compared to an industry, the key to achieving profitability in this industry lies in improving the "processing capability" of data and realizing the "value-added" of data through "processing".
Among the many definitions, the more representative one is the 3V definition, which means that big data needs to meet the following three characteristics (3V):
Scale (Volume): The amount of data should be at the PB level, or even at the EB level. 1EB=1024PB 1PB=1024TB
Variety: There are various types of data. In addition to structured data, it also includes semi-structured data and unstructured data.
Velocity: Analyze data in real time and obtain required information.
2. The importance of big data
1. Data has become a resource that can serve the social economy.
Taobao.com: launched a big data application solution on the Taobao platform - Data Rubik's Cube service. Through this service, merchants can understand the macro situation of the industry on the Taobao platform, the market conditions of their own brands, and the behavior of consumers, etc., and can make business decisions based on this.
Amazon: Established an online analysis engine to locate customers and obtain customer feedback through massive transaction data. In the process, Amazon found that the larger the amount of data, the better the analysis results and the higher the profits.
2. Big data is closely related to national development strategy
In March 2012, the Obama administration announced the Big Data Research and Development Project. The plan refers to big data as "the new oil of the future". Six departments and agencies under the US federal government announced an investment of 200 million US dollars to jointly develop core technologies, integrate relevant application talents, and strongly support collaborative innovation. Big data research has been elevated to a national development strategy.
Meteorological data points the way to rational disaster relief: Big data has begun to play an important role in the rescue of "natural disasters" such as earthquakes. Once a natural disaster occurs, big data technology will point the way to "rational disaster relief". Grab the historical meteorological data of the Meteorological Bureau and the Seismological Bureau, the historical data of nebula map changes, as well as the urban planning and housing structure data of the Urban Construction Bureau and the Planning Bureau, etc., and build an evaluation model of atmospheric movement laws and meteorological change correlation analysis, etc. path, accurately predict weather changes, find the best solution, and plan emergency and disaster relief work.
The open sharing of data is the beginning of establishing an open, service-oriented and modern government. From the above cases, it can be seen that it has become an inevitable trend for countries to accelerate data opening, and there is much to be done in the administrative field around big data to keep pace with the times. Through data opening, the government is becoming the leader of "data resourceization" and guiding data to penetrate deeper, becoming an important source of nourishing the well-being of the whole society, and becoming an important reliance for promoting information and economic development.
3. Big data processing technology
Big data processing flow:
1. Data extraction and integration: effectively organize data from different data sources and different types.
2. Data analysis: Effectively analyze the data to discover valuable information or knowledge.
3. Data Interpretation: Present analysis results to users in an easy-to-understand manner.
Key Technology: Cloud Computing
The basic platform and supporting technology of big data. If the applications of various big data are compared to "cars", then the "highway" that supports the operation of these "cars" is cloud computing. It is the advantages of cloud computing in data storage, data management and data analysis that make big data useful.
The era of big data has arrived. Big data is another disruptive technological revolution in the IT industry after cloud computing and the Internet of Things. It will have a huge impact on national governance models, corporate decision-making, organization and business processes, and personal lifestyles. Influence. Reasonable analysis and management of big data will surely promote the progress of science and technology and the development of enterprises, and at the same time provide more benefits and innovative results for the society.
In the era of big data, we must start with basic research, strengthen cooperation and exchanges within and between disciplines, and between academia and industry, and work together to solve new challenges in the era of big data and obtain the huge value contained in big data .