Now the development of big data is getting more and more popular, and the trend is becoming more and more popular. Just like the mobile games ''Honor of Kings'', ''Jedi Survival'' and other games that are very popular among young people now, but as we all know, games are often prosperous for a while, and then sink into the sea. . . . So, many of our small partners in the development of big data will have the following two concerns:
NO.1 Is the current big data industry really lacking talents?
Answer: Yes! In the future, there will be a shortage of 1.5 million talents, and data analysis talents will be the most scarce.
How big is the big data talent gap?
According to the "2016 China Internet Hottest Jobs Talent Report" released by LinkedIn, R&D engineers, product managers, human resources, marketing, operations and data analysis are the six most demanded talent positions in China's Internet industry. .
Among them, data analysis talents are the most scarce and the supply index is the lowest. At the same time, data analysis talents also have the fastest job-hopping speed, with an average job-hopping speed of 19.8 months.
And Wu Yongwei, a professor of computer science at Tsinghua University, revealed a set of data last year: In the next 3-5 years, China needs 1.8 million data talents, but currently there are only about 300,000.
NO.2 Will the big data industry have excess capacity in the future?
Third-party companies that provide big data technology and application services are facing adjustment, and the future development will be more concentrated
The discussion on "whether the concept of big data is over-hyped" actually happened in the summer Davos in 2013. At that time, 54.5% of the audience supported the "hype" view. In this regard, Su Meng, an associate professor at the Guanghua School of Management of Peking University, who held an objection, put forward three reasons:
The data between different institutions has not really flowed, and currently it is just a data "island";
A complete ecological industry chain has not yet been formed. Although a consumer’s preferences can be identified through behavioral data analysis, the chain from supply to purchase has not yet been established;
Data analysis talent is still extremely scarce.
Four years later, the focus of public opinion has gradually shifted from big data to artificial intelligence, and the big data industry has also undergone consolidation. In the past year, some big data companies have experienced layoffs and major business adjustments, and some companies have suffered losses. So what kind of companies are in crisis?
Based on data attribution, there are actually two types of companies involved in big data business: one is the Party A company that owns its own data, such as Amazon, Alibaba, etc.; the other is the first company that integrates data resources and provides big data technology and application services Three-party company. At present, the companies with profitability problems in industry integration are mostly concentrated in third-party service providers.
In this regard, Wang Di, vice president of LinkedIn (LinkedIn) China Technology, said that third-party service providers provide more technology or platforms, and more big data will benefit Party A's company.
In Wang Di's view, in order to generate economies of scale, big data businesses must have at least three points: algorithms, computing platforms, and the data itself. "Third-party big data startups have skills in algorithms, but their computing power has actually been homogenized. If traditional companies use them well, they are no different from big data startups, and even have stronger computing power. In terms of data acquisition, many Data is not shared within traditional industries, and it is more difficult for third-party big data companies to obtain such data, and in the end, whoever has the data may generate higher value.” To put it bluntly, data is king.
In 2013, less than 10 big data companies had received tens of millions of A rounds of financing. By 2015, more than 30 companies had received tens of millions of A rounds of financing. Until the cold winter of Internet capital in 2016, the investment in the big data industry has declined. Is there also excess capacity in the big data industry?
Wang Di believes that the current industry consolidation is a normal phenomenon. "After the survival of the fittest in the market, there will be some companies that do well in the third-party service field, and other companies may be eliminated or transformed into some vertical industry applications. From a social point of view, The total demand must increase, and for the supply side, after the natural reshuffle of the industry, it will eventually be concentrated in a few excellent industry companies
In short, the development space of the big data industry is very huge, so what is the value of big data? This requires you to define it yourself.
Big data is not just big data, it cannot be taken literally. It can be said that big data is a set of technical systems, a cognitive mining process, and a methodology and management decision-making thinking. If we want to understand the value of big data, we must first avoid data mining (or narrower machine learning, or more general artificial intelligence technology). Data Mining, also known as Data Mining, Data Mining, or Knowledge-Discovery in Databases (KDD). Data mining generally refers to the process of mining hidden laws and valuable information from a large amount of data through various algorithms, usually through statistical methods, machine learning, expert systems, pattern recognition, and online analysis and processing. Target. At this stage, the field of big data focuses on data collection, data storage, basic computing and visualization. Only the two hard bones of data mining modeling and decision support have not been studied and connected in depth. This is the fundamental reason why big data is difficult to implement. Most of us make decisions based on feeling, personal experience or other people's suggestions, and a small number of people will personally conduct objective data analysis on small data such as reports. And big data provides us with a more reliable decision support, after all, data does not tell lies. Big data itself does not generate value. The fundamental purpose of big data is to use big data mining and analysis to provide scientific basis for our decision-making, such as laws, knowledge and experience, and objectively reduce the uncertainty of future decision-making. Therefore, with business decision support as the analysis goal, big data does not depend on big data, and small data also has great value. Why do we need to define the value of big data ourselves? Because for the future and unknown areas, the uncertainties faced by each of us or organizations are different, some are biased towards individuals (such as disease diagnosis, crime prediction), and some are biased towards the public (such as advertising marketing, customer segmentation) , some are microscopic (such as gene sequence, personalized education), some are macroscopic (environmental monitoring, astronomical data processing), some focus on resource optimization (such as supply and demand matching, travel services), and some focus on macroscopic decision-making (such as Government asset analysis, comprehensive management and control)... It can be said that big data analysis needs are everywhere but very different. This requires setting the value and application goals of big data analysis by yourself based on your own actual needs and the status quo of data and technology. It is not advisable to copy the practices of Internet companies.
The big data industry requires us all to explore and develop in depth. Everyone has their own opinions, different people think differently, and the imagination space is different. Maybe your troubled problems can be replaced by someone else's thinking. It is easy to solve when the method is opened, so I hope everyone can communicate more. While you solve the difficulties for others, you can also learn things from others that you have not thoroughly understood, so I created a communication group and hope that everyone will join this big family. , we will work together to create a better future, if you are interested, you can join QQ: 719301411