How countries treat the world's second largest software artificial intelligence, machine learning and Big Data

A report on artificial intelligence, machine learning and big data

　　In today's world, in recent years the development of India is obvious, though a country in our country for the impression in India are more comedy, and for love of the Indian state, said the online India Asan, the third brother. But everything is by the two sides, although the development of India on some things more slowly, and always cute happy, but the coincidence in India because of the strength of the software above some of opportunity is very powerful, it can not be ignored, we may need to find from any person's body and draw on their merits, so that we can continue to develop, the following is a report on how the field of artificial intelligence have changed the world, let us look at this country the world's second largest software It is how to treat artificial intelligence, machine learning and big data right.

Summary

　　This report is intended to provide career opportunities for future data related fields overview. This report will help people understand these evolving technologies and the opportunities and impact of these technologies.

Foreword

Analytics Vidhya

　　2018 is a special year. We see from the laboratory of artificial intelligence and machine learning to become a part of our daily lives. Whether Amazon offered no convenience store "Amazon Go" or on Gmail, Google's smart reply feature, you can see the artificial intelligence have become regulars around us.

　　This report aims to create a background depicting changes that have occurred in the macro-level data for our scientific community, and how they are fully prepared for the upcoming changes. So, if you are already a professional or scientific data you want to enter the field of scientific data, we hope this report can provide you with background information and prepare for your future learning.

　　Analytics Vidhya Great learning and are currently at the forefront of India to create the next generation of scientific data ecosystem, we really hope this report can help you see the future direction of development.

For your own best future, please keep learning.

Jain Kunal - Founder and CEO

great learning

　　Artificial intelligence and machine learning era has come, these areas are likely to have a significant impact on the industry in India. To make the artificial intelligence system made possible by technology, it requires a combination of data and talent reaches a critical value, and promote investment growth in artificial intelligence. In India, efforts to revive productivity growth at the same time, AI artificial intelligence and machine learning is expected to fill this gap. In fact, finance, defense, security, health care and environmental protection and other industries have adopted artificial intelligence, and progress has been made. But the real advantage of the company is to find solutions for artificial intelligence to solve internal problems.

　　How to find this program, innovation is the key. To achieve this goal we need the time to create an ecosystem of artificial intelligence to train professional staff, we are looking for professional training in the field of artificial intelligence, artificial intelligence. This report is not our own efforts, but with Analytics Vidhya efforts to complete together the report but also to allow people to seize the opportunities in this rapidly developing field.

　　Now is a leap forward in the era of AI Artificial Intelligence

Lakhamraju Mohan - Founder and CEO

Data-center transformation and change

　　"As the power in almost 100 years ago changed everything, today, I find it difficult to find a reason not to believe that artificial intelligence will change the industry in the next few years" -Andrew NG (Andrew Ng)

　　In all aspects of life we ​​have felt the impact of data science and artificial intelligence.

　　How do you know that Amazon is most interested in that product? Your phone is or how to understand the "you" need to unlock the phone yet.

　　When we need to send a friend a gift, we will tangle in what kind of gift to our friends will like. This time, Google will not only suggest a variety of gifts, but also to show ads for these products in an instant.

　　Even if you go to the supermarket, at the checkout counter you can also ensure that attract your attention. Your bank can distinguish between potential fraud in real time and the real deal. Not only that, they can decide which customers can trust, and the amount of customer credit card is.

　　More than that, the likelihood and impact of artificial intelligence is infinite in our lives

　　Over the next decade or so, we will see a huge change in every industry goes. Health care, banking, network security, which is just a small part. So how to capture data and use them will be key to define a new pattern of these industries in the years to come inside.

When you read this era when change is taking place - and the data will be the heart of it all

　　That's why almost any professional need to constantly improve their skills and learn new rules of the game. We now need managers not only to understand the business area, but also to understand the data we are getting, as well as the advantages of how to use the data to create a competitive company.

Subversion of science in today's data

　　We now get the ability to store and analyze data has completely changed the way today's industry. The moment when people wake up from the bed, applications on smartphones have begun to acquire as much data and use the data for their benefit. This clearly illustrates the industry today is trying to acquire and use people's behavior patterns. The purpose of this report is to help people understand how the data changed the way almost all industries.

In our pending further discussion, we look at a simple statistics - there are more than one million registered companies, displayed in Gartner's survey in India, these companies have 75% of companies have invested or plan to invest large data fields.

 

Big companies, big investment, big data

　　First, let us look at some interesting data

• There are 2.7 terabytes of data in today's Internet world.

• Stored separately in Facebook, 30 access and analyze data generated by the user PB +.

• More than 5 billion people across the globe through phone calls, send text messages, tweets and browse the web,

• A few years ago, the first human genome decoding will take 10 years to complete. Because now we have the ability to handle a large number of decoding information, so within a week to complete decoding of the human gene.

• Wal-Mart need to deal with more than one million pens per hour customer transactions, these transactions are estimated at more than 2.5PB data into the database.

• Poor data make enterprises lose 20% -35% of operating income.

　　These simple statements highlighted today by generating, acquiring, storing and analyzing data owned by the powerful ability. But the question now is whether we have the ability to handle data and using the data?

　　In view of these large amounts of data, we need people with different skills to organize, store and understand the data.

 

 

Data science role

Data Scientists

　　In India, the data scientist is certainly one of the most popular jobs now, scientists data base salary of 7.7 million rupees, is one of the industry's highest scientific data income earners. Data scientists can use the latest technology to process the raw data, performs the necessary cleanup and analysis organization (large) data and information provided by way of the data obtained to the team.

Language / tools: R, SAS, SPSS, Matlab, Stata, Python, Perl, SQL, Hive, Pig, Spark

Employment Unit: LinkedIn, Johnson & Johnson, PepsiCo

Database Administrator

　　Database administrators need to ensure that everyone who needs the data in the organization can access the database. In addition, we also need to take the necessary security measures to ensure the security of data stored. To become a database administrator, you need to master the different techniques from SQL and XML to a more general-purpose programming language (such as java) of.

Language / tools: SQL, Java, Ruby on Rails, XML, C #, Python

Employment Unit: Reddit, twitter, Tableau

Business Analyst

　　This may be the lowest level of technology in the field of scientific data. However, business analysts through a deep understanding of business processes to make up for the lack of technical knowledge. Thus, business analysts often act as intermediaries between business and technical staff.

Language / Tools: SQL

Employment Unit: Uber, Dell, oracle

Data Analysis Manager

　　Data analysis manager is responsible for guiding the direction of data science team. This position requires a wide variety of base (such as SQL, R, SAS) and specific skills, and social skills necessary for management team

Language / tools: SQL, R, SAS, Python, Matlab, Java

Employment Unit: Coursera, Slack, Motorola Solutions

Where data in scientific work

　　Statistics show that India currently has more than 50,000 data analysis related posts vacant in the state. This clearly shows that we have not really mastered the right skills these opportunities.

　　Compared with the current world, India provides 12 percent of employment, however, the lack of such skills in the world and the potential demand for such skills, the number of personnel needs such work could grow exponentially.

　　If we look at the number of hiring data scientists interested in jobs, jobs and job seekers, you will find the number of such demand hit a record high in 2017. However, the number of job seekers are recruited almost half the number of jobs. This clearly shows how the industry is the need for data scientists.

 

　　Data science is not limited to any particular industry. Its application across multiple fields.

　　Banking and financial services are the largest market analysis and data science professionals. By 2017, the sector created 44% of jobs. To estimate and predict the risk of the banking market widely used field data and scientific analysis. Scientific data is widely used in fraud detection and credit risk prediction.

　　E-commerce has become a huge market analysis professionals. Widespread use of e-commerce website recommendation engine provides plenty of opportunities for this area. 2017, e-commerce industry has created 12% of the analyzed positions.

　　Healthcare industry has also been used to predict the risk, patterns of disease, the risk of cancer and other diseases using scientific data.

　　Media and other industries are using data science to understand and design media strategies to get the best results.

Skills - the way forward

　　With so many opportunities, we must now use our skills to take advantage of them. To achieve excellent results in any particular area, we need to master the basics right, even today, you can still be observed in the largest number of SQL indeed (job portals) job. Python and Java followed, but with a greater depth of learning support libraries, Python knows more and more popular.

　　Hadoop has a large data capabilities that can handle hundreds of GB of data. Followed by R, which is a widely used statistical and machine learning tools, followed by c. With the huge market demand for Python and R, the number of jobs in SAS recently declined.

 

　　While these tools are the current needs of the industry's most popular tools, but also need to understand the industry in a variety of data-driven roles. Although the application of a variety of complex data tools make the work of scientists is much easier than without them, but some skills that only experience can teach. One of them is the field of knowledge. For data scientists or analysts have the domain knowledge, it requires in-depth study and understand the entire functional areas. Become a good data scientist Another important aspect is to have a method of analysis, learning new tools is one thing, but need to have the right approach to the corresponding optimum results.

　　每个人都可以挑选认为适合自己的角色，然后努力获取该角色所必要的技能，这个网格是有助于理解特定角色最重要技能的一个集合。

 

分析和数据科学产业-及其未来的领域

　　我们都看到并经历了数据科学在电子商务和银行等领域的渗透。但是数据的力量并不仅限于这些领域。在当今世界，几乎所有的行业都在努力利用数据的力量，我们估计到2020年，在以下每个领域中，将有很多人从事分析和数据科学工作:

　　网络安全——你可能以前听说过——公司必须保护自己免受各种攻击。但是攻击者只需要一次成功的尝试。因为这一点，公司不能只是试图阻止攻击发生。分析公司一直在撰写报告，并就“大数据分析对各行业网络安全的影响”向“客户”提供咨询。目前，25％的全球最大公司已采用大数据分析技术，以实现至少一种欺诈检测用例的安全性。

　　到2020年，印度此类的分析工作岗位估计将达到5000个

　　医疗保健——在不同的医疗机构(支付方、提供者、制药公司)中，已经有大量的医疗数据可用。这些数据集的庞大和复杂给临床环境的分析和后续应用带来了巨大的挑战。

　　到2020年，印度此类分析工作岗位估计为15000个

　　基因组学——基因组学是研究生物体完整的遗传物质(基因组)。该领域包括测序映射和分析广泛的RNA和DNA代码。大数据帮助解开了这些基因组序列的基本原理。分析现在被用来检测异常和识别疾病。

　　到2020年，印度此类分析工作岗位估计将达到2000个

　　太空探索——大数据已经取得了巨大而有影响力的进展。虽然大数据分析已经被用于研究暗物质，但通过数据发现技术，统计学家和天体物理学家正在应用先进技术来解开宇宙之谜。

　　到2020年，印度此类分析工作岗位估计将达到350个

　　农业-农业不再是一个非技术性工作。分析被广泛应用于农业，特别是精确农业，在那里植物和种子被特别选择用于杂交育种。它还被用来了解土壤成分，加速作物改良。在农业领域发生的大量技术和数据采集使计算机科学成为其中的一个重要部分

　　到2020年，印度此类分析工作岗位将达到5500个

　　航空——你知道航空公司使用分析已经很长时间了吗?长期以来，航空公司一直在对客户进行细分。他们观察客户的模式、行为、偏好、支付能力和意愿等，以提供更好的客户体验，并获得最大的收益。

　　到2020年，印度此类分析工作岗位将达到4500个

　　无人驾驶交通——无人驾驶汽车成为人工智能和机器学习最流行的应用。无人驾驶汽车可以进行多次自动驾驶，并学会根据交通状况自动理解和行动。自动驾驶汽车已经成为机器学习、深度学习、物联网和人工智能融合的先锋产品。

　　到2020年，印度此类分析的工作岗位将达到7000个。

 

使用数据能力的热门技能

　　数据科学目前的发展已经超越了统计学，甚至机器学习。这个行业需要有技能的人来设计和开发机器人和智能机器，这是现在非常大的需求。

人工智能

　　这就是目前世界正在走向的潮流——拥有一台与人类大脑智力水平相当或超过人类的机器。正是因为这个原因，人工智能技术受到了人们的高度追捧。

机器人

　　机器人目前正在崛起，它们以远远高于人类的速度执行特殊的重复性工作，网络爬虫，互联网机器人，聊天机器人等，目前的需求量很大，所以根据这个形式不言而喻，能够设计这些机器人的人更受欢迎。

物联网

　　据预测，到2020年联网设备将达到500亿部，到2021年市场价值将达到6610亿美元，物联网是目前最热门的技术。物联网与大数据和分析相结合，将为组织和专业人士创造巨大的机会

AR/VR

　　虚拟现实可以定义为计算机生成的对真实生活环境的模拟。一个例子是3D商店货架，它可以适应为每个顾客提供更多相关的商品。增强现实可以定义为一种技术，它将计算机生成的增强层置于现有的现实之上，并通过交互性使其更有意义。

专家的观点

 

　　mudit kulshreshta博士

古尔冈大湖管理学院卓越分析中心副主任

　　

由于各行各业都出现了如此多的混乱，应对这种局面的压力可能是压倒性的。考虑到这一点，我们请到了mudit kulshreshta博士。

让我们看看他有什么要说的。

1. 这些年来，技术领域发生了怎样的变化?您如何看待数据科学在当今世界日益重要的地位?

　　企业级存储和计算能力对个人来说越来越容易获得并且负担得起。在接下来的十年里。大多数企业将通过SAAS、PAAS、DAAS等，将存储、应用和数据平台转移到云计算，物联网不再是战略选择，而是势在必行。它已经处于大数据和海量数据出现的拐点。我们已经看到千兆字节的数据以空前的规模和速度通过数字渠道实时流动。从图片到点击流再到视频，如今一切都是数据。开源革命可以让公众参与共同创造IT产品、机器学习、人工智能、机器人。我们目前正在经历一场技术革命，尤其是数据的获取和使用方式。

2. 目前在机器学习和人工智能领域中，哪些领域从正在进行的工作中获益最多?

　　从资本货物到零售，从制造到服务，从金融银行到医疗保健的每个领域都将受益并建立基于ML和人工智能的差异化商业模式。营销、零售、金融科技和医疗保健等领域已经采用了这种模式，并正在取得进展。

3. 未来5年，哪些工业领域将从这些技术中受益最多?

　　为了生存和差异化，所有工业领域无一例外地将拥抱这场数字革命。此外，一些新的领域也将被创造出来——从自动驾驶汽车到工业规模的3D打印、增强现实、虚拟娱乐、机器人、基因组研究、大气科学等。

4. 人们在这个阶段应该扮演什么样的角色，这样他们才能在未来的5-10年里做好准备?

　　坦白地说，这是一场无人幸免的洪水——人们需要参与其中并与之共舞——他们能做的最好的事情就是开始学习技术和技能——大数据、ML、人工智能、云、技术产品管理等等。

5. 从行业对这一领域的高需求来看，专业人士是否有足够的技能来满足这一需求?教育系统需要更新吗?

　　并没有——这不仅仅是从技能的角度来看——现在整个世界都毫无准备——就好像整个世界都走在了教育体系的前面——传统的教育机构现在正对其需求做出回应，但这些努力充其量也只是零散的。由数字平台和在线教育推动的点对点学习，将填补传统学校本应填补的空白。

6. 专业人士目前应该关注哪些最重要的技能?

　　云、大数据分析、机器学习、人工智能、深度学习——产品管理也将变得至关重要。

7. 另一个大问题是机器人的自动化。有些人担心将来的工作可能会更少。你认为这是真的吗?

　　传统领域的工作岗位将减少，而上述领域的工作岗位将增加——随着自动化成为一个自我维持的过程，人们将不得不进行变革，并走上持续学习的道路。希望在于，以数字、数据和人工智能为核心的新产业将会出现。这些行业将创造新的就业机会和新的机会

8. 有关于终结者中AI的讨论 - 你对AI作为宏观层面来讲对人类物种的影响有什么看法？

　　尽管人工智能带来了重大机遇，但世界还没有准备好迎接人工智能带来的风险。技术可能有有一个糟糕的主人，甚至会被滥用(可能是无意中的)，滥用的规模可能是全球性的，影响到数百万人的生活，在这个潜在的人工智能驱动的世界里，我们离全面了解后果还很远。我们将需要大量的经济，法律和社会法规，来对涉及隐私，未经请求的信息使用和网络欺诈的预防。这些机器人如果拥有了自己的意识，无论它看起来多么牵强，都是一种可能性。并且已经出现了这种威胁的例子。

未来的发展方向

　　正如Mudit博士所说，传统领域的工作岗位可能会减少，因为我们将能够实现重复性工作的自动化。然而，到2020年，非传统领域的工作机会将大幅增加。我们正在迈向一个机器可以帮助人类的智能世界，可以帮助人类在不同领域提高能力。我们进入了一个可以理解我们是否感到寒冷的世界，我们的医生可以预测我们是否有患致命疾病的风险。

原文链接：https://www.analyticsvidhya.com/blog/2018/09/artificial-intelligence-machine-learning-and-big-data-a-comprehensive-report/