Big Data is no longer a new term, companies increasingly need large data high-end talent. This gives people want to engage in large data aspects of the work provides a rare career opportunity. So in the big data industry, what position can have a choice? To look at the big data industry five positions orientation guide now!
A, ETL development
With the continuous increase in data types, data integration for enterprise professionals increasingly strong demand. ETL developers to deal with different data sources and organizations to extract data from different sources, and importing data warehouse to meet the needs of enterprises. ETL development, is responsible for the dispersion of heterogeneous data, such as data sources relational data, flat data files to a temporary intermediate layer extract was washed, after conversion, integration, and finally loaded into the data warehouse or data mart, the line becomes analytical processing, data mining foundation. Currently, ETL industry is relatively mature, related jobs work longer cycle life, usually done by between internal employees and outsourced contractors Kone. One of the reasons ETL talent in the big data era is hot: in the early stages of large enterprise data applications, Hadoop is just poor ETL.
Second, the visualization (front-end display) tool development
Analysis of mass data is a big challenge, and the new data visualization tools such Spotifre, Qlikview, Tableau, large data efficiently mirror can visually display the data. Visual development in a graphical user interface is a visual development tools provided by the user interface elements automatically generated by the visualization application development tool. Also easily across multiple levels of resources and connect all of your data, time-tested, fully scalable, feature-rich and comprehensive visual component library provides developers with full-featured and easy to use set of components to be used to build extremely rich user interface. Chinese mainland tool data is growing rapidly in recent years. Big Data Mirror is the first brand in the field, the market share of the first, has become the tens of thousands of business analysis, decision-making standard tools.
Third, information architecture development
Big data re-energize the boom master data management. Full development and utilization of enterprise data and support decision-making requires very specialized skills. Information architects must understand how to define and archive key elements to ensure that the most effective approach to data management and use. Key skills include information architect master data management, business knowledge and data modeling.
Four, Data Warehousing
Strategic collection of all types of data in the data warehouse is to develop the process for all levels of corporate decision-making support. It is a single data store, for the purposes of reporting and analytical decision support and creation. Providing needed business intelligence to guide the business process improvement and monitoring time, cost, and quality control. Experts familiar with the data warehouse Teradata, Neteeza and large companies such as Exadata machine data. To complete data integration, management and performance optimization work on the machine.
Fifth, scientific data
This position is also referred to past research data architecture, data scientist is a new type of work, it will be able to enterprise data and technology into the commercial value of the business. With the progress of science data, more and more work will be directed at the actual data, which will allow human knowledge data to understand nature and behavior. Therefore, the data scientists first should have excellent communication skills, be able to interpret the results of data analysis while the IT department and business unit leaders. Overall, the data analyst scientists, artists fit, require a variety of interdisciplinary science and business skills.
Of course, in addition to five directions above, there are a lot of good jobs big data industry, to small partners interested in big data, big data quickly into the arms of it!
Recommended Reading
40 + annual salary of big data development [W] tutorial, all here!
Big Data technologies inventory
Training programmers to share large data arrays explain in Shell
Big Data Tutorial: SparkShell in writing Spark and IDEA program