Big Data platform for research and development engineer
- Responsibilities:
1, the company responsible for building big data platform, to provide a stable corporate users, easy to use and convenient tool for big data platform, cool data products;
2, participate in and leading Big Data platform tool chain of design, development and ongoing maintenance;
3, to participate in the development of data products to explore data help commercial value;
4, continuous iterative optimization tools and data platform has a large data products, and promote the development of big data platform.
- job requirements:
1, full-time undergraduate degree or above, more than 6 years of relevant work experience, a solid basic knowledge of Java, has JavaSpring R & D and large-scale systems architecture experience, familiar with the design and application of distributed systems;
2, familiar with Hadoop / Hbase / Hive / Kylin / Impala / Spark / Flink / Flume / Storm / Druid and other large data open source framework, clear principles and mechanisms;
3, clear and logical analysis skills, love technology, willing to share, have their own opinion on the development of industry and technology;
4, the data platform construction experience is preferred;
5, good communication skills and language skills, self-drive.
Big Data R & D engineer
- Responsibilities:
Responsible for large distributed data application development platform (including data service interface system, portrait system, multi-dimensional analysis system, real-time processing system) architecture design and development;
Responsible for recommending platform development engine-related modules;
Responsible for data storage and back-end computing systems optimization.
- job requirements:
Computer-related undergraduate degree or above, more than five years of development experience, have a solid theoretical foundation computer;
At least familiar with the 1-2 JAVA, GOLANG, PHP, C ++ language development;
With massive real-time data processing platform construction experience is preferred;
Master and skilled application commonly used algorithms, data structures, there is a search, recommendation and other related work experience is preferred;
Familiar priority construction of massive data warehouse system;
Familiar HADOOP / SPARK / FLINK / DRUID / other components, relevant project experience is preferred.
Big Data Big Data Engineer Senior
- Job Responsibilities:
1. responsible for the design and development of Big Data management platform;
2. Responsible for big data platform dependent components of the secondary development;
3. Responsible for data warehouse ETL design and development;
- job requirements:
1. Bachelor relevant professional qualifications, computers, mathematics;
More than 2.3 years of experience in the development of Big Data, Big Data grasp the whole development process;
3. Master java language, can skillfully use shell scripts;
4. versed in the Hadoop \ \ at least two spark \ presto \ oozie other open source big data Hive art assembly;
5. have a good team spirit, strong self-driving force, compression ability, communication skills, responsibility and the ability to solve problems independently;
6. There is a team with experience preferred.
Big Data back-end development engineer
- Responsibilities:
1, responsible for large-scale real-time system architecture design and development work.
2, involved in complex distributed systems design, development, maintenance and optimization.
3, with the team to overcome technical challenges in a variety of different technology scenarios of high-performance, high-concurrency, high availability, and so on.
- job requirements:
1, computer related, at least 5 years of development experience, proficiency in at least one back-end development language, such as Python / Golang
2, with a solid based programming, data structures and algorithms familiar with common, familiar with common distributed algorithm.
3, and the common NOSQL skilled use MYSQL database.
4, familiar with Linux system principles, including but not limited to IO stack, file system, network protocol stack and so on.
5, familiar with the theory of distributed and the corresponding implementation.
6, familiar with the micro-service design ideas and practical experience.
7, familiar with docker and related tools chain.
8, with the online problem-solving and optimized system performance experience.
9, there is a strong literature reading and arithmetic ability to achieve.
10. Have good teamwork and communication skills.
11, have the following experience preferred: there are massive user system development experience is preferred; participant and contributor to the open source community priorities; understand the priority machine learning algorithms.
12, have priority Hadoop, spark, kubernetes and other open source distributed systems experience.
Big Data Engineer
- Responsibilities:
1, participating in the search data platform architecture and planning;
2, involved in the development of data warehouse modeling to meet the business needs of each application side of the data;
- job requirements:
1, in the field of data warehousing at least 2 years, familiar with the data warehouse ETL model design and development, with massive data processing (ETL) relevant experience
2, has a certain data model and data architecture based on familiar hadoop \ hive and common databases, understanding cloud computing and data services
