Overview of the main responsibilities of the big data architect position (collection)

 

    Overview of the main responsibilities of the big data architect position 1

    Responsibilities:

    1. Participate in the company's data platform system planning and architecture work, lead the system architecture design and project implementation, and ensure project quality and key performance indicators are achieved;

    2. Coordinate and promote the construction of the internal data system of the manufacturing plant, establish logical relationships between data from different sources, and provide data support for the company's operational diagnosis and operational efficiency improvement;

    3. Responsible for the docking of data system requirements, data docking of various information systems, and software supplier management.

    5. Develop an overall data governance plan and data system establishment based on the current situation, including data collection, access, classification, development standards and specifications, and formulate a full-link data governance plan; deeply explore the company's data business and have strong data business awareness , explore the value of data, promote the implementation of data transformation scenarios, and empower decision-making and business;

    6. Define different data application scenarios, promote the company's data visualization work, and improve the company's data analysis efficiency and data value conversion.

    job requirements:

    1. Bachelor degree or above, more than 8 years of experience in the software industry, more than 5 years of experience in big data architecture design, familiar with BI platforms, big data system-related technical architecture and technical standards;

    2. Be familiar with data warehouses, data marts, and understand data mining, data extraction, data cleaning, and data modeling related technologies;

    3. Familiar with big data related technologies: Hadoop, Hive, Hbase, Storm, Flink, Spark, Kafka, RabbitMQ;

    4. Familiar with manufacturing enterprise information systems and related database technologies;

    5. Have experience in big data platforms, computing storage platforms, and visualization development platforms, and experience in the development or implementation of big data system projects in manufacturing companies is preferred;

    6. Sensitive to data, have excellent business demand analysis and report presentation capabilities, have manufacturing enterprise data analysis and data insights, and architectural design capabilities for big data systems, and understand mainstream reporting tools or emerging front-end reporting tools;

    7. Have strong communication, organization and coordination skills, have result-oriented thinking, and have relevant project management experience will be preferred.

    Overview of the main responsibilities of the big data architect position 2

    Responsibilities:

    1. Responsible for the big data platform and BI system framework design, planning, technology selection, architecture design and completion of the development of system basic services;

    2. Responsible for the construction of application layer architecture and core code implementation such as massive tracking rules, SDK standardization, tracking data collection, processing and storage, business data distributed storage, streaming/real-time computing, etc.;

    3. Develop the core code of the big data platform, manage the project agile development process, complete system debugging, integration and implementation, solve technical problems in each project cycle, and ensure the online operation of big data products;

    4. Responsible for the architecture optimization and code review of the big data platform, and continuously optimize the data architecture according to business needs to ensure product reliability and stability;

    5. Guide developers to complete data model planning and construction, analysis model construction and analysis presentation, and share technical experience;

    6. Effectively formulate response plans for various sudden R&D technical failures and have a clear awareness of hidden dangers;

    7. Conduct in-depth research on big data-related technologies and products, and follow up on advanced technologies in the industry;

    【job requirements】

    1. Bachelor degree or above in statistics, applied mathematics or computer-related majors;

    2. Familiar with Internet mobile terminal tracking methods (behavior tracking such as clicking and browsing), no tracking schemes, etc. Applicants with experience in independent development of tracking SDK will be preferred;

    3. Familiar with Hadoop, MR/MapReduce, Hdfs, Hbase, Redis, Storm, Python, zookeeper, kafka, flinkHadoop, hive, mahout, flume, ElasticSearch, KafkaPython, etc., and have practical project design and development experience;

    4. Familiar with the technical details and processes related to data collection, data cleaning, analysis and modeling work

    5. Familiar with the Liunx/Unix operating system, proficient in using scripting languages ​​such as shell/perl, and proficient in one or more programming languages ​​​​in java/python/go/C++

    6. Have certain algorithmic capabilities and understand the use of machine learning/deep learning algorithm tools. Applicants with experience in the development and use of mainstream big data computing components will be given priority.

    7. Familiar with big data visualization tools Tableau/echarts

    8. Have strong execution ability, high sense of responsibility, strong learning and communication skills, and be able to work efficiently under high pressure;

    Overview of the main responsibilities of the big data architect position 3

    Responsibilities:

    Based on big data business needs, design big data solutions and architecture to implement related functions;

    Build and maintain big data clusters to ensure continuous, stable, efficient and smooth operation of the cluster scale;

    Responsible for the design and guidance of specific development work of big data business;

    Responsible for the data and storage design during the company's product development process;

    For data analysis work, be able to complete and guide responsible business data modeling.

    Job Requirements:

    Bachelor degree or above in computer, automation or related majors (such as statistics, mathematics), and more than 3 years of relevant work experience in big data processing;

    Proficient in mainstream big data frameworks (such as Hadoop, hive, Spark, etc.);

    Familiar with mainstream databases such as MySQL, NoSQL (MongoDB, Redis), and queue technologies such as rabbit MQ;

    Familiar with the principles and characteristics of hadoop/spark ecosystem and have practical development experience;

    Familiarity with commonly used data mining algorithms is preferred.

    Overview of the main responsibilities of the big data architect position 4

    Responsibilities:

    1. Responsible for the design and optimization of product-level business system architecture (such as business data object identification, data entities, data attribute analysis, data standards, end-to-end data flow, etc.). Assist in promoting the analysis, positioning, and solution design of major cross-domain data issues, ensure system high performance, high availability, high security, high timeliness, and distributed scalability from the architectural design, and be responsible for system quality.

    2. Responsible for the architectural design of the cloud data platform and the optimization of the data processing system, promote the construction and continuous upgrade of the cloud data platform, and formulate cloud data platform calling constraints and specifications.

    3. Responsible for the selection of solutions for each link of data flow based on the needs of industry applications, leading the construction of cloud data platform, participating in core code writing and review; statistical logistic regression algorithm of data, real-time interactive analysis; selection of data visualization solutions, etc. , deployment, integration and fusion, etc.

    4. Pay attention to the technology trends in the cloud data platform and continue to promote the upgrade of the platform's technical architecture to meet the company's data needs at different stages.

    job requirements:

    1. Familiar with basic cloud computing platforms, including Linux (Ubuntu/CentOS) and basic environments such as KVM and OpenStack/K8S, and familiar with control, computing, storage and network;

    2. Master the technology stack of large-scale distributed systems, such as: CDN, load balancing, servitization/asynchronization, distributed cache, NoSQL, database vertical and horizontal expansion; be familiar with end-to-end related high-performance products for big data applications.

    3. Proficient in Java, Python, Shell programming languages, and proficient in the operation optimization of addition, deletion, modification and query of databases such as SQL and NoSQL;

    4. Experience in the implementation, development and management of PB-level practical data platforms and production environments;

    5. Familiar with the orchestration and encapsulation of containers such as Docker, and the development and daily scheduling of microservices;

    6. Bachelor degree or above in computer, software, electronic information and communications and other related majors, more than 5 years of software engineering development experience, and more than 2 years of working experience as a big data architect.

    Overview of the main responsibilities of the big data architect position 5

    Responsibilities:

    1. Big data platform architecture planning and design;

    2. Responsible for the selection of big data platform technology framework and solving technical difficulties;

    3. Be able to independently design and optimize the overall technical framework, business framework and system architecture of industry big data applications, and be able to guide the development team to complete the implementation work according to the business needs of the system;

    4. Responsible for the upgrading and optimization of data infrastructure and data processing systems, continuously improving the stability and efficiency of the system, and providing support and guarantee of the big data underlying platform for related businesses;

    5. Cultivate and establish a big data team and provide technical guidance to the team.

    job requirements:

    1. Computer-related major background: Bachelor's degree or master's degree from a first-class college, more than 8 years of work experience (5 years for master's degree) (at least 3 years of experience in big data projects or product architecture);

    2. Proficient in Java, J2EE related technologies, proficient in the architecture of common open source frameworks, and proficient in the principles and architecture of relational database systems (Oracle MySQL, etc.) and noSQL data storage systems;

    3. Proficient in SQL, Mapreduce, and Spark processing methods;

    4. Proficient in big data system architecture, familiar with industry data warehouse modeling methods and the development of new modeling methods, and have experience in special construction of DW and BI architecture systems;

    5. Have an in-depth understanding of big data systems, be familiar with big data technologies such as Kafka, Hadoop, Hive, HBase, Spark, Storm, greenplum, ES, and Redis, and be able to design relevant data models;

    6. Strong learning, analysis and problem-solving abilities, able to quickly grasp business logic and convert it into technical solutions, and able to independently write project solutions and project technical documents;

    7. Have strong internal and external communication skills, good team awareness and collaboration spirit;

    8. Candidates with rich experience in machine learning technology, data mining, and artificial intelligence will be given priority;

9. Applicants with working experience in the energy and power industry are preferred.

Overview of job responsibilities for software architect position

    Overview of job responsibilities of software architect position 1

    (1) Planning: Responsible for planning the technical route of the product, designing the technical core competitiveness of the product, and responsible for the evolution of the software architecture throughout the entire life cycle of the product and project.

    (2) Project establishment stage: Connect with PD, understand business requirements, identify and sort out non-functional system requirements (performance, security, high availability, etc.), evaluate the feasibility of technical implementation, estimate difficulty and workload, and identify technical risks.

    (3) Overall design stage: Combine manpower, schedule requirements, system importance, scalability, maintainability and other factors to conduct a reasonable overall architecture design, including application architecture, technical architecture, deployment architecture, data architecture, etc. Responsible for sub-development System/module division, module interaction design, boundary and interface definition with other systems, etc. are combined with different projects and products to identify common technical components across projects and products, and design and reuse common components. Responsible for outputting overall design documents Responsible for the analysis and decision-making of key technologies

    Technical interface with partner systems to ensure overall deliverability. In line with project delivery requirements, work with development leaders to formulate development and joint debugging strategies, including the priorities of subsystems and modules.

    (4) Project technical support: Support the technical exchange of market projects as a technical expert.

    (5) As technical support for POC projects.

    Overview of job responsibilities of software architect position 2

    Combined with the company's strategy, study industry best practices in the business field and guide business departments to make changes;

    Diagnose the company's business processes and analyze root causes of problems;

    Be familiar with the business processes and information systems in the R&D field, lead the demand analysis of multiple business modules in the R&D field, or the complex demand analysis of a certain business module, and guide user needs;

    Participate in requirements review, design IT solutions based on requirements analysis documents, clarify requirements with developers and control the progress of requirements, and also undertake the testing, training and acceptance of IT solutions;

    Carry out IT project management and maintenance, and participate in IT solution review;

    Combined with the company's strategy, optimize the company's end-to-end business processes;

    Discover and analyze process and system problems across business areas, and propose feasible optimization and improvement suggestions and plans;

    Conduct in-depth research on industry IT application trends, conduct overall planning for IT systems, and support the implementation of company strategies;

    Communicate regularly with business departments and formulate corresponding IT system plans based on business plans in the areas of responsibility;

    Overview of job responsibilities of software architect position 3

    Responsibilities:

    1. Responsible for the overall system analysis and design of the company’s camera product reference design plan

    2. Participate in the definition of technical specifications of the camera main control chip

    3. Responsible for the architecture design of image and video intelligent analysis

    4. Responsible for the customer SDK architecture design of intelligent front-end product solutions

    5. Responsible for the construction of the company’s visual AI chip product technical support system and team building

    job requirements

    1. Proficient in camera software development architecture design

    2. Proficient in business development related to Linux or embedded platforms

    3. Familiar with image and video intelligent product business, development and software architecture

    4. Familiar with the development framework based on HiSilicon, Ambarella, TI and other chips

    Qualifications

    1. Bachelor degree or above, major in computer, electronics, software, etc.

    2. More than 3 years of experience in camera development

    3. Have experience in intelligent product development

    4. Have strong research ability, complete and independent system analysis ability, and have the courage to accept challenges

    Overview of job responsibilities of software architect position 4

    Responsibilities:

    1. Understand the business needs of products and experiences, and design backend implementation solutions.

    2. Responsible for or participate in microservice architecture design, technical research and plan formulation.

    3. Develop and abide by code specifications, and participate in the research and introduction of new technologies.

    4. Responsible for or participate in the development of the core code of the company's framework.

    5. Lead and coach team members.

    job requirements:

    1. More than 4 years of JAVA development experience, and more than 2 years of practical work experience in microservices.

    2. Familiar with microservice related concepts and have project experience in building microservice applications.

    3. Proficient in Spring boot and REST API.

    4. Proficient in the design, development, optimization and deployment of Mysql, Redis/Mongodb/ElasticSearch data

    5. Have in-depth understanding of various open source frameworks and middleware such as RabbitMq, Kafka, Spark, etc.

    6. Have experience in tuning large-scale distributed systems (such as JVM tuning, SQL tuning, cache optimization, RPC optimization, etc.);

    7. Familiar with developing microservices based on Kubernetes and Docker containers.

    8. Good coding style, teamwork spirit, good communication skills and learning ability.

    Overview of job responsibilities of software architect position 5

    Responsibilities:

    1. Analyze, design, and implement system architecture solutions based on project requirements. Make the system architecture rational and scalable.

    2. Responsible for the technology selection and architecture implementation of massive data collection, processing and storage, and application solutions

    3. Responsible for the development of data statistics systems, various statistical program reports, massive data analysis/query, distributed storage, streaming/real-time computing and other application layer architecture construction and core code implementation

    4. Track the latest scientific and technological achievements of big data and cloud computing technology, and coordinate the team to apply them to internal business practices

    5. Participate in the implementation of code, write technical documents, and reuse common technologies.

    job requirements:

    1. Familiar with the underlying file system of Hadoop and the Hadoop distributed computing framework (HDFS, Hbase, Hive, Mapreduce, Spark, Storm, Flink, etc.).

    2. Proficient in at least two programming languages ​​such as Java, Scala, and Python, and have strong distributed computing foundation and software engineering capabilities

    3. Be familiar with the products, solution forms and technologies in the industry's influential data warehouse and big data fields, be familiar with OLAP, OLTP engines and DB, and be familiar with mainstream data integration and governance technologies and tools;

    4. Be familiar with system architecture design methods in the field of big data and data warehouse, have experience in the installation, deployment and maintenance of massive data systems, and those with rich experience in large-scale data parallel computing/transmission/processing will be given priority;

    5. Be familiar with and master general big data data merging, modeling, extraction, analysis mining, display and other mining algorithms. Applicants with experience in developing big data algorithms combined with business scenarios in actual projects will be given priority;

Guess you like

Origin blog.csdn.net/AI_data_cloud/article/details/131104304