1 Big data department business process analysis
Product personnel provide requirements (statistics of total users, daily active users, return users, etc.) ====> Data department builds a data platform, analyzes data indicators ====> Data visualization (report display, email sending, large screen) Display, etc.)
2 Organizational Structure of Big Data Department
The organizational structure of the big data department is suitable for large and medium-sized enterprises:
2.1 Platform group: Hadoop, Flume, Kafka, Hbase, Spark and other framework platforms, cluster performance monitoring, cluster performance tuning
2.2 Data Warehouse Group: ETL Engineer-Data Cleaning, Hive Engineer-Data Analysis and Data Warehouse Modeling
2.3 Data Mining Group: Algorithm Engineer, Recommendation System Engineer, User Profile Engineer
2.4 Report Development Group: JavaEE Engineer