Big data technology selection and server selection

1. Framework version selection
1) Apache: Operation and maintenance is troublesome, and compatibility between components needs to be investigated by yourself. (Generally used by large factories, with strong technical strength and professional operation and maintenance personnel)
2) CDH: The most used version in China, but CM is not open source, but it has no effect on the use of small and medium companies (recommended)
3) HDP: Open source, secondary development is possible, but there is no CDH stability, less domestic use
5.2.3 Server selection

2. Does the server use a physical machine or a cloud host?

1. Machine cost considerations:

2. Physical machine: With 128G memory, 20-core physical CPU, 40 threads, 8THDD and 2TSSD hard disks, a single quotation is over 4W, and the hosting server fee needs to be considered. The life of a general physical machine is about 5 years

3. Cloud host, taking Alibaba Cloud as an example, almost the same configuration, 5W per year

   2. Operation and maintenance cost considerations:

• Physical machine: need to have professional operation and maintenance personnel
• Cloud hosting: A lot of operation and maintenance work has been completed by Alibaba Cloud, which is relatively easy