Author: Zen and the Art of Computer Programming
1 Introduction
2020 is the first year of artificial intelligence. With the continuous development of artificial intelligence, the traditional back-end service architecture can no longer meet the needs of innovative Internet application scenarios. Therefore, more and more companies are choosing to build cloud-based data platforms to achieve data sharing and unified management.
The construction of a data center is inseparable from all aspects of data collection, storage, processing, and processing. There are currently many open source tools available on the market, such as Apache Kafka and the Hadoop ecosystem. However, building a data center is not an easy task. You must first understand the relevant technologies, processes, and methodologies of the data center, and then implement them into the actual production environment to ensure that the data is accurate, timely, and effective.
The 2020 Fliggy Travel Platform (www.fliggy.com) is the first cloud-based data middle platform system in China, covering massive data in aviation, hotels, car rentals, scenic spots and other fields. At the same time, due to the huge challenges of data middle platforms, different industries and businesses are exploring in practice how to use data middle platforms to improve efficiency and reduce costs. For example, the aerospace data center can provide customized price discounts and service push; the hotel room price prediction data center can make hotel guest income more accurate and improve hotel operation efficiency; the smart city data center can discover parking density and congestion , traffic congestion, and then optimize the urban transportation network and underground garage layout to increase residents’ travel convenience.
Here, I would like to invite the Fliggy team to discuss how to quickly build our own Fliggy travel platform data center? And, why can't other companies implement data middle office? And, how to use the data center to improve efficiency?
2.Basic concepts and terminology
2.1 Overview of data center
Data middle platform refers to a technical infrastructure that is independent, highly standardized, highly automated, and highly integrated in data collection, storage, processing, processing, and calculation. It is used to support the company's various application scenarios and businesses, including data analysis and artificial intelligence. , intelligent decision-making, data-driven business