elasticsearch is just a search framework, nothing more. Hadoop/spark are computing frameworks/big data operating environments, which are not comparable at all.
Knowledge of network engineering, various programming languages, various scripting languages , cloud computing, databases, algorithms, etc. In fact, the so-called big data is a large amount of traffic, a huge amount of data flows on the network, researching big data is researching How to save big data with the smallest space, find small data in big data in the shortest time, the shortest path to flow from other people's computer to your computer, etc. These are very complicated
Most companies are not unfamiliar with the concept of big data, but few people understand the technology used in it. On the one hand, the software used by many people is relatively simple and professional, and only needs to be able to operate it. For example, the FineBI business intelligence solution software, all the internal technologies do not need to be understood by the operator, and only need to understand some superficial communication needs. That is, you don't need to consider how to model, which can save communication time during project implementation and bring more benefits to the enterprise.
On the other hand, many bosses are not good at this, and understanding it has no practical effect on them, but for those who often come into contact with these software, understanding the technology behind it will be of better help to their work. So, what technologies are used behind big data?
1. NoSQL database
In the environment we live in, the emergence of new technologies does not take too long to be reused by people. In fact, many technologies will be used by people one month after they appear. In a broad sense, NoSQL databases themselves also contain many technologies. They focus on the limitations of relational database engines such as indexing, streaming media, and high-access website services, as well as others. In these areas, NoSQL databases are used most frequently.
二、HadoopMapReduce
This is a technology that can handle the challenges posed by big data analysis, not only with high frequency of application, but also with unique advantages in processing. In my hometown, many companies think that the data platform developed by Hadoop MapReduce technology is the best to use. It can be seen that this technology can indeed bring unexpected benefits to enterprises.
3. Memory Analysis Technology
Memory was expensive when it first appeared, but with the advancement of technology, more and more memory began to appear, and the price naturally dropped again and again. However, the performance has not declined, but has an upward trend, which is why memory is very popular in the network.
Not only that, but professionals also mentioned that low-cost memory applications in big data centers have real-time and high-efficiency advantages, and can also improve big data insights, thereby providing enterprises with better data analysis and mining.
4. Integrated equipment
Business intelligence and big data analysis were only stimulated after the emergence of data warehouse equipment. This way of using data warehouse technology to enhance their own competitive advantages and stay ahead of competitors has made many companies happy. However, there are still many functions of integrated equipment. Among them, the ability to enhance the role of traditional database systems is the most used by many enterprises. In addition, integrated equipment has become an important tool for enterprises to cope with data challenges. Therefore, this technology has also attracted much attention.