logstash-input-jdbc learning
One of the advantages of ES (elasticsearch abbreviation) is that it is open source and has many plug-ins. So it is very convenient to expand, which also makes its ecosystem more and more powerful. This kind of open source sharing idea is really out of tune with the celestial dynasty. The domestic open source community has been doing it for a long time, but there is nothing that can be taken out. Maybe only Ali pays more attention to sharing.
The query speed of ES is very fast, and the search is very fast. However, our data is still mainly stored in traditional relational databases. Is there any way to synchronize the data in the database to ES in real time? logstash is such a thing.
Logstash is an open source data collection engine with real-time data transmission capabilities. It can uniformly filter data from different sources and output it to the destination according to the specifications made by the developer.
After installing Logstash, then installing the logstash-input-jdbc plug-in, and then installing the mysql-connector-java-6.0.6.jar plug-in, the data in mysql can be synchronized to ES in real time. Installation process reference: ElasticSearch study notes (3) logstash installation and logstash-input-jdbc plugin .
logstash-input-jdbc can be configured to perform incremental synchronization or full synchronization, and whether incremental synchronization is based on time or based on the change value of a field. You can refer to: logstash-input-jdbc synchronization principle and interpretation of related issues . Very convenient.
Chinese word segmentation plugin
There are many Chinese word segmentation plugins on ES, which can segment the stored data to respond to search requests. The most widely used is ik. Its github address . There is a complete introduction to installation and use above. You can even use different tokenizers for the searched content, which is very convenient. reference .
References:
ElasticSearch study notes (3) logstash installation and logstash-input-jdbc plugin