Data collection ETL and streaming batch integration framework
Features: efficient, stable, fast, safe
bboss is an open source project released based on the open source agreement Apache License. It mainly consists of the following three parts:
- Elasticsearch Highlevel Java Restclient , a high-performance and high-compatibility Elasticsearch/Opensearch java client framework
- Data collection synchronization ETL , a powerful ETL tool based on Java language to implement data collection operations, provides a wealth of input plug-ins and output plug-ins, and can easily expand new input plug-ins and output plug-ins based on plug-in specifications.
- The stream-batch integrated computing framework provides a simple framework for flexible data indicator statistics and stream-batch integrated processing functions. It can be combined with data collection and synchronization ETL tools to implement data stream processing and batch processing calculations, and can also be used independently; calculation results can be saved to various relational databases, distributed data warehouses Elasticsearch, Clickhouse, etc. It is especially suitable for enterprise-level data analysis and computing scenarios with small data volume and scale. It has the characteristics of low cost, quick results, and easy operation and maintenance, helping enterprises to reduce costs. Increase efficiency
Reference documentation
https://esdoc.bbossgroups.com/#/db-es-tool
bboss ETL plug-in usage guide
https://esdoc.bbossgroups.com/#/datatran-plugins
bboss detailed introduction document
https://esdoc.bbossgroups.com/#/README
bboss actual combat video
Elasticsearch Bboss Stream ETL introduction video
Real-time collection of Mysql binlog data addition, deletion and modification video tutorial