Flume real case operation and maintenance articles
Author: Yin Zhengjie
Copyright: original works, declined to reprint! Otherwise held liable.
A .Flume Overview
1> What is the Flume
Flume is a distributed, reliable, high availability of massive log polymerization system that supports various types of customized data sender in the system for collecting data; Meanwhile, Flume provides simple data processing, and various kinds of data written to the recipient .
Official Address: HTTP: // flume.apache.org/.
2> .Flume properties
( 1 ) high reliability Flume provides end to end data reliability mechanisms
( 2 ) easy to expand Agent is a distributed architecture, horizontally scalable
( 3 ) easy to recover Channel to save the event and data sources related to failure when the recovery
( 4 ) feature rich Flume with built-in assembly, including different data sources and different storage
3> .Flume common components
( 1 ) Source: data sources, simply means that the agent obtain entry data. ( 2 ) Channel: channel pipe, and the flow of data storage. You must be at least a source and a channel association. ( . 3 ) Sink: to receive the data transmission channel and transmitted to the designated place, has been successfully removed from the channel.
4> .Flume architecture
two.
three.