flume实战:监控文件所追加内容

一:agent配置文件内容

# 声明agent
a1.sources = r1
a1.sinks = k1
a1.channels = c1

# 监控test.log文件追加内容
a1.sources.r1.type = exec
a1.sources.r1.command = tail -f /opt/software/flume/datas/test.log

# Describe the sink
a1.sinks.k1.type = logger

# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

二:演示,涉及到的两个命令

1、启动flume:bin/flume-ng agent -n a1 -c conf/ -f job/file_logger.conf -Dflume.root.logger=INFO,console

2、文件追加内容:示例:echo 123 >> test.log   追加不覆盖

注意:当r1.type为exec时,若所监控的该文件中已有内容,那么启动flume时,会默认先将原有的数据进行读取

窗口1:

窗口2:

演示完毕

 

猜你喜欢

转载自blog.csdn.net/lyw5200/article/details/114745034