Flume 正则过滤拦截器、时间戳拦截器

正则过滤拦截器:
a1.sources = s1
a1.channels = c1
a1.sinks = sk1

a1.sources.s1.type = netcat
a1.sources.s1.bind = master
a1.sources.s1.port = 44444

a1.sources.s1.interceptors = i1
a1.sources.s1.interceptors.i1.type = regex_filter //拦截器名称
a1.sources.s1.interceptors.i1.regex = (Spark) | (Hadoop) //正则表达式
a1.sources.s1.interceptors.i1.excludeEvents = false //默认收集符合匹配条件的事件。如果为true,则会删除匹配到的event,收集未匹配到的

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000

a1.sinks.sk1.type = logger

a1.sinks.sk1.channel = c1
a1.sources.s1.channels = c1

时间戳拦截器
a1.sources = s1
a1.channels = c1
a1.sinks = sk1

a1.sources.s1.type = netcat
a1.sources.s1.bind = master
a1.sources.s1.port = 44444

a1.sources.s1.interceptors = i1
a1.sources.s1.interceptors.i1.type = timestamp //拦截器名称
a1.sources.s1.interceptors.i1.preserveExisting = false 

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000

a1.sinks.sk1.type = logger

a1.sinks.sk1.channel = c1
a1.sources.s1.channels = c1

猜你喜欢

转载自blog.csdn.net/GX_0824/article/details/126964676