flume遇到的坑

一、内存溢出

报错:

Exception in thread "SinkRunner-PollingRunner-DefaultSinkProcessor" java.lang.OutOfMemoryError: GC overhead limit exceeded
	at java.util.Arrays.copyOfRange(Arrays.java:3664)
	at java.lang.String.<init>(String.java:207)
	at java.lang.String.substring(String.java:1969)
	at com.huawei.shade.com.alibaba.fastjson.parser.JSONScanner.subString(JSONScanner.java:152)
	at com.huawei.shade.com.alibaba.fastjson.parser.JSONScanner.stringVal(JSONScanner.java:135)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parseObject(DefaultJSONParser.java:470)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parseArray(DefaultJSONParser.java:1205)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parseObject(DefaultJSONParser.java:504)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parseArray(DefaultJSONParser.java:1205)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parseObject(DefaultJSONParser.java:504)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parse(DefaultJSONParser.java:1380)
	at com.huawei.shade.com.alibaba.fastjson.parser.DefaultJSONParser.parse(DefaultJSONParser.java:1346)
	at com.huawei.shade.com.alibaba.fastjson.JSON.parse(JSON.java:156)
	at com.huawei.shade.com.alibaba.fastjson.JSON.parse(JSON.java:166)
	at com.huawei.shade.com.alibaba.fastjson.JSON.parse(JSON.java:135)
	at com.huawei.shade.com.alibaba.fastjson.JSON.parseObject(JSON.java:227)
	at com.hui.yilianzhong.HmcxxTask.process(HmcxxTask.java:74)
	at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
	at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
	at java.lang.Thread.run(Thread.java:748)

解决:修改flume的bin目录下的flume-ng文件中的JAVA_OPTS参数,默认是20m,根据实际情况调大即可
在这里插入图片描述

猜你喜欢

转载自blog.csdn.net/m0_37739193/article/details/104906325