Storm初始化时抛出NotSerializableException

启动topo抛出如下异常:

Exception in thread "main" java.lang.IllegalStateException: Spout 'DetrUpdateEvent' contains a non-serializable field of type com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner, which was instantiated prior to topology creation. com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner should be instantiated within the prepare method of 'DetrUpdateEvent at the earliest.
    at backtype.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:138)
    at com.gdl.gdl.gdlpsr.processor.detrupdate.DetrupdateTopology.main(DetrupdateTopology.java:42)
Caused by: java.lang.RuntimeException: java.io.NotSerializableException: com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner
    at backtype.storm.utils.Utils.javaSerialize(Utils.java:196)
    at backtype.storm.topology.TopologyBuilder.createTopology(TopologyBuilder.java:135)
    ... 1 more
Caused by: java.io.NotSerializableException: com.gdl.trolley.stormclient.TrolleySpout$StormMessageListner
    at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
    at java.io.ObjectOutputStream.defaultWriteFields(ObjectOutputStream.java:1548)
    at java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1509)
    at java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
    at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
    at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
    at backtype.storm.utils.Utils.javaSerialize(Utils.java:192)
    ... 2 more

在storm和bolt和spout中不能包含非静态且在对象创建时初始化的字段。如下面代码时不被允许的。

public class TrolleySpout extends KafkaSpout {
    private static KafkaSpoutConfig.Builder builder = KafkaSpoutConfig.builderStringBytes(UpdateConfig.getInstance().getBrokerHosts()
            , UpdateConfig.getInstance().getAppid());
    private StormMessageListner stormMessageListner = new StormMessageListner();

解决方案:对于bolt,在pepare方法中完成初始化。对于spout,要么重构,要么冒险进行序列化。
实行序列化有什么危险呢?

猜你喜欢

转载自blog.csdn.net/define_us/article/details/82216499