运行Flink接受kafka数据踩坑(一)

运行程序的时候报错如下:

Caused by: java.lang.NoSuchMethodError: org.apache.kafka.clients.consumer.KafkaConsumer.assign(Ljava/util/List;)V

错误的原因:Flink接受的kafka数据的Consumer的版本和kafka-client的版本不一致导致

正确的配置如下:



pom:
       <dependency>
            <groupId>org.apache.flink</groupId>
            <artifactId>flink-connector-kafka-0.10_2.11</artifactId>
            <version>${flink.version}</version>
        </dependency>

        <dependency>
            <groupId>org.apache.kafka</groupId>
            <artifactId>kafka-clients</artifactId>
            <version>${kafka.version}</version>
        </dependency>

code:
val kafka09 =new  FlinkKafkaConsumer09[String](topics,new SimpleStringSchema(),properties)
//对应的kafka.version=0.9.0.1

val kafka010=new  FlinkKafkaConsumer010[String](topics,new SimpleStringSchema(),properties)
//对应的kakfa.version=1.0.0

猜你喜欢

转载自blog.csdn.net/wangyu1025391259/article/details/86627954