kafka configuration explained

# Raw data kafka read 
kafka.consumer.servers = IP: 9092, IP: 9092 (kafka cluster consumption + ip Port port) 
kafka.consumer.enable.auto.commit = to true (whether to automatically submit) 
kafka.consumer.session.timeout = 20000 (connection timeout) 
kafka.consumer.auto.commit.interval = 100 
kafka.consumer.auto.offset.reset = Latest (real-time production, real consumption, will not scratch consumption) 
kafka.consumer.topic = the Result ( topic of consumption) 
kafka.consumer.group.id = the Test (consumer group) 
kafka.consumer.concurrency = 10 (sets the number of consumer threads) 

after # protocol conversion storage Kafka used to live 
kafka.producer.servers = IP: 9092, IP: 9092 ( kafka production clusters + ip port port) 
kafka.producer.topic=result(生产的topic)
kafka.producer.retries=0
kafka.producer.batch.size=4096
kafka.producer.linger=1
kafka.producer.buffer.memory=40960

 

Guess you like

Origin www.cnblogs.com/lbky/p/11521471.html