One, topic queue operation
1.1, view the topic list
kafka-topics.sh \
--zookeeper 192.168.8.99:2181 \
--list
1.2, create a topic queue
kafka-topics.sh --create \
--zookeeper 192.168.8.99:2181 \
--partitions 1 \
--replication-factor 1 \
--topic topic_name
1.3, view topic details
kafka-topics.sh \
--zookeeper 192.168.8.99:2181 \
--describe \
--topic topic_name
1.4, delete topic queue
kafka-topics.sh \
--delete \
--zookeeper 192.168.8.99:2181 \
--topic topic_name
Two, queue message operation
2.1, production queue message
kafka-console-producer.sh \
--broker-list 192.168.8.99:9092 \
--topic topic_name
2.2, consumption queue message
kafka-console-consumer.sh \
--bootstrap-server 192.168.8.99:9092 \
--from-beginning \
--topic topic_name
2.3. View the number of messages in each partition of the message queue
kafka-run-class.sh kafka.tools.GetOffsetShell \
--broker-list 192.168.8.99:9092 \
-time -1 \
--offsets 1 \
--topic topic_name
Three, execute Flume to write data to Kafka
flume-ng agent \
-n train \
-c /opt/flume/conf/ \
-f /opt/flume/conf/jobkb09/train-flume-kafka.conf \
-Dflume.root.logger=INFO,console