kafka 测试 [2019-5-28 16:52:00]

目录

环境准备

kafka 单节点单broker(1-1)

kafka 单节点多broker(1-3)

kafka 多节点多broker(3-3)

kafka api - java


环境准备

解压安装kafka最新版、启动zookeeper单机/完全分布式

kafka 单节点单broker(1-1)

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

# 修改配置文件    $KAFKA_HOME/config/server.properties
# server1_1

broker.id=01
listeners=PLAINTEXT://:9092
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs
zookeeper.connect=master:2181
--------------------------# 启动kafka #-------------------------------------------------
kafka-server-start.sh -daemon $KAFKA_HOME/config/server1_1

--------------------------# jps #-------------------------------------------------------
3495 QuorumPeerMain
3866 Kafka
3931 Jps
--------------------------# 停止 #-------------------------------------------------------
kafka-server-stop.sh
--------------------------# 创建topic: zk #----------------------------------------------
# 副本 1,分区 1
kafka-topics.sh --create --zookeeper master:2181 --replication-factor 1 --partitions 1 --topic hello_topic
--------------------------# 查看所有topic #-----------------------------------------------
kafka-topics.sh --list --zookeeper master:2181
#查看所有topic的详细信息:
kafka-topics.sh --describe --zookeeper master:2181
#查看指定topic的详细信息:
kafka-topics.sh --describe --zookeeper master:2181 --topic hello_topic

--------------------------# 删除主题topic #-----------------------------------------------	
# 注意:server.properties配置delete.topic.enable=true才是真正的删除,否则把topic标记为:marked for deletion)

kafka-topics.sh --delete  --zookeeper master:2181 --topic hello_topic

--------------------------# 发送消息: broker #--------------------------------------------
kafka-console-producer.sh --broker-list master:9092 --topic hello_topic

--------------------------# 消费消息: zk #------------------------------------------------
# --from-beginning    
kafka-console-consumer.sh --zookeeper master:2181 --topic hello_topic --from-beginning
# 如果上一句出现问题是老版本的已过时,则使用下面这一句的新版本的
kafka-console-consumer.sh --bootstrap-server master:9092  --topic hello_topic --from-beginning
-----------------------------------------------------------------------------------------

kafka 单节点多broker(1-3)

?????????????????有问题-无法消费--暂时没解决

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

# 修改配置文件    $KAFKA_HOME/config/server-1.properties
# server3_1

broker.id=01
listeners=PLAINTEXT://:9093
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs-1
zookeeper.connect=master:2181
-------------------------------------------------------------------------------------------
# 修改配置文件    $KAFKA_HOME/config/server-2.properties
# server3_2

broker.id=02
listeners=PLAINTEXT://:9094
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs-2
zookeeper.connect=master:2181
-------------------------------------------------------------------------------------------
# 修改配置文件    $KAFKA_HOME/config/server-3.properties
# server3_3

broker.id=03
listeners=PLAINTEXT://:9095
host.name=master
log.dirs=/app/kafka/tmp0/kafka-logs-3
zookeeper.connect=master:2181
--------------------------# 启动kafka #--------------------------------------------------
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3_1 &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3_2 &
kafka-server-start.sh -daemon $KAFKA_HOME/config/server3_3 &
jps

--------------------------# 创建topic: zk #----------------------------------------------

kafka-topics.sh --create --zookeeper master:2181 --replication-factor 3 --partitions 1 --topic my-replicated-topic
--------------------------# 发送消息: broker #--------------------------------------------

kafka-console-producer.sh --broker-list master:9093,master:9094,master:9095 --topic my-replicated-topic

--------------------------# 消费消息: zk #------------------------------------------------

kafka-console-consumer.sh --zookeeper master:2181 --topic my-replicated-topic --from-beginning
上面一句出现问题-已过时,使用下面的最新版Kafka

kafka-console-consumer.sh --bootstrap-server master:9093,master:9094,master:9095 --topic my-replicated-topic --from-beginning
--------------------------# 描述主题     #------------------------------------------------
kafka-topics.sh --list --zookeeper master:2181

kafka-topics.sh --describe --zookeeper master:2181 --topic my-replicated-topic
-----------------------------------------------------------------------------------------

kafka 多节点多broker(3-3)

暂时先不弄,跟单节点多broker差不多

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

=======================================================================

kafka api - java

发布了51 篇原创文章 · 获赞 6 · 访问量 4771

猜你喜欢

转载自blog.csdn.net/weixin_42191996/article/details/90642665