kafka 单台安装配置

kafka安装

安装jdk1.8  解压到/usr/local 重命名。

环境变量配置 vi /etc/profile

export JAVA_HOME=/usr/local/jdk1.8

export JRE_HOME=${JAVA_HOME}/jre

export CLASSPATH=.:${JAVA_HOME}/lib:${JRE_HOME}/lib:$CLASSPATH

export JAVA_PATH=${JAVA_HOME}/bin:${JRE_HOME}/bin

export PATH=$PATH:${JAVA_PATH}

 

zookeeper安装单台集群

Tar –zxvf zookeeper-3.4.14.tar.gz

cp -R zookeeper-3.4.14 /opt/zookeeper/zookeeper-2181

cp -R zookeeper-3.4.14 /opt/zookeeper/zookeeper-2182

cp -R zookeeper-3.4.14 /opt/zookeeper/zookeeper-2183

 

zookeeper根目录：mkdir zkdata zkdatalog

配置文件位置cp zoo.cfg

dataDir=/opt/zookeeper/zookeeper-2181/zkdata

dataLogDir=/opt/zookeeper/zookeeper-2181/zkdatalog

 

server.1=10.20.200.137:2881:3881

server.2=10.20.200.137:2882:3882

server.3=10.20.200.137:2883:3883

 

1. 修改hosts文件添加三台主机IP和主机名（必要）
2. 修改vim /opt/zookeeper/zookeeper-2181/zkdata/myid
3. 修改vim /opt/zookeeper/zookeeper-2182/zkdata/myid
4. 修改vim /opt/zookeeper/zookeeper-2183/zkdata/myid

分别是 对应server，添加 1 主机2  添加2  主机3  添加3（必要）

启动./zkServer.sh start

 

安装kafka

tar -zxvf kafka_2.11-2.2.0.tgz

mv kafka_2.11* /opt/kafka_2.11

vim server.properties

60行：log.dirs=/opt/kafka_2.11/logs

123行：zookeeper.connect=10.20.200.137:2181,10.20.200.137:2182,10.20.200.137:2183

启动kafka

../bin/kafka-server-start.sh server.properties

Jps

jps –m   查看进程

 

添加测试创建topic为test

./kafka-topics.sh -create -zookeeper 10.20.200.137:2181 --replication-factor 1 --partitions 1 --topic test

 

验证接收

./kafka-topics.sh --list --zookeeper 10.20.200.137:2181

 

启动生产者

kafka-console-producer.sh --broker-list localhost:9092 --topic test

消费者消费数据

./kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning