ELKは構築し、カフカ

• 参考リンク：https://www.cnblogs.com/fengjian2016/p/5841556.html

飼育係：

nohup bin/zookeeper-server-start.sh config/zookeeper.properties & #启动zookeeper 端口 2181

カフカ：

nohup bin/kafka-server-start.sh config/server_cluster.properties & #启动kafka 端口 9092
bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test #创建主题
 bin/kafka-topics.sh --list --bootstrap-server localhost:9092 #查看主题
bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test #生产者 在主题 test 生产消息
bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic test --from-beginning #消费消息
bin/kafka-topics.sh  --zookeeper 10.10.2.67:2181 --describe --topic test_log #从zookeeper读取数据

これは、次のとおりです。

logstash：

bin/logstash -f config/kafka_logstash_to_es.conf --config.test_and_exit #测试文件
nohup bin/logstash -f config/kafka_logstash_to_es.conf --config.reload.automatic & #启动服务

filebeat：

カフカのクラスター・エラー、バージョンおよびその他の設定は同じではありません

[2019-06-09 22:23:33,639] INFO [ZooKeeperClient] Waiting until connected. (kafka
.zookeeper.ZooKeeperClient)
[2019-06-09 22:23:39,650] INFO [ZooKeeperClient] Closing. (kafka.zookeeper.ZooKe
eperClient)
[2019-06-09 22:23:40,082] INFO Opening socket connection to server 192.168.72.73
/192.168.72.73:2181. Will not attempt to authenticate using SASL (unknown error)
 (org.apache.zookeeper.ClientCnxn)
[2019-06-09 22:23:40,082] WARN Client session timed out, have not heard from ser
ver in 6440ms for sessionid 0x0 (org.apache.zookeeper.ClientCnxn)
[2019-06-09 22:23:40,191] INFO Session: 0x0 closed (org.apache.zookeeper.ZooKeep
er)
[2019-06-09 22:23:40,191] INFO EventThread shut down for session: 0x0 (org.apach
e.zookeeper.ClientCnxn)
[2019-06-09 22:23:40,191] INFO [ZooKeeperClient] Closed. (kafka.zookeeper.ZooKee
perClient)
[2019-06-09 22:23:40,191] ERROR Fatal error during KafkaServer startup. Prepare
to shutdown (kafka.server.KafkaServer)
kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connectio
n while in state: CONNECTING