[シリーズ]ドッキングウィンドウカフカ・マネージャコンテナをカスタムイメージを作成し、実行するために、カフカクラスタ管理ツール

前提:私はカフカ使用するクラスタ、バージョン2.12-2.4.0。

最新バージョンドッキングウィンドウプルsheepkiller / 1.3.1.8のカフカ・マネージャー、または下記のカフカでサポート0.9.0.1バージョン。図:

したがって、我々はサポートバージョン2.0以上カフカカフカ・マネージャーを作成する必要があります。 

ビューgithubのは、の2.0.0.2バージョン見つかった
アドレスを:  https://github.com/yahoo/kafka-manager/releases

だから、私は非常に簡単に取りました。ライン上で直接2.0.0.2にDockerfile 1.2.7上図、。
注:2.0.0.2を使用することができます前に、私が使用しました。しかし、その後、公式サイトには、ディレクトリ構造が得られ、このバージョンを更新変更しました。一時的に取ります。

私は私が以前のバージョンをダウンロードして、Dockerfileディレクトリの下に置かれた囲みこの方法!
https://download.csdn.net/download/weixin_42697074/12193828

[root@hadoop-keda kafka-manager]# clear
[root@hadoop-keda kafka-manager]# ll
total 8
drwxr-xr-x 2 root root 4096 Jan  7 14:24 conf
-rwxrwxrwx 1 root root  618 Jan  7 13:30 Dockerfile
[root@hadoop-keda kafka-manager]# vim Dockerfile 

FROM hseeberger/scala-sbt

MAINTAINER seowen.wang <[email protected]>

ENV ZK_HOSTS=localhost:2181 \
     KM_VERSION=2.0.0.2

RUN mkdir -p /tmp
ADD 2.0.0.2.tar.gz /tmp
WORKDIR /tmp
RUN cd /tmp/kafka-manager-${KM_VERSION} && \
    sbt clean dist && \
    unzip  -d / ./target/universal/kafka-manager-${KM_VERSION}.zip && \
    rm -fr /tmp/${KM_VERSION} /tmp/kafka-manager-${KM_VERSION}

WORKDIR /kafka-manager-${KM_VERSION}

EXPOSE 9000
ENTRYPOINT ["./bin/kafka-manager","-Dconfig.file=conf/application.conf"]

Dockerfileは、サーバー上に置きました。そして、ミラーを作成するには、ビルドコマンドを入力します。

docker build -t seowen/kafka-manager .

長いミラーの作成プロセス、患者も

[root@hadoop-keda kafka-manager]# docker images
REPOSITORY                  TAG                 IMAGE ID            CREATED             SIZE
seowen/kafka-manager        latest              e96d3d8b7477        About an hour ago   1.36GB
zookeeper                   3.5.6               2f0427341b7b        8 days ago          224MB
mysql                       latest              ed1ffcb5eff3        9 days ago          456MB
nginx                       latest              f7bb5701a33c        9 days ago          126MB
wurstmeister/kafka          2.12-2.4.0          9a5842c217a8        2 weeks ago         432MB
consul                      latest              61c55d0793c6        6 weeks ago         117MB
logstash                    7.4.2               642b82780655        2 months ago        889MB
kibana                      7.4.2               230d3ded1abc        2 months ago        1.1GB
elasticsearch               7.4.2               b1179d41a7b4        2 months ago        855MB
sheepkiller/kafka-manager   latest              4e4a8c5dabab        21 months ago       463MB
hseeberger/scala-sbt        latest              da0e1be3bb79        2 years ago         925MB
mobz/elasticsearch-head     5                   b19a5c98e43b        2 years ago         824MB
[root@hadoop-keda kafka-manager]# 

あなたは良いイメージを作成した後、コンテナを実行し、設定ファイルを変更し始めます。

[root@hadoop-keda kafka-manager]# sudo docker run -dit \
--net docker-hadoop-net \
--ip 172.170.0.14 \
--restart=always \
--hostname=hadoop_kafka_manager \
--name=hadoop-kafka-manager \
-p 19000:9000 \
-v /usr/docker/software/kafka-manager/conf:/kafka-manager-2.0.0.2/conf \
-v /etc/localtime:/etc/localtime \
-e ZK_HOSTS="172.19.12.12:12181,172.19.12.13:12181,172.19.12.14:12181" \
-e KAFKA_MANAGER_AUTH_ENABLED=true \
-e KAFKA_MANAGER_USERNAME=admin \
-e KAFKA_MANAGER_PASSWORD=Keda@123456 \
-e TZ='Asia/Shanghai' \
-e LANG="en_US.UTF-8" \
seowen/kafka-manager:latest

说明:
-e ZK_HOSTS="172.19.12.12:12181,172.19.12.13:12181,172.19.12.14:12181" 
配置 zookeeper 集群地址
-e KAFKA_MANAGER_AUTH_ENABLED=true 
启用 账号登录
-e KAFKA_MANAGER_USERNAME=admin 
设置用户名
-e KAFKA_MANAGER_PASSWORD=Keda@123456 
设置密码

然后,查看容器日志

[root@hadoop-keda conf]# docker logs d1a6c8d8493d7cc58
2020-01-07 14:27:31,816 - [WARN] application - conf/application.conf: 12: play.crypto.secret is deprecated, use play.http.secret.key instead
2020-01-07 14:27:32,168 - [WARN] o.a.c.r.ExponentialBackoffRetry - maxRetries too large (100). Pinning to 29
2020-01-07 14:27:32,272 - [INFO] k.m.a.KafkaManagerActor - Starting curator...
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:zookeeper.version=3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03, built on 06/29/2018 00:39 GMT
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:host.name=hadoop_kafka_manager
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.version=1.8.0_131
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.vendor=Oracle Corporation
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.home=/usr/lib/jvm/java-8-openjdk-amd64/jre
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.class.path=/kafka-manager-2.0.0.2/lib/../conf/:/kafka-manager-2.0.0.2/lib/kafka-manager.kafka-manager-2.0.0.2-sans-externalized.jar:/kafka-manager-2.0.0.2/lib/org.scala-lang.scala-library-2.12.8.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.twirl-api_2.12-1.3.15.jar:/kafka-manager-2.0.0.2/lib/org.scala-lang.modules.scala-xml_2.12-1.0.6.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-server_2.12-2.6.21.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play_2.12-2.6.21.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.build-link-2.6.21.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-exceptions-2.6.21.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-netty-utils-2.6.21.jar:/kafka-manager-2.0.0.2/lib/org.slf4j.slf4j-api-1.7.25.jar:/kafka-manager-2.0.0.2/lib/org.slf4j.jul-to-slf4j-1.7.25.jar:/kafka-manager-2.0.0.2/lib/org.slf4j.jcl-over-slf4j-1.7.25.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-streams_2.12-2.6.21.jar:/kafka-manager-2.0.0.2/lib/org.reactivestreams.reactive-streams-1.0.2.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.akka.akka-stream_2.12-2.5.19.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.akka.akka-actor_2.12-2.5.19.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.config-1.3.3.jar:/kafka-manager-2.0.0.2/lib/org.scala-lang.modules.scala-java8-compat_2.12-0.8.0.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.akka.akka-protobuf_2.12-2.5.19.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.ssl-config-core_2.12-0.3.6.jar:/kafka-manager-2.0.0.2/lib/org.scala-lang.modules.scala-parser-combinators_2.12-1.1.1.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.akka.akka-slf4j_2.12-2.5.19.jar:/kafka-manager-2.0.0.2/lib/com.fasterxml.jackson.datatype.jackson-datatype-jsr310-2.8.11.jar:/kafka-manager-2.0.0.2/lib/commons-codec.commons-codec-1.11.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-json_2.12-2.6.12.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-functional_2.12-2.6.12.jar:/kafka-manager-2.0.0.2/lib/org.scala-lang.scala-reflect-2.12.8.jar:/kafka-manager-2.0.0.2/lib/org.typelevel.macro-compat_2.12-1.1.1.jar:/kafka-manager-2.0.0.2/lib/joda-time.joda-time-2.9.9.jar:/kafka-manager-2.0.0.2/lib/com.google.guava.guava-23.6.1-jre.jar:/kafka-manager-2.0.0.2/lib/com.google.code.findbugs.jsr305-3.0.2.jar:/kafka-manager-2.0.0.2/lib/org.checkerframework.checker-compat-qual-2.0.0.jar:/kafka-manager-2.0.0.2/lib/com.google.errorprone.error_prone_annotations-2.1.3.jar:/kafka-manager-2.0.0.2/lib/com.google.j2objc.j2objc-annotations-1.1.jar:/kafka-manager-2.0.0.2/lib/org.codehaus.mojo.animal-sniffer-annotations-1.14.jar:/kafka-manager-2.0.0.2/lib/io.jsonwebtoken.jjwt-0.7.0.jar:/kafka-manager-2.0.0.2/lib/javax.xml.bind.jaxb-api-2.3.1.jar:/kafka-manager-2.0.0.2/lib/javax.activation.javax.activation-api-1.2.0.jar:/kafka-manager-2.0.0.2/lib/org.apache.commons.commons-lang3-3.6.jar:/kafka-manager-2.0.0.2/lib/javax.transaction.jta-1.1.jar:/kafka-manager-2.0.0.2/lib/javax.inject.javax.inject-1.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.filters-helpers_2.12-2.6.21.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-logback_2.12-2.6.21.jar:/kafka-manager-2.0.0.2/lib/ch.qos.logback.logback-classic-1.2.3.jar:/kafka-manager-2.0.0.2/lib/ch.qos.logback.logback-core-1.2.3.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.play.play-akka-http-server_2.12-2.6.21.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.akka.akka-http-core_2.12-10.0.15.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.akka.akka-parsing_2.12-10.0.15.jar:/kafka-manager-2.0.0.2/lib/org.webjars.webjars-play_2.12-2.6.3.jar:/kafka-manager-2.0.0.2/lib/org.webjars.requirejs-2.3.5.jar:/kafka-manager-2.0.0.2/lib/org.webjars.webjars-locator-0.32-1.jar:/kafka-manager-2.0.0.2/lib/org.webjars.webjars-locator-core-0.35.jar:/kafka-manager-2.0.0.2/lib/org.apache.commons.commons-compress-1.9.jar:/kafka-manager-2.0.0.2/lib/org.webjars.bootstrap-4.3.1.jar:/kafka-manager-2.0.0.2/lib/org.webjars.jquery-3.3.1-2.jar:/kafka-manager-2.0.0.2/lib/org.webjars.popper.js-1.14.3.jar:/kafka-manager-2.0.0.2/lib/org.webjars.backbonejs-1.3.3.jar:/kafka-manager-2.0.0.2/lib/org.webjars.underscorejs-1.9.0.jar:/kafka-manager-2.0.0.2/lib/org.webjars.dustjs-linkedin-2.7.2.jar:/kafka-manager-2.0.0.2/lib/org.webjars.json-20121008-1.jar:/kafka-manager-2.0.0.2/lib/org.webjars.octicons-4.3.0.jar:/kafka-manager-2.0.0.2/lib/org.apache.curator.curator-framework-2.12.0.jar:/kafka-manager-2.0.0.2/lib/org.apache.curator.curator-client-2.12.0.jar:/kafka-manager-2.0.0.2/lib/jline.jline-0.9.94.jar:/kafka-manager-2.0.0.2/lib/org.apache.curator.curator-recipes-2.12.0.jar:/kafka-manager-2.0.0.2/lib/org.json4s.json4s-jackson_2.12-3.6.5.jar:/kafka-manager-2.0.0.2/lib/org.json4s.json4s-core_2.12-3.6.5.jar:/kafka-manager-2.0.0.2/lib/org.json4s.json4s-ast_2.12-3.6.5.jar:/kafka-manager-2.0.0.2/lib/org.json4s.json4s-scalap_2.12-3.6.5.jar:/kafka-manager-2.0.0.2/lib/com.thoughtworks.paranamer.paranamer-2.8.jar:/kafka-manager-2.0.0.2/lib/com.fasterxml.jackson.core.jackson-databind-2.9.8.jar:/kafka-manager-2.0.0.2/lib/com.fasterxml.jackson.core.jackson-annotations-2.9.0.jar:/kafka-manager-2.0.0.2/lib/com.fasterxml.jackson.core.jackson-core-2.9.8.jar:/kafka-manager-2.0.0.2/lib/org.json4s.json4s-scalaz_2.12-3.6.5.jar:/kafka-manager-2.0.0.2/lib/org.scalaz.scalaz-core_2.12-7.2.27.jar:/kafka-manager-2.0.0.2/lib/org.slf4j.log4j-over-slf4j-1.7.25.jar:/kafka-manager-2.0.0.2/lib/com.adrianhurt.play-bootstrap_2.12-1.4-P26-B4.jar:/kafka-manager-2.0.0.2/lib/com.adrianhurt.play-bootstrap-core_2.12-1.4-P26.jar:/kafka-manager-2.0.0.2/lib/org.clapper.grizzled-slf4j_2.12-1.3.3.jar:/kafka-manager-2.0.0.2/lib/org.apache.kafka.kafka_2.12-2.2.0.jar:/kafka-manager-2.0.0.2/lib/org.apache.kafka.kafka-clients-2.2.0.jar:/kafka-manager-2.0.0.2/lib/com.github.luben.zstd-jni-1.3.8-1.jar:/kafka-manager-2.0.0.2/lib/org.lz4.lz4-java-1.5.0.jar:/kafka-manager-2.0.0.2/lib/org.xerial.snappy.snappy-java-1.1.7.2.jar:/kafka-manager-2.0.0.2/lib/com.fasterxml.jackson.datatype.jackson-datatype-jdk8-2.9.8.jar:/kafka-manager-2.0.0.2/lib/net.sf.jopt-simple.jopt-simple-5.0.4.jar:/kafka-manager-2.0.0.2/lib/com.yammer.metrics.metrics-core-2.2.0.jar:/kafka-manager-2.0.0.2/lib/com.typesafe.scala-logging.scala-logging_2.12-3.9.0.jar:/kafka-manager-2.0.0.2/lib/com.101tec.zkclient-0.11.jar:/kafka-manager-2.0.0.2/lib/org.apache.zookeeper.zookeeper-3.4.13.jar:/kafka-manager-2.0.0.2/lib/org.apache.yetus.audience-annotations-0.5.0.jar:/kafka-manager-2.0.0.2/lib/io.netty.netty-3.10.6.Final.jar:/kafka-manager-2.0.0.2/lib/org.apache.kafka.kafka-streams-2.2.0.jar:/kafka-manager-2.0.0.2/lib/org.apache.kafka.connect-json-2.2.0.jar:/kafka-manager-2.0.0.2/lib/org.apache.kafka.connect-api-2.2.0.jar:/kafka-manager-2.0.0.2/lib/org.rocksdb.rocksdbjni-5.15.10.jar:/kafka-manager-2.0.0.2/lib/com.beachape.enumeratum_2.12-1.5.13.jar:/kafka-manager-2.0.0.2/lib/com.beachape.enumeratum-macros_2.12-1.5.9.jar:/kafka-manager-2.0.0.2/lib/com.github.ben-manes.caffeine.caffeine-2.6.2.jar:/kafka-manager-2.0.0.2/lib/com.unboundid.unboundid-ldapsdk-4.0.9.jar:/kafka-manager-2.0.0.2/lib/kafka-manager.kafka-manager-2.0.0.2-assets.jar
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib/x86_64-linux-gnu/jni:/lib/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:/usr/lib/jni:/lib:/usr/lib
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.io.tmpdir=/tmp
2020-01-07 14:27:32,286 - [INFO] o.a.z.ZooKeeper - Client environment:java.compiler=<NA>
2020-01-07 14:27:32,290 - [INFO] o.a.z.ZooKeeper - Client environment:os.name=Linux
2020-01-07 14:27:32,290 - [INFO] o.a.z.ZooKeeper - Client environment:os.arch=amd64
2020-01-07 14:27:32,290 - [INFO] o.a.z.ZooKeeper - Client environment:os.version=3.10.0-1062.1.2.el7.x86_64
2020-01-07 14:27:32,290 - [INFO] o.a.z.ZooKeeper - Client environment:user.name=root
2020-01-07 14:27:32,290 - [INFO] o.a.z.ZooKeeper - Client environment:user.home=/root
2020-01-07 14:27:32,290 - [INFO] o.a.z.ZooKeeper - Client environment:user.dir=//kafka-manager-2.0.0.2
2020-01-07 14:27:32,291 - [INFO] o.a.z.ZooKeeper - Initiating client connection, connectString=172.19.12.12:12181,172.19.12.13:12181,172.19.12.14:12181 sessionTimeout=60000 watcher=org.apache.curator.ConnectionState@ff76e11
2020-01-07 14:27:32,335 - [INFO] o.a.z.ClientCnxn - Opening socket connection to server 172.19.252.91/172.19.252.91:12181. Will not attempt to authenticate using SASL (unknown error)
2020-01-07 14:27:32,336 - [INFO] k.m.a.KafkaManagerActor - zk=172.19.12.12:12181,172.19.12.13:12181,172.19.12.14:12181 
2020-01-07 14:27:32,337 - [INFO] k.m.a.KafkaManagerActor - baseZkPath=/kafka-manager
2020-01-07 14:27:32,344 - [INFO] o.a.z.ClientCnxn - Socket connection established to 172.19.12.12/172.19.12.12:12181, initiating session
2020-01-07 14:27:32,358 - [INFO] o.a.z.ClientCnxn - Session establishment complete on server 172.19.12.13/172.19.12.13:12181, sessionid = 0xb00329cdbe60003, negotiated timeout = 40000
2020-01-07 14:27:32,474 - [INFO] k.m.a.KafkaManagerActor - Started actor akka://kafka-manager-system/user/kafka-manager
2020-01-07 14:27:32,474 - [INFO] k.m.a.KafkaManagerActor - Starting delete clusters path cache...
2020-01-07 14:27:32,474 - [INFO] k.m.a.DeleteClusterActor - Started actor akka://kafka-manager-system/user/kafka-manager/delete-cluster
2020-01-07 14:27:32,474 - [INFO] k.m.a.DeleteClusterActor - Starting delete clusters path cache...
2020-01-07 14:27:32,495 - [INFO] k.m.a.DeleteClusterActor - Adding kafka manager path cache listener...
2020-01-07 14:27:32,496 - [INFO] k.m.a.DeleteClusterActor - Scheduling updater for 10 seconds
2020-01-07 14:27:32,496 - [INFO] k.m.a.KafkaManagerActor - Starting kafka manager path cache...
2020-01-07 14:27:32,511 - [INFO] k.m.a.KafkaManagerActor - Adding kafka manager path cache listener...
2020-01-07 14:27:32,734 - [INFO] play.api.Play - Application started (Prod)
2020-01-07 14:27:33,403 - [INFO] p.c.s.AkkaHttpServer - Listening for HTTP on /0.0.0.0:9000
2020-01-07 14:27:33,535 - [INFO] k.m.a.KafkaManagerActor - Updating internal state...
[root@hadoop-keda conf]# ls

显示,连接成功!

打开浏览器:http://xxxxxxx.xx:19000

 

 


 

 

至此,kafka-manager 创建完毕

发布了111 篇原创文章 · 获赞 28 · 访问量 4万+

おすすめ

転載: blog.csdn.net/weixin_42697074/article/details/103874777