Kafka cluster management tools kafka-manager

About a .kafka-manager

    kafka-manager is the most popular kafka cluster management tool, the first open source Yahoo, users can perform some simple cluster management operations in the Web interface. Specific support the following:

  • Manage multiple clusters
  • Easily check the cluster status (theme, consumer, offset, agents, distribute copies, distributed partition)
  • Run a copy of the electoral choice
  • Use option generates partition is assigned to select the agent you want to use
  • Running partition reallocation (based on the generated distribution)
  • Use the optional theme configuration to create a theme (0.8.1.1 has 0.8.2+ different configurations)
  • Delete themes (supports only 0.8.2+ and remember to set delete.topic.enable = true in the proxy configuration in)
  • Theme list is now marked for deletion theme (only supported 0.8.2+)
  • Volume generated more topics partition assignment, and can choose to use the proxy
  • Batch runs reassign more topics partitions
  • Adding a partition to an existing topic
  • Update an existing theme configuration

kafka-manager Project Address: https://github.com/yahoo/kafka-manager

Two mounting .kafka-manager

1. Download and extract the installation package

Using Git or downloaded directly from the Releases, where we download version 2.0.0.2: https://github.com/yahoo/kafka-manager/release

$ wget https://github.com/yahoo/kafka-manager/archive/2.0.0.2.zip

2, sbt compilation

1) yum mounting sbt (because kafka-manager needs to compile sbt)

$ curl https://bintray.com/sbt/rpm/rpm > bintray-sbt-rpm.repo
$ sudo mv bintray-sbt-rpm.repo /etc/yum.repos.d/
$ sudo yum install sbt

Modify Warehouse Address: (sbt the default download library files is slow, interrupted from time to time), Ali cloud the mirror we can use for substitution

$ Vim ~ / .sbt / repositories must be in strict accordance with the format, after each line without spaces

[repositories] 
local
aliyun: http://maven.aliyun.com/nexus/content/groups/public/
typesafe: http://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly
sonatype-oss-releases
maven-central
sonatype-oss-snapshots

Verification: sbt check whether the installation was successful, view the command output, has found success from maven.aliyun.com/nexusit means to rely successfully downloaded

$ sbt -version

2) Compile kafka-manager

$ ./sbt clean dist

3, modify the configuration file

vim conf / application.conf modify kafka-manager.zkhosts list for their zk node 
  kafka-manager.zkhosts = "node21: 2181 , node22: 2181, node23: 2181"

4, start the service

Boot sequence: zk cluster -> kafka cluster -> kafka-manager

kafka-manager is the default port 9000 , can be specified port -Dhttp.port; -Dconfig.file = conf / application.conf specified configuration file:

nohup /usr/local/kafka-manager-2.0.0.2/bin/kafka-manager -Dconfig.file=/usr/local/kafka-manager-2.0.0.2/conf/application.conf -Dhttp.port=8888 >/dev/null 2>&1 &

jps view the process:

QuorumPeerMain -- ZooKeeper

Kafka - Kafka

ProdServerStart -- kafka-manager

 

Three .kafka-manager configuration

1. New Cluster

Click [Cluster]> [Open] Add Cluster to add the cluster configuration interface as follows: Enter the name of the cluster (as Kafka-Cluster-1) and Zookeeper server address (such as localhost:2181), select the closest version of Kafka

 

Guess you like

Origin www.cnblogs.com/wjoyxt/p/11867316.html