About a .kafka-manager
kafka-manager is the most popular kafka cluster management tool, the first open source Yahoo, users can perform some simple cluster management operations in the Web interface. Specific support the following:
- Manage multiple clusters
- Easily check the cluster status (theme, consumer, offset, agents, distribute copies, distributed partition)
- Run a copy of the electoral choice
- Use option generates partition is assigned to select the agent you want to use
- Running partition reallocation (based on the generated distribution)
- Use the optional theme configuration to create a theme (0.8.1.1 has 0.8.2+ different configurations)
- Delete themes (supports only 0.8.2+ and remember to set delete.topic.enable = true in the proxy configuration in)
- Theme list is now marked for deletion theme (only supported 0.8.2+)
- Volume generated more topics partition assignment, and can choose to use the proxy
- Batch runs reassign more topics partitions
- Adding a partition to an existing topic
- Update an existing theme configuration
kafka-manager Project Address: https://github.com/yahoo/kafka-manager
Two mounting .kafka-manager
1. Download and extract the installation package
Using Git or downloaded directly from the Releases, where we download version 2.0.0.2: https://github.com/yahoo/kafka-manager/release
$ wget https://github.com/yahoo/kafka-manager/archive/2.0.0.2.zip
2, sbt compilation
1) yum mounting sbt (because kafka-manager needs to compile sbt)
$ curl https://bintray.com/sbt/rpm/rpm > bintray-sbt-rpm.repo $ sudo mv bintray-sbt-rpm.repo /etc/yum.repos.d/ $ sudo yum install sbt
Modify Warehouse Address: (sbt the default download library files is slow, interrupted from time to time), Ali cloud the mirror we can use for substitution
$ Vim ~ / .sbt / repositories must be in strict accordance with the format, after each line without spaces
[repositories] local aliyun: http://maven.aliyun.com/nexus/content/groups/public/ typesafe: http://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/(scala_[scalaVersion]/)(sbt_[sbtVersion]/)[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly sonatype-oss-releases maven-central sonatype-oss-snapshots
Verification: sbt check whether the installation was successful, view the command output, has found success from maven.aliyun.com/nexus
it means to rely successfully downloaded
$ sbt -version
2) Compile kafka-manager
$ ./sbt clean dist
3, modify the configuration file
4, start the service
Boot sequence: zk cluster -> kafka cluster -> kafka-manager
kafka-manager is the default port 9000 , can be specified port -Dhttp.port; -Dconfig.file = conf / application.conf specified configuration file:
nohup /usr/local/kafka-manager-2.0.0.2/bin/kafka-manager -Dconfig.file=/usr/local/kafka-manager-2.0.0.2/conf/application.conf -Dhttp.port=8888 >/dev/null 2>&1 &
jps view the process:
QuorumPeerMain -- ZooKeeper
Kafka - Kafka
ProdServerStart -- kafka-manager
Three .kafka-manager configuration
1. New Cluster
Click [Cluster]> [Open] Add Cluster to add the cluster configuration interface as follows: Enter the name of the cluster (as Kafka-Cluster-1
) and Zookeeper server address (such as localhost:2181
), select the closest version of Kafka