Table of contents

3.1 Download Offset Explorer and install

3.2 Software configuration

3.2.5 Modify configuration file

3.3 Basic use

3.3.1 View topic partition list and partition leader location information

3.3.2 View data

I. Overview

Offset Explorer (formerly known as Kafka Tool) is a GUI application for managing and enabling Apache Kafka® clusters. It provides an intuitive UI that allows one to quickly view objects in a Kafka cluster and messages stored in cluster topics. It contains features for developers and administrators.

Some key features include:

Quickly view all Kafka clusters, including their brokers, topics and consumers
View the content of messages in a section and add new ones
View consumer offsets, including Apache Storm Kafka spout consumers
Display JSON, XML and Avro messages in pretty print format
Add and delete topics and other administrative functions
Save individual messages from a partition to the local hard drive
Write your own plugins that allow you to view custom data formats
Offset Explorer runs on Windows, Linux and Mac OS

2. Environmental information

System environment: windows 10

Offset explorer version: 2.2

Kafka version: Kafka2.0.0

3. Installation and use

3.1 Download Offset Explorer and install

Download URL: Offset Explorer

Download to local .exe file

accept Next

Installation path, Next

Finish

3.2 Software configuration

3.2.1Properties

After downloading and installing, make a new connection, start offsetexplorer.exe, and fill in the parameters such as Cluster name and kafka Cluster Version under the Properties option in the Add Cluster window.

Cluster name: can be filled in at will;
Cluster version: Need to confirm, there are big differences between different versions;
The IP address of the server where zookeeper is located:
port;

3.2.2Properties

Configure security items, choose according to your own environment, my environment is SASL_PLAINTEXT, just select SASL_PLAINTEXT below.

SASL_PLAINTEXT: Use the SASL framework for authentication and data encryption, and use plaintext to transmit data

SASL_SSL: Use the SASL framework for authentication and data encryption, and use SSL encryption to transmit data

3.2.3Advanced

Bootstrap servers: Configure your own kafka broker address

SASL Mechanism: Fill in GSSAPI (here means the implementation of SASL, GSSAPI is a set of interfaces, and now only Kerberos v5 implements this interface; here actually refers to Kerberos)

3.2.4 JAAS config

If you are not using GSSAPI, you can refer to the official website ; otherwise, there are two methods, the first is to start adding configuration from the command line, and the second is to modify the configuration file;

Our JAAS can also directly add parameters to the start command of offsetexplorer.exe without configuration.

com.sun.security.auth.module.Krb5LoginModule required
useKeyTab=true
storeKey=true
client=true
serviceName="kafka"
keyTab="D:/work/winner/kerberos/kafka/kafka.service.keytab"
principal="kafka/[email protected]";

After update is configured, cd to the installation directory of offsetexplorer, and add the startup parameter krb5.conf.

offsetexplorer.exe  -J-Djava.security.krb5.conf=D:/work/winner/kerberos/kafka/krb5.conf

There is no configuration in JAAS to add JAAS.conf path in startup parameters.

offsetexplorer.exe -J-Djava.security.auth.login.config=D:/work/winner/kerberos/kafka/kafka_client_winner_jaas.conf -J-Djava.security.krb5.conf=D:/work/winner/kerberos/kafka/kafka.service.keytab -J-Djava.security.krb5.conf=D:/work/winner/kerberos/kafka/krb5.conf

3.2.5 Modify configuration file

Find the offset explorer installation directory, open the offsetexplorer.vmoptions file, and add the following information at the end (save and close, it will take effect every time you start it, if you access other KDC clusters, please modify the configuration and restart):

3.3 Basic use

3.3.1 View topic partition list and partition leader location information

3.3.2 View data

After kafka is successfully connected, you can see the Topics information of the kafka. If it is a cluster kafka, you can see the information of all nodes under the cluster.

Open a topic, click Data to view the data, there is no data at first;
Choose the consumption method, whether to consume from the beginning or from the latest;
After selecting the consumption method, click the "green triangle symbol" play button in the upper left corner to display the data, and you can set the number of queries.

The list shows: the partition (partition) to which the message belongs, offset (offset), message (message data), timestamp (data generation timestamp),

After selecting specific data, view the panel below