Related reset command offset kafka

kafka official document
https://kafka.apache.org/documentation.html#quickstart
kafka installation documentation
https://www.jianshu.com/p/c74e0ec577b0

Related command:

kafka start: kafka official document
https://kafka.apache.org/documentation.html#quickstart
kafka installation documentation
https://www.jianshu.com/p/c74e0ec577b0

Theme Related command:

kafka start:

kafka-server-start.sh  ./config/server.properties 1>/dev/null 2>&1 &

kafka stop:
```
kill pid
```

The number of partitions to create depend on the available topic replication

kafka-topics.sh  --create --zookeeper 10.202.13.196:2181 --replication-factor 1 --partitions 1 --topic cjw-test

Delete topic

kafka-topics.sh  --delete --zookeeper 10.202.13.196:2181 --topic cjw-test

Obtaining relevant parameters to create a partition
```
kafka-topics.sh  --help
```

Lists partition information

kafka-topics.sh --list --zookeeper 10.202.13.196:2181

List node details

kafka-topics.sh --describe cjw-test --zookeeper 10.202.13.196:2181
##或者
kafka-topics.sh --describe  --bootstrap-server 10.202.13.28:9092 --topic  cjw-test

Write data

kafka-console-producer.sh  --broker-list 10.202.13.27:9092 --topic cjw-test

Push the test data

kafka-producer-perf-test.sh  --topic  cjw-test --num-records  50000 --throughput -1 --record-size 100 --producer-props bootstrap.servers=10.202.13.27:9092 acks=-1

Consumption data

kafka-console-consumer.sh  --bootstrap-server 10.202.13.27:9092 --topic cjw-test --from-beginning
##设置消费组
kafka-console-consumer.sh  --bootstrap-server 10.202.13.27:9092 --topic cjw-test --from-beginning  --consumer-property  group.id=cjw

Check the consumer's progress

## group需要 启动时设置相关的 consumer-properties group.id
kafka-consumer-groups.sh --bootstrap-server localhost:9092 --group cjw --describe

Reset consumption schedule

## 详情通过help 命令查看
## all topic  重置到最早消费进度
kafka-consumer-groups.sh  --bootstrap-server 10.202.13.27:9092 --group cjw --reset-offsets --all-topics --to-earliest --execute
##指定主题
kafka-consumer-groups.sh  --bootstrap-server 10.202.13.27:9092 --group cjw --reset-offsets --topic cjw-test --to-earliest --execute
##指定偏移量
kafka-consumer-groups.sh  --bootstrap-server 10.202.13.27:9092 --group cjw --reset-offsets --topic cjw-test --to-offset 2 --execute
##指定主题、分区、消费偏移
kafka-consumer-groups.sh  --bootstrap-server 10.202.13.27:9092 --group cjw --reset-offsets --topic cjw-test:1 --to-offset 2 --execute

zookeeper related

View kafka Subdivision:
```
ls /brokers/topics/cjw-test/partitions
```
View Consumer group information
```
ls /consumers
```

kafka import and export data

Creating Connectors

## 第一个配置为基本配置 kafka 代理、数据的序列化格式
## 第二个配置源文件  和相关topic名称 
## 第三个配置文件 为目标文件相关sink
connect-standalone.sh /usr/local/kafka_2.12-2.3.0/config/connect-standalone.properties  /usr/local/kafka_2.12-2.3.0/config/connect-file-source.properties /usr/local/kafka_2.12-2.3.0/config/connect-file-sink.properties  1>/dev/null 2>&1 &

Consumer-related data

##  connect-test  可以设置为自己的topic
bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic connect-test --from-beginning

Related reset command offset kafka

Guess you like