Introduction to Apache Kafka

 Kafka is a high-throughput distributed publish-subscribe messaging system that can process all action flow data in consumer-scale websites

kafka noun explanation

Broker: A Kafka cluster contains one or more servers, which are called brokers.

Topic: Each message published to a Kafka cluster has a category, which is called a topic. (Physically, messages of different topics are stored separately. Logically, although messages of a topic are stored on one or more brokers, users only need to specify the topic of the message to produce or consume data without worrying about where the data is stored).

Partition: Partition is a physical concept, and each Topic contains one or more Partitions.

Producer: Responsible for publishing messages to the Kafka broker.

Consumer: message consumer, a client that reads messages from the Kafka broker.

Consumer Group: Each Consumer belongs to a specific Consumer Group (group name can be specified for each Consumer, if no group name is specified, it belongs to the default group).

Each message (also called a record, also called a message) consists of a key, a value and a timestamp.

Fundamentals and Architecture

There are two types of message models: queue and publish-subscribe. Queues are handled in a way that a group of consumers reads messages from the server, and a message is processed by only one of the consumers. In the publish-subscribe model, the message is broadcast to all consumers, and the consumers who receive the message can process the message.

 

Guess you like

Origin http://10.200.1.11:23101/article/api/json?id=326846731&siteId=291194637