A, Kafka Profile

　　Kafka is a high throughput distributed publish-subscribe messaging system , users can publish large amounts of information systems by Kafka, but also can subscribe to real-time consumption information. Kafka can meet online in real time and off-line batch processing simultaneously.

　　In a large company data ecosystems, as may the data exchange hub Kafka, different types of distributed systems (relational database, the NoSQL database, stream processing system, a batch system, etc.), can be unified access to Kafka, implementation and Hadoop efficient real-time exchange of data between the various different types of components.

Broker: Kafka cluster comprising one or more servers, which is called the server broker.
Topic: Each post messages to Kafka cluster has a category, the category is called Topic. (Topic different physically separate storage of messages, the message is logically a Topic although stored on one or more Broker, but the user need only specify message Topic to production or consumption data without concern for where the data are stored in).
The Partition: the Partition is a physical concept, each comprising one or more Topic Partition.
Producer: be responsible for dissemination of information to Kafka broker.
Consumer: news consumers, read a message to Kafka broker clients.
Consumer Group: each belonging to a specific Consumer Consumer Group (Consumer may be specified for each group name, if the group name specified in the Default Group)