It pushed AWS hosted Apache Kafka streaming service

In the AWS re: Invent 2018 conference hosted first release of Apache Kafka streaming services (Amazon Managed Streaming for Apache Kafka, MSK) messages, is now officially launched service from the preview stage. Apache Kafka is a distributed streaming platform, which is using a publish and subscribe architecture, role separation will result in the application and use of streaming data streaming data. Apache Kafka allows users to capture events such as streaming, transaction, networking events, or applications such as streaming and log data, but also analyze real-time, uninterrupted conversion data, and then received data after treatment, dispersed in the lake, and other data in the database.

AWS mentioned, users in a production environment to configure Apache Kafka, need to overcome some obstacles, particularly in the management and follow-up of the expansion work, and now the official launch of MSK AWS services, by AWS responsible for administrative tasks, allowing users to simply use configuration, and because recent version of Kafka, and require the use of a common node coordinator Zookeeper, therefore MSK services are simply setting can make Kafka and ZooKeeper operations together. MSK use the service, users can create in minutes cluster, and use the AWS IAM identity management and access control management cluster operations, but also authority authorized clients through ACM (AWS Certificate Manager) fully managed private TLS certificate to TLS other data encryption key to encrypt data, using the KMS (AWS key Management Service) in. When a server fails, MSK will replace the failed machine, automatically performs repair work, the user can from Amazon CloudWatch, the monitoring indicators of state services.
AWS represents, MSK and Kafka 1.1.1 and 2.1.0 versions are fully compatible, so users can perform the original Kafka applications and tools directly in AWS, without any need to modify the program code, the user can use open source tools MirrorMaker, data Kafka move from the existing cluster directly to MSK. Pricing the MSK is arranged to store pricing and Kafka Broker per hour, and the MSK data transmission rates AWS original transmission of the same data, the cluster node Zookeeper used, as well as the region Broker cluster nodes and transfer data to a Zookeeper no extra charge. Now users can already use the MSK AWS service in most of the region, including North America, Asia and Europe.