Storm Trident example

Storm Trident example

http://blog.csdn.net/opensure/article/details/45847545

Storm Trident's core data model is a batch of "streams" that are processed in batches, and the "streams" are partitioned in the cluster on the nodes of the cluster , the operations on the "stream" are also performed on each partition in parallel.
Trident has five operations on "streams":
1. Local batch operations that do not require network transmission
2. "Redistribution" operations that require network transmission, without changing the content of the data
3. Aggregation operations, where network transmission is the operation Part
4. "Stream" grouping (grouby) operations
5. Merge and association operations
Batch local operations:
batch local operations do not require network transmission, and the operations of this partition (partion) are independent of each other

Guess you like

Origin http://10.200.1.11:23101/article/api/json?id=326926574&siteId=291194637