storm parallelism introduce the core concepts of analysis

A parallel presentation .storm

  A plurality of parallel means jobs distributed on different nodes, and do not rely on each other, and each node can operate independently.

  In the Storm, Storm Jobs (task) submitted by nimbus distributed to multiple supervisor on, jobs are executed to run and executed by the supervisor.

  1.worker: on behalf of a process

    In storm profile storm.yml in supervisor.slots.port number of configurations, it can be seen as a worker on the corresponding machine configured on a slot . nimbus will distribute tasks to a different supervisor on all the submitted job is through supervisor to execute and run. A topology with a plurality of spout bolt constitute a work at the time of execution may perform a topology of the spout or Bolt , in short, work is a process level, by the supervisor responsible for the management, startup, monitoring the process, and then run after the data back to the nimbus.

  2. .executor : on behalf of a thread

    Each executor run only topology under the spout bolt in one or more instances, executor can be dynamically modified

 

Guess you like

Origin www.cnblogs.com/MrRightZhao/p/11041272.html