Author: High Yun (Yun Qian)
1. Overview
This paper describes the core mechanism of job execution Flink Runtime. First introduced Flink Runtime overall architecture and basic execution flow Job, and then introduced in the process, Flink is how resource management, job scheduling and error recovery. Finally, the article also briefly describes some of the work currently in progress Flink Runtime layer.
2. Flink Runtime overall architecture
Flink overall architecture shown in Figure 1. Flink is runs on a variety of different environments, for example, it can be run directly by way of a single multi-threaded process, providing the ability to debug. It can also run on Yarn or K8S such resources management system above, can also be performed in a variety of cloud environments.
Figure 1. Flink's overall architecture, which provides a unified Runtime layer distributed execution engine for different execution environments.
For different execution environments, Fl