Connect an article, written just read the log. In peacetime work which, encounter this situation, and very common. For example: delta extracted (drawn every two hours to the last record as of the time of extraction)
This paper will be used in operations, first to become familiar with the concept of a job at
Simply put, a process ETL is a conversion, while the conversion work is more a collection job, the job can be scheduled for conversion or job
situation in each drawing is completed, will be written to the log table to record this extraction time, the extraction will next begin acquiring data extraction based on the success of this time drawn.
We can use the job to complete the scheduled task, you use scheduling control [start] and [success] both.
[Start] can control the frequency of execution, execution control what time, how long interval can be configured to perform, it is quite easy.
The following five controls need to be done, we look at each control one by one is how to use.
1) [start] control.
Below, which may be configured to control the timing and the execution time interval, whether to repeat the like. In order to extract real-time, we have to check on the repetition, the type selected time interval, in minutes, every 60 minutes once the job execution.
2) [1] Conversion - Get updated student list, we click right into the edit page conversion
Click for student input table controls, enter the following interface, fill in the appropriate sql- specific examples annex
Click [Settings] variables, the results in table inputted into variables.
3) [2] -student conversion table operation, we right click, enter the edit page transition, set the corresponding table of input and output table entry, as shown below
4) conversion [3] - write synchronization log, we right click, enter the edit page transition, contained herein is a] [sql script, sql click Save after writing
the conversion is complete.
Each one hour interval effect extraction, written to the log table. Next extract data after the log table.
欢迎关注公众号，学习kettle、数据库和开发方面的知识
获取例子源码，扫描下方二维码加关注
