kettle tutorial --- table by configuring the configuration for data batch incremental update (Utility)

This article connected articles, the above article is talking about, updated by the full amount of the configuration file, the next incremental update now say

 

 

As shown above, it relates to a converter and a job.

1 to Table delta synchronization (conversion)

 

This parameter can be synchronized table excel spreadsheet file, get the table name and dependent objects synchronized (this article is cjsj creation time) by reading, copying records after successful synchronization to results

2- incremental data synchronization (job)

 

 

 

 

 

 

 

 We right point to open as shown above, contains seven conversion components.

1) data synchronization table (conversion)

 

 

Obtaining a recording conversion into variable settings.

2) data synchronization is provided in Table 2 (conversion)

 

 

 

Acquisition time variable into setting variables

3) to obtain the query criteria (conversion)

 

 

 

 3.1) opening the acquired query, write the query, set into a variable

 

 

 

4) delete the original target data (conversion)

Delete the original target library data, as shown below, delete duplicate data

 

 

 

 

5) to be inserted into the data synchronization (conversion), after opening the conversion, below, shows the data acquisition time after cjsj created log table, insert new table

 

 

 

 

 

6) save synchronization logs (conversion)

 

 Written to the log table.

This completes incremental update table data to configure the data table through a configuration file, a professional can complete update of all tables full and incremental amount.

 

By adding the table name table excel, to achieve a scheduled task, the completion of all the tables in the synchronization
welcome attention to public numbers, learn kettle, database and development aspects of the
acquisition of source code examples, plus interest Fanger Wei code scanning at

Guess you like

Origin www.cnblogs.com/dalaba/p/12050464.html