Big data CDH (ClouderaManager) uses Oozie for visual scheduling of tasks

 

1. Create workFlow

There are many ways to create WorkFlow, and save operation after creation.

 

Second, add a scheduled task to WorkFlow

1. Select the workflow name to add the scheduled task

2. The frequency of adding tasks is similar to the crontab of linux

3. Set the time zone

4. Set the time when the scheduled task starts and ends 

     Note: If the set time is less than the current time, the previous data will be re-executed, otherwise it will be executed when the execution time is up.

6. Save after setting

7. Submit the operation after saving, otherwise it will not take effect

1. Running status indicates that the task is in the running state

2. Said that it has been successfully executed

3. The time point of the next execution

 

Note: The above picture is the information of the workflow that has been successfully executed and the workflow that is being executed.

 

Three, hue oozie task display time problem

CDH installs hue, oozie. Create an oozie task through hue. The time when the submitted task runs and the time displayed on hue will be different from the current system time. The problem is due to oozie, the hue time zone is different from the system time zone.

1. Modify the oozie time zone:

Cloudera oozie configuration—> Oozie Server Default Group-> Advanced-> Oozie Server advanced configuration code segment (safety valve) of oozie-site.xml added

<property>

 <name>oozie.processing.timezone</name>

 <value>GMT+0800</value>

</property>

2. Modify the hue time zone

time_zone:Asia/Shanghai


3. Make sure the server time is synchronized 

Published 110 original articles · 22 praises · 70,000 views

Guess you like

Origin blog.csdn.net/yangshaojun1992/article/details/104556250