azkaban batch heavy task failed to run

Disclaimer: This article is a blogger original article, the source is http://blog.csdn.net/silentwolfyh https://blog.csdn.net/silentwolfyh/article/details/89517467

Other interfaces can refer to the official documentation https://azkaban.readthedocs.io/en/latest/ajaxApi.html

A, mydb query failed data (found projectname and flowid)

select b.name ,a.flow_id from execution_jobs a
INNER JOIN projects b ON a.project_id = b.id
WHERE a.status = 70
and a.attempt=0
and a.start_time > 1551369601000 ORDER by b.name asc

status = 70 represents a failure status
attempt = 0 indicates the number of retries
start_time check period. 1551369601000 ms time stamp can convert https://tool.lu/timestamp/

Here Insert Picture Description

Second, splicing the curl command

2.1) to find the sessionid, sessionid the id is the user login azkaban real-time sessionid.

2.2) stitching in Excel (Note: When the drop-down date or port increments, all only copy)

curl -k --data "session.id=76ba04cb-c54a-4b43-b40c-590d1385c044&ajax=executeFlow&flowOverride[dt]=2019-03-01&project=azkabanProject&flow=azkabanFlows"  http://localhost:8088/executor?ajax=executeFlow

Here Insert Picture Descriptionproject job name, sql check out the name field
flow process name, sql check out flow_id field

Here Insert Picture Description

Third, the login azkaban server, all spliced ​​directly execute the command.

And performing the next return incorrect results shown:

[yuhui@hadoop11 ~]$ curl -k --data "session.id=76ba04cb-c54a-4b43-b40c-590d1385c044&ajax=executeFlow&flowOverride[dt]=2019-03-01&project=azkabanProject&flow=azkabanFlows"  http://localhost:8088/executor?ajax=executeFlow
{
  "project" : "azkabanProject",
  "message" : "Execution submitted successfully with exec id 53890",
  "flow" : "azkabanFlows",
  "execid" : 53890
}[yuhui@hadoop11 ~]

After going to see the project running azkaban

Guess you like

Origin blog.csdn.net/silentwolfyh/article/details/89517467