Initial job has not accepted any resources spark error solution

Initial job has not accepted any resources spark error solution

Original  2016-03-04 16:57:35

• Label:
• spark /
• multiple programs  /
• synchronous commit

• 1936

When running multiple spark applications, the error "initial job has not accepted any resources" often occurs.

And if you submit by spark-submit, the result is often not displayed. What I see on the monitoring page is that the status has been waiting. As shown below.

After careful inspection, it was found that it was a problem with CORES. Since the previous program occupied all CORES, and the subsequent tasks did not have enough CPU to support, it could only be WAITING.

Therefore, it is only necessary to configure the number of cores before RUN.