hadoop在本地调试出现的错误——创建符号链接失败

2018-09-25 19:33:39,842 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1129)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2018-09-25 19:33:39,846 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2018-09-25 19:33:40,215 WARN  [main] mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2018-09-25 19:33:40,216 WARN  [main] mapreduce.JobResourceUploader (JobResourceUploader.java:uploadFiles(171)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
2018-09-25 19:33:40,269 INFO  [main] input.FileInputFormat (FileInputFormat.java:listStatus(281)) - Total input paths to process : 1
2018-09-25 19:33:40,302 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(199)) - number of splits:1
2018-09-25 19:33:40,433 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(288)) - Submitting tokens for job: job_local596285358_0001
2018-09-25 19:33:40,733 INFO  [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(201)) - Creating symlink: \tmp\hadoop-XiaoNing\mapred\local\1537875220570\product <- D:\App\eclipse-java-photon-R-hadoop\workspace\HadoopLearn/product
2018-09-25 19:33:40,753 WARN  [main] fs.FileUtil (FileUtil.java:symLink(829)) - Command 'E:\App\Source\hadoop-2.6.4\bin\winutils.exe symlink D:\App\eclipse-java-photon-R-hadoop\workspace\HadoopLearn\product \tmp\hadoop-XiaoNing\mapred\local\1537875220570\product' failed 1 with: CreateSymbolicLink error (1314): ???????????

2018-09-25 19:33:40,754 WARN  [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:symlink(203)) - Failed to create symlink: \tmp\hadoop-XiaoNing\mapred\local\1537875220570\product <- D:\App\eclipse-java-photon-R-hadoop\workspace\HadoopLearn/product
2018-09-25 19:33:40,754 INFO  [main] mapred.LocalDistributedCacheManager (LocalDistributedCacheManager.java:setup(165)) - Localized file:/E:/App/Test/join/cache/product as file:/tmp/hadoop-XiaoNing/mapred/local/1537875220570/product
2018-09-25 19:33:40,832 INFO  [main] mapreduce.Job (Job.java:submit(1301)) - The url to track the job: http://localhost:8080/
2018-09-25 19:33:40,833 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1346)) - Running job: job_local596285358_0001
2018-09-25 19:33:40,836 INFO  [Thread-6] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(471)) - OutputCommitter set in config null
2018-09-25 19:33:40,849 INFO  [Thread-6] mapred.LocalJobRunner (LocalJobRunner.java:createOutputCommitter(489)) - OutputCommitter is org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter
2018-09-25 19:33:40,902 INFO  [Thread-6] mapred.LocalJobRunner (LocalJobRunner.java:runTasks(448)) - Waiting for map tasks
2018-09-25 19:33:40,902 INFO  [LocalJobRunner Map Task Executor #0] mapred.LocalJobRunner (LocalJobRunner.java:run(224)) - Starting task: attempt_local596285358_0001_m_000000_0
2018-09-25 19:33:40,934 INFO  [LocalJobRunner Map Task Executor #0] util.ProcfsBasedProcessTree (ProcfsBasedProcessTree.java:isAvailable(181)) - ProcfsBasedProcessTree currently is supported only on Linux.
2018-09-25 19:33:40,953 INFO  [LocalJobRunner Map Task Executor #0] mapred.Task (Task.java:initialize(587)) -  Using ResourceCalculatorProcessTree : org.apache.hadoop.yarn.util.WindowsBasedProcessTree@2c3940f5
2018-09-25 19:33:40,959 INFO  [LocalJobRunner Map Task Executor #0] mapred.MapTask (MapTask.java:runNewMapper(753)) - Processing split: file:/E:/App/Test/join/input/order:0+69
2018-09-25 19:33:40,998 INFO  [Thread-6] mapred.LocalJobRunner (LocalJobRunner.java:runTasks(456)) - map task executor complete.
2018-09-25 19:33:41,001 WARN  [Thread-6] mapred.LocalJobRunner (LocalJobRunner.java:run(560)) - job_local596285358_0001
java.lang.Exception: java.io.FileNotFoundException: product (系统找不到指定的文件。)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.io.FileNotFoundException: product (系统找不到指定的文件。)
    at java.io.FileInputStream.open(Native Method)
    at java.io.FileInputStream.<init>(Unknown Source)
    at java.io.FileInputStream.<init>(Unknown Source)
    at cn.hkj.bigdata.mr.rjoin.MapSideJoin$MapSideJoinMapper.setup(MapSideJoin.java:37)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.LocalJobRunner$Job$MapTaskRunnable.run(LocalJobRunner.java:243)
    at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
    at java.util.concurrent.FutureTask.run(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
    at java.lang.Thread.run(Unknown Source)
2018-09-25 19:33:41,837 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1367)) - Job job_local596285358_0001 running in uber mode : false
2018-09-25 19:33:41,839 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1374)) -  map 0% reduce 0%
2018-09-25 19:33:41,844 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1387)) - Job job_local596285358_0001 failed with state FAILED due to: NA
2018-09-25 19:33:41,848 INFO  [main] mapreduce.Job (Job.java:monitorAndPrintJob(1392)) - Counters: 0

错误分析:权限不够,不能创建文件链接

1、

如图设置用户,测试无果。

2、直接管理员权限运行eclipse,解决。

猜你喜欢

转载自blog.csdn.net/qq_40471761/article/details/82843910
今日推荐