执行~/hadoop-2.6.1/bin/hadoop distcp hdfs://master:8020/hbase hdfs://master:8020/backup1 时遇到一个问题:
15/12/27 22:40:29 INFO mapreduce.Job: map 0% reduce 0%
15/12/27 22:40:29 INFO mapreduce.Job: Job job_1451283482913_0002 failed with state FAILED due to: Application application_1451283482913_0002 failed 2 times due to AM Container for appattempt_1451283482913_0002_000002 exited with exitCode: 1
For more detailed output, check application tracking page: click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1451283482913_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
at org.apache.hadoop.util.Shell.run(Shell.java:455)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
15/12/27 22:40:29 INFO mapreduce.Job: Counters: 0
15/12/27 22:40:29 ERROR tools.DistCp: Exception encountered
java.io.IOException: DistCp failure: Job job_1451283482913_0002 has failed: Application application_1451283482913_0002 failed 2 times due to AM Container for appattempt_1451283482913_0002_000002 exited with exitCode: 1
For more detailed output, check application tracking page: click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1451283482913_0002_02_000001
Exit code: 1
是没有在/home/hadoop/hadoop-2.6.1/etc/hadoop/yarn-site.xml 中设置yarn.application.classpath所致,我添加如下即可:
-
<property>
-
<name>yarn.application.classpath</name>
-
<value>
-
/home/hadoop/hadoop-2.6.1/etc/*,
-
/home/hadoop/hadoop-2.6.1/etc/hadoop/*,
-
/home/hadoop/hadoop-2.6.1/lib/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/common/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/common/lib/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/mapreduce/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/mapreduce/lib/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/hdfs/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/hdfs/lib/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/yarn/*,
-
/home/hadoop/hadoop-2.6.1/share/hadoop/yarn/lib/*
-
</value>
-
</property>
##留为笔记!
阅读(9058) | 评论(0) | 转发(0) |