Chinaunix首页 | 论坛 | 博客
  • 博客访问: 2758992
  • 博文数量: 587
  • 博客积分: 6356
  • 博客等级: 准将
  • 技术积分: 6410
  • 用 户 组: 普通用户
  • 注册时间: 2008-10-23 10:54
个人简介

器量大者,福泽必厚

文章分类

全部博文(587)

文章存档

2019年(3)

2018年(1)

2017年(29)

2016年(39)

2015年(66)

2014年(117)

2013年(136)

2012年(58)

2011年(34)

2010年(50)

2009年(38)

2008年(16)

分类: 大数据

2015-12-28 17:20:44

执行~/hadoop-2.6.1/bin/hadoop distcp hdfs://master:8020/hbase   hdfs://master:8020/backup1 时遇到一个问题:

15/12/27 22:40:29 INFO mapreduce.Job:  map 0% reduce 0%
15/12/27 22:40:29 INFO mapreduce.Job: Job job_1451283482913_0002 failed with state FAILED due to: Application application_1451283482913_0002 failed 2 times due to AM Container for appattempt_1451283482913_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page: click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1451283482913_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
        at org.apache.hadoop.util.Shell.run(Shell.java:455)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)

Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
15/12/27 22:40:29 INFO mapreduce.Job: Counters: 0
15/12/27 22:40:29 ERROR tools.DistCp: Exception encountered 
java.io.IOException: DistCp failure: Job job_1451283482913_0002 has failed: Application application_1451283482913_0002 failed 2 times due to AM Container for appattempt_1451283482913_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page: click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1451283482913_0002_02_000001
Exit code: 1
是没有在/home/hadoop/hadoop-2.6.1/etc/hadoop/yarn-site.xml 中设置yarn.application.classpath所致,我添加如下即可:

  
  1. <property>
  2.   <name>yarn.application.classpath</name>
  3.       <value>
  4.            /home/hadoop/hadoop-2.6.1/etc/*,
  5.            /home/hadoop/hadoop-2.6.1/etc/hadoop/*,
  6.            /home/hadoop/hadoop-2.6.1/lib/*,
  7.            /home/hadoop/hadoop-2.6.1/share/hadoop/common/*,
  8.            /home/hadoop/hadoop-2.6.1/share/hadoop/common/lib/*,
  9.            /home/hadoop/hadoop-2.6.1/share/hadoop/mapreduce/*,
  10.            /home/hadoop/hadoop-2.6.1/share/hadoop/mapreduce/lib/*,
  11.            /home/hadoop/hadoop-2.6.1/share/hadoop/hdfs/*,
  12.            /home/hadoop/hadoop-2.6.1/share/hadoop/hdfs/lib/*,
  13.            /home/hadoop/hadoop-2.6.1/share/hadoop/yarn/*,
  14.            /home/hadoop/hadoop-2.6.1/share/hadoop/yarn/lib/*
  15.       </value>
  16. </property>



##留为笔记!
阅读(8927) | 评论(0) | 转发(0) |
0

上一篇:jstorm运维经验转载

下一篇:jstorm 常用命令

给主人留下些什么吧!~~