Chinaunix首页 | 论坛 | 博客
  • 博客访问: 1189785
  • 博文数量: 259
  • 博客积分: 10
  • 博客等级: 民兵
  • 技术积分: 2518
  • 用 户 组: 普通用户
  • 注册时间: 2012-10-13 16:12
个人简介

科技改变世界,技术改变人生。

文章分类

全部博文(259)

分类: HADOOP

2015-09-15 10:47:51

今天hadoop群集get文件的时候出现报错,如下:
$hdfs dfs -get /test/part-r-00000.gz ./

15/09/15 09:20:33 INFO hdfs.DFSClient: Access token was invalid when connecting to /192.168.2.42:50010 : org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51440, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
15/09/15 09:20:33 WARN hdfs.DFSClient: Failed to connect to /192.168.2.42:50010 for block, add to deadNodes and continue. org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
    at org.apache.hadoop.hdfs.RemoteBlockReader2.checkSuccess(RemoteBlockReader2.java:425)
    at org.apache.hadoop.hdfs.RemoteBlockReader2.newBlockReader(RemoteBlockReader2.java:397)
    at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:786)
    at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:665)
    at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:325)

获取不到Block文件,后来发现有人大量的使用put命令进行文件的上传,导致hdfs拥堵,所以下载不了文件,kill到put进程,就恢复正常了。
阅读(4097) | 评论(0) | 转发(0) |
给主人留下些什么吧!~~