今天hadoop群集get文件的时候出现报错,如下:
$hdfs dfs -get /test/part-r-00000.gz ./
15/09/15 09:20:33 INFO hdfs.DFSClient: Access token was invalid when connecting to /192.168.2.42:50010 : org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51440, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
15/09/15 09:20:33 WARN hdfs.DFSClient: Failed to connect to /192.168.2.42:50010 for block, add to deadNodes and continue. org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
org.apache.hadoop.hdfs.security.token.block.InvalidBlockTokenException: Got access token error for OP_READ_BLOCK, self=/192.168.2.12:51441, remote=/192.168.2.42:50010, for file /test/part-r-00000.gz, for pool BP-9392391-192.168.2.101-1404293177278 block 1121463064_48718312
at org.apache.hadoop.hdfs.RemoteBlockReader2.checkSuccess(RemoteBlockReader2.java:425)
at org.apache.hadoop.hdfs.RemoteBlockReader2.newBlockReader(RemoteBlockReader2.java:397)
at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:786)
at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:665)
at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:325)
获取不到Block文件,后来发现有人大量的使用put命令进行文件的上传,导致hdfs拥堵,所以下载不了文件,kill到put进程,就恢复正常了。
阅读(4212) | 评论(0) | 转发(0) |