[
https://issues.apache.org/jira/browse/HBASE-16265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387014#comment-15387014
]
Jerry He commented on HBASE-16265:
----------------------------------
This may be related to the commit by HBASE-13701.
But the root cause is HBASE-15291. See my comment on that JIRA.
The refactoring makes it happen more often in the tests since secure bulk load
is the default now.
I think we need to revert HBASE-15291
See:
https://builds.apache.org/job/PreCommit-HBASE-Build/2437/testReport/org.apache.hadoop.hbase.mapreduce/TestLoadIncrementalHFilesSplitRecovery/testSplitTmpFileCleanUp/
Towards the end of the output:
{noformat}
2016-06-30 07:48:23,454 ERROR
[RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=56734]
regionserver.HRegion(5508): There was a partial failure due to IO when
attempting to load family_0004 :
hdfs://localhost:52668/user/jenkins/test-data/34d5b872-06e9-4844-a90b-4635a736994d/splitTmpFileCleanUp/splitTmpFileCleanUp2/family_0004/.tmp/2f32f7a8e89f4dbcbbe38b095e06352e.top
java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:808)
at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2113)
at
org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
at
org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1317)
at
org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$SecureBulkLoadListener.isFile(SecureBulkLoadManager.java:410)
at
org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$SecureBulkLoadListener.prepareBulkLoad(SecureBulkLoadManager.java:347)
at
org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:5479)
at
org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$1.run(SecureBulkLoadManager.java:249)
at
org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$1.run(SecureBulkLoadManager.java:234)
{noformat}
> BulkLoadSuite#Wide Row Bulk Load fails in master branch
> -------------------------------------------------------
>
> Key: HBASE-16265
> URL: https://issues.apache.org/jira/browse/HBASE-16265
> Project: HBase
> Issue Type: Bug
> Reporter: Ted Yu
>
> See
> https://builds.apache.org/job/HBase-TRUNK_matrix/1265/jdk=latest1.8,label=yahoo-not-h2/testReport/org.apache.hadoop.hbase.spark/BulkLoadSuite/Wide_Row_Bulk_Load__Test_multi_family_and_multi_column_tests_with_one_column_family_with_custom_configs_plus_multi_region/
> :
> {code}
> File does not exist:
> /tmp/junit811617169708528768/junit7419829633245108670/f1/b934f7ee0d414de5ab3457d057b9df64

> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)

> at
> org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)

> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1828)

> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1799)

> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1712)

> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:587)

> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365)

> at
> org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)

> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)

> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
 at
> org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
 at
> org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
 at
> java.security.AccessController.doPrivileged(Native Method)
 at
> javax.security.auth.Subject.doAs(Subject.java:422)
 at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)

> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045)

> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
