Re: [VOTE] Release Apache Hadoop 2.9.1 (RC0)

2018-04-30 Thread 俊平堵 
Thanks Sammi for working on this!

+1 (binding), based on::
- built from source successfully
- verified signature is correct
- deployed a pseudo cluster and run some simple MR jobs (PI, sleep, etc.)
- checked HDFS/YARN daemons' UI are normal.

Thanks,

Junping
Chen, Sammi 于2018年4月19日 周四下午4:58写道：

> Hi all,
>
> This is the first dot release of Apache Hadoop 2.9 line since 2.9.0 was
> released on November 17, 2017.
>
> It includes 208 changes. Among them, 9 blockers, 15 critical issues and
> rest are normal bug fixes and feature improvements.
>
> Thanks to the many who contributed to the 2.9.1 development.
>
> The artifacts are available here:
> https://dist.apache.org/repos/dist/dev/hadoop/2.9.1-RC0/
>
> The RC tag in git is release-2.9.1-RC0. Last git commit SHA is
> e30710aea4e6e55e69372929106cf119af06fd0e.
>
> The maven artifacts are available at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1115/
>
> My public key is available from:
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
> Please try the release and vote; the vote will run for the usual 5 days,
> ending on 4/25/2018 PST time.
>
> Also I would like thank Lei(Eddy) Xu and Chris Douglas for your help
> during the RC preparation.
>
> Bests,
> Sammi Chen
>

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-04-30 Thread Apache Jenkins Server 
For more details, see https://builds.apache.org/job/hadoop-trunk-win/453/

No changes




-1 overall


The following subsystems voted -1:
compile mvninstall unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit


Specific tests:

Failed junit tests :

   hadoop.crypto.key.kms.server.TestKMS 
   hadoop.cli.TestAclCLI 
   hadoop.cli.TestAclCLIWithPosixAclInheritance 
   hadoop.cli.TestCacheAdminCLI 
   hadoop.cli.TestCryptoAdminCLI 
   hadoop.cli.TestDeleteCLI 
   hadoop.cli.TestErasureCodingCLI 
   hadoop.cli.TestHDFSCLI 
   hadoop.cli.TestXAttrCLI 
   hadoop.fs.contract.hdfs.TestHDFSContractAppend 
   hadoop.fs.contract.hdfs.TestHDFSContractConcat 
   hadoop.fs.contract.hdfs.TestHDFSContractCreate 
   hadoop.fs.contract.hdfs.TestHDFSContractDelete 
   hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus 
   hadoop.fs.contract.hdfs.TestHDFSContractMkdir 
   hadoop.fs.contract.hdfs.TestHDFSContractOpen 
   hadoop.fs.contract.hdfs.TestHDFSContractPathHandle 
   hadoop.fs.contract.hdfs.TestHDFSContractRename 
   hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory 
   hadoop.fs.contract.hdfs.TestHDFSContractSeek 
   hadoop.fs.contract.hdfs.TestHDFSContractSetTimes 
   hadoop.fs.loadGenerator.TestLoadGenerator 
   hadoop.fs.permission.TestStickyBit 
   hadoop.fs.shell.TestHdfsTextCommand 
   hadoop.fs.TestEnhancedByteBufferAccess 
   hadoop.fs.TestFcHdfsCreateMkdir 
   hadoop.fs.TestFcHdfsPermission 
   hadoop.fs.TestFcHdfsSetUMask 
   hadoop.fs.TestGlobPaths 
   hadoop.fs.TestHDFSFileContextMainOperations 
   hadoop.fs.TestHdfsNativeCodeLoader 
   hadoop.fs.TestResolveHdfsSymlink 
   hadoop.fs.TestSWebHdfsFileContextMainOperations 
   hadoop.fs.TestSymlinkHdfsDisable 
   hadoop.fs.TestSymlinkHdfsFileContext 
   hadoop.fs.TestSymlinkHdfsFileSystem 
   hadoop.fs.TestUnbuffer 
   hadoop.fs.TestUrlStreamHandler 
   hadoop.fs.TestWebHdfsFileContextMainOperations 
   hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot 
   hadoop.fs.viewfs.TestViewFileSystemHdfs 
   hadoop.fs.viewfs.TestViewFileSystemLinkFallback 
   hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash 
   hadoop.fs.viewfs.TestViewFileSystemWithAcls 
   hadoop.fs.viewfs.TestViewFileSystemWithTruncate 
   hadoop.fs.viewfs.TestViewFileSystemWithXAttrs 
   hadoop.fs.viewfs.TestViewFsAtHdfsRoot 
   hadoop.fs.viewfs.TestViewFsDefaultValue 
   hadoop.fs.viewfs.TestViewFsFileStatusHdfs 
   hadoop.fs.viewfs.TestViewFsHdfs 
   hadoop.fs.viewfs.TestViewFsWithAcls 
   hadoop.fs.viewfs.TestViewFsWithXAttrs 
   hadoop.hdfs.client.impl.TestBlockReaderLocal 
   hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy 
   hadoop.hdfs.client.impl.TestBlockReaderRemote 
   hadoop.hdfs.client.impl.TestClientBlockVerification 
   hadoop.hdfs.crypto.TestHdfsCryptoStreams 
   hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer 
   hadoop.hdfs.qjournal.client.TestEpochsAreUnique 
   hadoop.hdfs.qjournal.client.TestQJMWithFaults 
   hadoop.hdfs.qjournal.client.TestQuorumJournalManager 
   hadoop.hdfs.qjournal.server.TestJournal 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.qjournal.server.TestJournalNodeMXBean 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.qjournal.TestMiniJournalCluster 
   hadoop.hdfs.qjournal.TestNNWithQJM 
   hadoop.hdfs.qjournal.TestSecureNNWithQJM 
   hadoop.hdfs.security.TestDelegationToken 
   hadoop.hdfs.security.TestDelegationTokenForProxyUser 
   hadoop.hdfs.security.token.block.TestBlockToken 
   hadoop.hdfs.server.balancer.TestBalancer 
   hadoop.hdfs.server.balancer.TestBalancerRPCDelay 
   hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer 
   hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes 
   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes 
   hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup 
   hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer 
   
hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy 
   hadoop.hdfs.server.blockmanagement.TestBlockManager 
   hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting 
   hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean 
   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks 
   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS 
   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped 
   hadoop.hdfs.server.blockmanagement.TestComputeInvalidateWork

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-04-30 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/767/

No changes




-1 overall


The following subsystems voted -1:
asflicense findbugs unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-hdds/common 
   Exceptional return value of java.io.File.mkdirs() ignored in 
org.apache.hadoop.utils.LevelDBStore.openDB(File, Options) At 
LevelDBStore.java:ignored in org.apache.hadoop.utils.LevelDBStore.openDB(File, 
Options) At LevelDBStore.java:[line 79] 

FindBugs :

   module:hadoop-hdds/container-service 
   
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKProto.PARSER
 isn't final but should be At StorageContainerDatanodeProtocolProtos.java:be At 
StorageContainerDatanodeProtocolProtos.java:[line 17805] 
   Class 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKProto
 defines non-transient non-serializable instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java:instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java 
   
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKProto$DeleteBlockTransactionResult.PARSER
 isn't final but should be At StorageContainerDatanodeProtocolProtos.java:be At 
StorageContainerDatanodeProtocolProtos.java:[line 17928] 
   Class 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKProto$DeleteBlockTransactionResult
 defines non-transient non-serializable instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java:instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKProto$DeleteBlockTransactionResult$Builder.maybeForceBuilderInitialization()
 At StorageContainerDatanodeProtocolProtos.java: At 
StorageContainerDatanodeProtocolProtos.java:[line 18177] 
   
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKResponseProto.PARSER
 isn't final but should be At StorageContainerDatanodeProtocolProtos.java:be At 
StorageContainerDatanodeProtocolProtos.java:[line 17421] 
   Class 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKResponseProto
 defines non-transient non-serializable instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java:instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerBlocksDeletionACKResponseProto$Builder.maybeForceBuilderInitialization()
 At StorageContainerDatanodeProtocolProtos.java: At 
StorageContainerDatanodeProtocolProtos.java:[line 17599] 
   
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerInfo.PARSER
 isn't final but should be At StorageContainerDatanodeProtocolProtos.java:be At 
StorageContainerDatanodeProtocolProtos.java:[line 3582] 
   Class 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerInfo
 defines non-transient non-serializable instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java:instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerInfo$Builder.maybeForceBuilderInitialization()
 At StorageContainerDatanodeProtocolProtos.java: At 
StorageContainerDatanodeProtocolProtos.java:[line 4195] 
   
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerPersistanceProto.PARSER
 isn't final but should be At StorageContainerDatanodeProtocolProtos.java:be At 
StorageContainerDatanodeProtocolProtos.java:[line 2027] 
   Class 
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerPersistanceProto
 defines non-transient non-serializable instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java:instance field unknownFields In 
StorageContainerDatanodeProtocolProtos.java 
   
org.apache.hadoop.hdds.protocol.proto.StorageContainerDatanodeProtocolProtos$ContainerReportsRequestProto.PARSER
 isn't final but should be At StorageContainerDatanodeProtocolProtos.java:be At 
StorageContainerDatanodeProtocolProtos.java:[line 5973] 
   Class