Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/501/ [Jun 17, 2018 6:42:01 AM] (surendralilhore) HADOOP-15523. Shell command timeout given is in seconds whereas it is [Jun 17, 2018 6:54:26 PM] (cdouglas) HADOOP-13186. Multipart Uploader API. Contributed by Ewan Higgs -1 overall The following subsystems voted -1: compile mvninstall pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.key.kms.server.TestKMS hadoop.cli.TestAclCLI hadoop.cli.TestAclCLIWithPosixAclInheritance hadoop.cli.TestCacheAdminCLI hadoop.cli.TestCryptoAdminCLI hadoop.cli.TestDeleteCLI hadoop.cli.TestErasureCodingCLI hadoop.cli.TestHDFSCLI hadoop.cli.TestXAttrCLI hadoop.fs.contract.hdfs.TestHDFSContractAppend hadoop.fs.contract.hdfs.TestHDFSContractConcat hadoop.fs.contract.hdfs.TestHDFSContractCreate hadoop.fs.contract.hdfs.TestHDFSContractDelete hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus hadoop.fs.contract.hdfs.TestHDFSContractMkdir hadoop.fs.contract.hdfs.TestHDFSContractOpen hadoop.fs.contract.hdfs.TestHDFSContractPathHandle hadoop.fs.contract.hdfs.TestHDFSContractRename hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory hadoop.fs.contract.hdfs.TestHDFSContractSeek hadoop.fs.contract.hdfs.TestHDFSContractSetTimes hadoop.fs.loadGenerator.TestLoadGenerator hadoop.fs.permission.TestStickyBit hadoop.fs.shell.TestHdfsTextCommand hadoop.fs.TestEnhancedByteBufferAccess hadoop.fs.TestFcHdfsCreateMkdir hadoop.fs.TestFcHdfsPermission hadoop.fs.TestFcHdfsSetUMask hadoop.fs.TestGlobPaths hadoop.fs.TestHDFSFileContextMainOperations hadoop.fs.TestHDFSMultipartUploader hadoop.fs.TestHdfsNativeCodeLoader hadoop.fs.TestResolveHdfsSymlink hadoop.fs.TestSWebHdfsFileContextMainOperations hadoop.fs.TestSymlinkHdfsDisable hadoop.fs.TestSymlinkHdfsFileContext hadoop.fs.TestSymlinkHdfsFileSystem hadoop.fs.TestUnbuffer hadoop.fs.TestUrlStreamHandler hadoop.fs.TestWebHdfsFileContextMainOperations hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot hadoop.fs.viewfs.TestViewFileSystemHdfs hadoop.fs.viewfs.TestViewFileSystemLinkFallback hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash hadoop.fs.viewfs.TestViewFileSystemWithAcls hadoop.fs.viewfs.TestViewFileSystemWithTruncate hadoop.fs.viewfs.TestViewFileSystemWithXAttrs hadoop.fs.viewfs.TestViewFsAtHdfsRoot hadoop.fs.viewfs.TestViewFsDefaultValue hadoop.fs.viewfs.TestViewFsFileStatusHdfs hadoop.fs.viewfs.TestViewFsHdfs hadoop.fs.viewfs.TestViewFsWithAcls hadoop.fs.viewfs.TestViewFsWithXAttrs hadoop.hdfs.client.impl.TestBlockReaderLocal hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.client.impl.TestBlockReaderRemote hadoop.hdfs.client.impl.TestClientBlockVerification hadoop.hdfs.crypto.TestHdfsCryptoStreams hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer hadoop.hdfs.qjournal.client.TestEpochsAreUnique hadoop.hdfs.qjournal.client.TestQJMWithFaults hadoop.hdfs.qjournal.client.TestQuorumJournalManager hadoop.hdfs.qjournal.server.TestJournal hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeMXBean hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.qjournal.TestMiniJournalCluster hadoop.hdfs.qjournal.TestNNWithQJM hadoop.hdfs.qjournal.TestSecureNNWithQJM hadoop.hdfs.security.TestDelegationToken hadoop.hdfs.security.TestDelegationTokenForProxyUser hadoop.hdfs.security.token.block.TestBlockToken hadoop.hdfs.server.balancer.TestBalancer hadoop.hdfs.server.balancer.TestBalancerRPCDelay hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer hadoop.hdfs.server.balancer.TestBalancerWithHANameNodes hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes hadoop.hdfs.server.balancer.TestBalancerWithNodeGroup hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer hadoop.hdfs.server.blockmanagement.TestAvailableSpaceBlockPlacementPolicy hadoop.hdfs.server.blockmanagement.TestBlockManager hadoop.hdfs.server.blockmanagement.TestBlockReportRateLimiting hadoop.hdfs.server.blockmanagement.TestBlockStatsMXBean
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/ [Jun 17, 2018 6:42:01 AM] (surendralilhore) HADOOP-15523. Shell command timeout given is in seconds whereas it is -1 overall The following subsystems voted -1: asflicense findbugs pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.reloadListener; locked 75% of time Unsynchronized access at AllocationFileLoaderService.java:75% of time Unsynchronized access at AllocationFileLoaderService.java:[line 117] Failed junit tests : hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.namenode.TestDecommissioningStatus hadoop.hdfs.TestMaintenanceState hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.mapred.TestMRTimelineEventHandling Failed TAP tests : hadoop_stop_daemon.bats.tap cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/diff-compile-javac-root.txt [348K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/diff-checkstyle-root.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/xml.txt [4.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-warnings.html [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-hdds_client.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [48K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [60K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-ozone_client.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-ozone_common.txt [24K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-ozone_objectstore-service.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-ozone_ozone-manager.txt [4.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/814/artifact/out/branch-findbugs-hadoop-ozone_tools.txt [4.0K]
Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/500/ [Jun 15, 2018 8:07:54 PM] (inigoiri) HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:36:46 PM] (weichiu) HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by [Jun 15, 2018 9:10:17 PM] (aengineer) HDDS-172. The numbers of operation should be integer in KSM UI. [Jun 15, 2018 10:06:26 PM] (mackrorysd) HADOOP-15504. Upgrade Maven Core and Maven Wagon dependencies. [Jun 15, 2018 10:59:19 PM] (inigoiri) HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by [Jun 15, 2018 11:49:06 PM] (inigoiri) HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test -1 overall The following subsystems voted -1: compile mvninstall pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFileUtil hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.fs.TestLocalFileSystem hadoop.http.TestHttpServer hadoop.http.TestHttpServerLogs hadoop.io.compress.TestCodec hadoop.io.nativeio.TestNativeIO hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.security.TestSecurityUtil hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestDiskCheckerWithDiskIo hadoop.util.TestNativeCodeLoader hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.balancer.TestBalancer hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestBlockScanner hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestStorageReport hadoop.hdfs.server.diskbalancer.TestDiskBalancer hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.TestNamenodeCapacityReport hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs hadoop.hdfs.TestDFSShell hadoop.hdfs.TestDFSStripedInputStream hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy hadoop.hdfs.TestDFSStripedOutputStream hadoop.hdfs.TestDFSStripedOutputStreamWithFailure hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.TestDFSUpgradeFromImage hadoop.hdfs.TestFetchImage hadoop.hdfs.TestFileConcurrentReader hadoop.hdfs.TestHDFSFileSystemContract hadoop.hdfs.TestMaintenanceState hadoop.hdfs.TestPread hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy hadoop.hdfs.TestSecureEncryptionZoneWithKMS hadoop.hdfs.TestTrashWithSecureEncryptionZones hadoop.hdfs.tools.TestDFSAdmin hadoop.hdfs.web.TestWebHDFS hadoop.hdfs.web.TestWebHdfsUrl hadoop.fs.http.server.TestHttpFSServerWebServer hadoop.yarn.server.nodemanager.containermanager.container.TestContainer hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch hadoop.yarn.server.nodemanager.containermanager.TestAuxServices hadoop.yarn.server.nodemanager.containermanager.TestContainerManager hadoop.yarn.server.nodemanager.TestContainerExecutor hadoop.yarn.server.nodemanager.TestNodeManagerResync hadoop.yarn.server.webproxy.amfilter.TestAmFilter hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilterForV1 hadoop.yarn.server.resourcemanager.applicationsmanager.TestAMRestart hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestFSSchedulerConfigurationStore hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestLeveldbConfigurationStore hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler hadoop.yarn.server.resourcemanager.scheduler.constraint.TestPlacementProcessor hadoop.yarn.server.resourcemanager.scheduler.fair.TestAllocationFileLoaderService
Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/28/ [Jun 11, 2018 5:53:37 AM] (sammi.chen) HADOOP-15499. Performance severe drops when running [Jun 11, 2018 6:12:44 PM] (haibochen) YARN-8323. FairScheduler.allocConf should be declared as volatile. [Jun 11, 2018 6:16:21 PM] (haibochen) YARN-8322. Change log level when there is an IOException when the [Jun 11, 2018 6:19:33 PM] (haibochen) YARN-8321. AllocationFileLoaderService.getAllocationFile() should be [Jun 11, 2018 6:20:29 PM] (inigoiri) HDFS-13653. Make dfs.client.failover.random.order a per nameservice [Jun 11, 2018 10:13:18 PM] (yzhang) Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release. (cherry [Jun 11, 2018 11:02:32 PM] (xyao) HDDS-72. Add deleteTransactionId field in ContainerInfo. Contributed by [Jun 12, 2018 2:25:56 AM] (inigoiri) YARN-8370. Some Node Manager tests fail on Windows due to improper [Jun 12, 2018 11:43:09 AM] (rohithsharmaks) YARN-8405. RM zk-state-store.parent-path ACLs has been changed since [Jun 12, 2018 11:44:22 AM] (rohithsharmaks) YARN-8413. Flow activity page is failing with 'Timeline server failed [Jun 12, 2018 12:10:41 PM] (sunilg) YARN-8419. [UI2] User cannot submit a new service as submit button is [Jun 12, 2018 3:06:23 PM] (msingh) HDDS-158. DatanodeStateMachine endPoint task throws [Jun 12, 2018 3:25:18 PM] (aengineer) HDDS-111. Include tests for Rest Client in TestVolume and TestBucket. [Jun 12, 2018 3:35:37 PM] (aajisaka) YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. [Jun 12, 2018 4:03:55 PM] (xyao) HDDS-130. TestGenerateOzoneRequiredConfigurations should use [Jun 12, 2018 5:03:34 PM] (haibochen) YARN-6931. Make the aggregation interval in AppLevelTimelineCollector [Jun 12, 2018 5:11:30 PM] (haibochen) YARN-8325. Miscellaneous QueueManager code clean up. (Szilard Nemeth via [Jun 12, 2018 5:24:34 PM] (inigoiri) HADOOP-15529. ContainerLaunch#testInvalidEnvVariableSubstitutionType is [Jun 12, 2018 5:59:50 PM] (inigoiri) YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni [Jun 12, 2018 6:16:24 PM] (xiao) HADOOP-15307. NFS: flavor AUTH_SYS should use VerifierNone. Contributed [Jun 12, 2018 6:21:51 PM] (gera) MAPREDUCE-7108. TestFileOutputCommitter fails on Windows. (Zuoming Zhang [Jun 12, 2018 9:16:14 PM] (inigoiri) HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. [Jun 12, 2018 10:36:52 PM] (arun suresh) MAPREDUCE-7101. Add config parameter to allow JHS to alway scan user dir [Jun 13, 2018 12:40:32 AM] (eyang) HADOOP-15527. Improve delay check for stopping processes. [Jun 13, 2018 1:28:05 AM] (wwei) YARN-8394. Improve data locality documentation for Capacity Scheduler. [Jun 13, 2018 7:36:02 AM] (jitendra) HADOOP-15483. Upgrade jquery to version 3.3.1. Contributed by Lokesh [Jun 13, 2018 10:39:16 AM] (sunilg) YARN-8404. Timeline event publish need to be async to avoid Dispatcher [Jun 13, 2018 12:05:55 PM] (yqlin) HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun. [Jun 13, 2018 4:50:10 PM] (aengineer) HDDS-109. Add reconnect logic for XceiverClientGrpc. Contributed by [Jun 13, 2018 6:43:18 PM] (xyao) HDDS-159. RestClient: Implement list operations for volume, bucket and [Jun 13, 2018 11:05:52 PM] (eyang) YARN-8411. Restart stopped system service during RM start. [Jun 13, 2018 11:24:31 PM] (eyang) YARN-8259. Improve privileged docker container liveliness checks. [Jun 14, 2018 1:48:59 AM] (aengineer) HDDS-161. Add functionality to queue ContainerClose command from SCM [Jun 14, 2018 3:18:22 AM] (aengineer) HDDS-163. Add Datanode heartbeat dispatcher in SCM. Contributed by [Jun 14, 2018 7:08:10 AM] (rohithsharmaks) YARN-8155. Improve ATSv2 client logging in RM and NM publisher. [Jun 14, 2018 4:58:50 PM] (inigoiri) HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by [Jun 14, 2018 7:54:21 PM] (eyang) YARN-8410. Fixed a bug in A record lookup by CNAME record. [Jun 14, 2018 8:14:25 PM] (Bharat) YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil [Jun 14, 2018 8:43:14 PM] (inigoiri) HDFS-13675. Speed up TestDFSAdminWithHA. Contributed by Lukas Majercak. [Jun 14, 2018 9:14:24 PM] (aengineer) HDDS-146. Refactor the structure of the acceptance tests. Contributed by [Jun 15, 2018 9:28:20 AM] (msingh) HDFS-13679. Fix Typo in javadoc for ScanInfoPerBlockPool#addAll. [Jun 15, 2018 4:40:45 PM] (inigoiri) HADOOP-15537. Clean up ContainerLaunch and ContainerExecutor [Jun 15, 2018 5:33:28 PM] (inigoiri) HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:07:54 PM] (inigoiri) HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:36:46 PM] (weichiu) HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by [Jun 15, 2018 9:10:17 PM] (aengineer) HDDS-172. The numbers of operation should be integer in KSM UI. [Jun 15,
