date:20180519

Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86

2018-05-19 Thread Apache Jenkins Server

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java9-linux-x86/24/

[May 14, 2018 6:24:01 AM] (littlezhou) Add 2.9.1 release notes and changes 
documents
[May 14, 2018 6:38:40 AM] (sammichen) Revert "Add 2.9.1 release notes and 
changes documents"
[May 14, 2018 7:14:02 AM] (sammi.chen) Add 2.9.1 release notes and changes 
documents
[May 14, 2018 3:29:31 PM] (sunilg) YARN-8271. [UI2] Improve labeling of certain 
tables. Contributed by
[May 14, 2018 4:05:23 PM] (naganarasimha_gr) YARN-8288. Fix wrong number of 
table columns in Resource Model doc.
[May 14, 2018 4:10:03 PM] (xyao) HDDS-29. Fix 
TestStorageContainerManager#testRpcPermission. Contributed
[May 14, 2018 4:28:39 PM] (xiao) HDFS-13539. DFSStripedInputStream NPE when 
reportCheckSumFailure.
[May 14, 2018 4:55:03 PM] (msingh) HDDS-19. Update ozone to latest ratis 
snapshot build
[May 14, 2018 5:12:08 PM] (hanishakoneru) HDFS-13544. Improve logging for 
JournalNode in federated cluster.
[May 14, 2018 6:08:42 PM] (haibochen) YARN-8130 Race condition when container 
events are published for KILLED
[May 15, 2018 6:31:28 AM] (sunilg) YARN-8266. [UI2] Clicking on application 
from cluster view should
[May 15, 2018 6:43:04 AM] (sunilg) YARN-8166. [UI2] Service page header links 
are broken. Contributed by
[May 15, 2018 6:47:35 AM] (sunilg) YARN-8236. Invalid kerberos principal file 
name cause NPE in native
[May 15, 2018 9:28:19 AM] (wwei) YARN-8278. DistributedScheduling is not 
working in HA. Contributed by
[May 15, 2018 3:13:56 PM] (stevel) HADOOP-15442. 
ITestS3AMetrics.testMetricsRegister can't know metrics
[May 15, 2018 3:19:03 PM] (stevel) HADOOP-15466. Correct units in 
adl.http.timeout. Contributed by Sean
[May 15, 2018 5:21:42 PM] (inigoiri) HDFS-13551. 
TestMiniDFSCluster#testClusterSetStorageCapacity does not
[May 15, 2018 5:27:36 PM] (inigoiri) HDFS-11700. 
TestHDFSServerPorts#testBackupNodePorts doesn't pass on
[May 15, 2018 6:20:32 PM] (inigoiri) HDFS-13548. 
TestResolveHdfsSymlink#testFcResolveAfs fails on Windows.
[May 15, 2018 10:34:54 PM] (inigoiri) HDFS-13567.
[May 16, 2018 12:40:39 AM] (eyang) YARN-8081.  Add support to upgrade a 
component. Contributed
[May 16, 2018 8:25:31 AM] (aajisaka) YARN-8123. Skip compiling old hamlet 
package when the Java version is 10
[May 16, 2018 2:23:49 PM] (jlowe) YARN-8284. get_docker_command refactoring. 
Contributed by Eric Badger
[May 16, 2018 4:31:46 PM] (inigoiri) HDFS-13557. TestDFSAdmin#testListOpenFiles 
fails on Windows. Contributed
[May 16, 2018 4:38:26 PM] (eyang) YARN-8300.  Fixed NPE in 
DefaultUpgradeComponentsFinder.
[May 16, 2018 5:08:49 PM] (inigoiri) 
HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows.
[May 16, 2018 6:28:39 PM] (arp) HDFS-13512. WebHdfs getFileStatus doesn't 
return ecPolicy. Contributed
[May 16, 2018 8:00:01 PM] (haibochen) YARN-7933. [atsv2 read acls] Add 
TimelineWriter#writeDomain. (Rohith
[May 16, 2018 9:17:28 PM] (jlowe) YARN-8071. Add ability to specify nodemanager 
environment variables
[May 17, 2018 2:23:02 AM] (inigoiri) HDFS-13559. TestBlockScanner does not 
close TestContext properly.
[May 17, 2018 10:54:51 AM] (rohithsharmaks) YARN-8297. Incorrect ATS Url used 
for Wire encrypted cluster.
[May 17, 2018 2:23:24 PM] (kihwal) HDFS-13581. DN UI logs link is broken when 
https is enabled. Contributed
[May 17, 2018 3:31:44 PM] (xyao) HDDS-77. Key replication factor and type 
should be stored per key by
[May 17, 2018 3:52:00 PM] (xyao) HDDS-3. Send NodeReport and ContainerReport 
when datanodes register.
[May 17, 2018 4:21:57 PM] (inigoiri) HDFS-13570. 
TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on
[May 17, 2018 6:08:55 PM] (stevel) HADOOP-15469. S3A directory committer commit 
job fails if _temporary
[May 17, 2018 6:16:04 PM] (szegedim) MAPREDUCE-7094. 
LocalDistributedCacheManager leaves classloaders open,
[May 17, 2018 7:47:10 PM] (vinodkv) YARN-8128. Documenting the per-node per-app 
file limit in YARN log
[May 17, 2018 8:35:09 PM] (inigoiri) HDFS-13558. TestDatanodeHttpXFrame does 
not shut down cluster.
[May 17, 2018 9:06:58 PM] (eyang) YARN-8293.  Removed "User Name for service" 
for deploying secure YARN
[May 17, 2018 9:16:50 PM] (eyang) YARN-8080.  Add restart policy for YARN 
services.
[May 17, 2018 9:29:34 PM] (eyang) YARN-8141.  Removed 
YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS
[May 17, 2018 9:48:04 PM] (inigoiri) HDFS-13554. 
TestDatanodeRegistration#testForcedRegistration does not
[May 17, 2018 10:21:26 PM] (aengineer) HDDS-73. Add acceptance tests for Ozone 
Shell. Contributed by Lokesh
[May 17, 2018 11:13:28 PM] (aengineer) HDDS-38. Add SCMNodeStorage map in SCM 
class to store storage statistics
[May 17, 2018 11:53:23 PM] (inigoiri) HDFS-13556. TestNestedEncryptionZones 
does not shut down cluster.
[May 18, 2018 12:03:23 AM] (inigoiri) HDFS-13560. Insufficient system resources 
exist to complete the
[May 18, 2018 12:56:04 AM] (eyang) YARN-8141.

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-05-19 Thread Apache Jenkins Server

For more details, see https://builds.apache.org/job/hadoop-trunk-win/472/

[May 18, 2018 11:44:11 PM] (aw) YETUS-630. Add HDDS subproject to the Hadoop 
personality
[May 18, 2018 11:51:07 PM] (aw) YETUS-620. reject patches if they contain files 
with names/paths over a
[May 18, 2018 4:36:58 PM] (inigoiri) HDFS-13592.
[May 18, 2018 4:46:02 PM] (inigoiri) HDFS-13593.
[May 18, 2018 6:29:20 PM] (xiao) HADOOP-15154. Abstract new method 
assertCapability for
[May 18, 2018 9:29:10 PM] (eyang) YARN-7530.  Refactored YARN service API 
project location.




-1 overall


The following subsystems voted -1:
compile mvninstall pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h 00m 00s)
unit


Specific tests:

Failed junit tests :

   hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec 
   hadoop.fs.contract.rawlocal.TestRawlocalContractAppend 
   hadoop.fs.TestFsShellCopy 
   hadoop.fs.TestFsShellList 
   hadoop.fs.TestLocalFileSystem 
   hadoop.fs.TestRawLocalFileSystemContract 
   hadoop.fs.TestTrash 
   hadoop.http.TestHttpServer 
   hadoop.http.TestHttpServerLogs 
   hadoop.io.nativeio.TestNativeIO 
   hadoop.ipc.TestSocketFactory 
   hadoop.metrics2.impl.TestStatsDMetrics 
   hadoop.security.TestSecurityUtil 
   hadoop.security.TestShellBasedUnixGroupsMapping 
   hadoop.security.token.TestDtUtilShell 
   hadoop.util.TestNativeCodeLoader 
   hadoop.hdfs.qjournal.client.TestQuorumJournalManager 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.qjournal.server.TestJournalNodeSync 
   hadoop.hdfs.server.blockmanagement.TestBlocksWithNotEnoughRacks 
   hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestFsDatasetImpl 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistFiles 
   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaPlacement 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl 
   hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage 
   hadoop.hdfs.server.datanode.TestBlockScanner 
   hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics 
   hadoop.hdfs.server.datanode.TestDataNodeFaultInjector 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDirectoryScanner 
   hadoop.hdfs.server.diskbalancer.command.TestDiskBalancerCommand 
   hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC 
   hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA 
   hadoop.hdfs.server.namenode.ha.TestHAAppend 
   hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA 
   hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics 
   hadoop.hdfs.server.namenode.TestAuditLoggerWithCommands 
   hadoop.hdfs.server.namenode.TestEditLogRace 
   hadoop.hdfs.server.namenode.TestReencryptionHandler 
   hadoop.hdfs.server.namenode.TestStartup 
   hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs 
   hadoop.hdfs.TestDecommissionWithStriped 
   hadoop.hdfs.TestDFSShell 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy 
   hadoop.hdfs.TestDFSUpgradeFromImage 
   hadoop.hdfs.TestErasureCodingExerciseAPIs 
   hadoop.hdfs.TestFetchImage 
   hadoop.hdfs.TestHDFSFileSystemContract 
   hadoop.hdfs.TestHDFSTrash 
   hadoop.hdfs.TestLeaseRecovery 
   hadoop.hdfs.TestLocalDFS 
   hadoop.hdfs.TestPread 
   hadoop.hdfs.TestReconstructStripedFile 
   hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy 
   hadoop.hdfs.TestSafeModeWithStripedFile 
   hadoop.hdfs.TestSecureEncryptionZoneWithKMS 
   hadoop.hdfs.TestTrashWithSecureEncryptionZones 
   hadoop.hdfs.tools.TestDFSAdmin 
   hadoop.hdfs.tools.TestDFSAdminWithHA 
   hadoop.hdfs.tools.TestGetConf 
   hadoop.hdfs.web.TestWebHDFS 
   hadoop.hdfs.web.TestWebHdfsUrl 
   hadoop.fs.http.server.TestHttpFSServerWebServer 
   hadoop.yarn.logaggregation.TestAggregatedLogFormat 
   hadoop.registry.server.dns.TestRegistryDNS 
   hadoop.registry.server.dns.TestSecureRegistryDNS 
   
hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch 
   
hadoop.yarn.server.nodemanager.containermanager.linux.privileged.TestPrivilegedOperationExecutor
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestCGroupsHandlerImpl
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestDockerContainerRuntime
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.runtime.TestJavaSandboxLinuxContainerRuntime
 
   hadoop.yarn.server.nodemanager.containermanager.TestAuxServices

[jira] [Created] (HDFS-13597) HDFS memory issues

2018-05-19 Thread Shawn Wallace (JIRA)

Shawn Wallace created HDFS-13597:


 Summary: HDFS memory issues
 Key: HDFS-13597
 URL: https://issues.apache.org/jira/browse/HDFS-13597
 Project: Hadoop HDFS
  Issue Type: Test
  Components: balancer  mover
Affects Versions: 2.7.4
 Environment: PROD
Reporter: Shawn Wallace
 Fix For: HDFS-7285


Please help me with this issue asap



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [ANNOUNCE] Apache Hadoop 2.9.1 Release

2018-05-19 Thread Yongjun Zhang

Thanks for the effort doing the release Sammi, very nice work!

--Yongjun

On Tue, May 15, 2018 at 10:21 AM, Chen, Sammi  wrote:

> Hello everyone,
>
> I am glad to announce that Apache Hadoop 2.9.1 has been released.
>
> Apache Hadoop 2.9.1 is the next release of Apache Hadoop 2.9 line. It
> includes 208 bug fixes, improvements and enhancements since previous Apache
> Hadoop 2.9.0 release.
>
>  - For major changes included in Hadoop 2.9 line, please refer to Hadoop
> 2.9.1 main page [1].
>  - For more details about fixes and improvements in 2.9.1 release, please
> refer to CHANGES [2] and RELEASENOTES [3].
>  - For download, please got to download page[4]
>
> Thank you all for contributing to the Apache Hadoop 2.9.1.
>
>
> Last, thanks Yongjun Zhang, Junping Du, Andrew Wang and Chris Douglas for
> your help and support.
>
>
> Bests,
> Sammi Chen
>
> [1] http://hadoop.apache.org/docs/r2.9.1/index.html
> [2] http://hadoop.apache.org/docs/r2.9.1/hadoop-project-dist/
> hadoop-common/release/2.9.1/CHANGES.2.9.1.html
> [3] http://hadoop.apache.org/docs/r2.9.1/hadoop-project-dist/
> hadoop-common/release/2.9.1/RELEASENOTES.2.9.1.html
> [4] http://hadoop.apache.org/releases.html#Download
>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-05-19 Thread Apache Jenkins Server

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/785/

[May 18, 2018 2:26:44 AM] (inigoiri) HDFS-13586. Fsync fails on directories on 
Windows. Contributed by Lukas
[May 18, 2018 2:43:53 AM] (yqlin) HDFS-13573. Javadoc for 
BlockPlacementPolicyDefault is inaccurate.
[May 18, 2018 3:00:52 AM] (arun suresh) YARN-7900. [AMRMProxy] 
AMRMClientRelayer for stateful
[May 18, 2018 8:38:46 AM] (msingh) HDDS-76. Modify SCMStorageReportProto to 
include the data dir paths as
[May 18, 2018 4:36:58 PM] (inigoiri) HDFS-13592.
[May 18, 2018 4:46:02 PM] (inigoiri) HDFS-13593.
[May 18, 2018 6:29:20 PM] (xiao) HADOOP-15154. Abstract new method 
assertCapability for
[May 18, 2018 9:29:10 PM] (eyang) YARN-7530.  Refactored YARN service API 
project location.




-1 overall


The following subsystems voted -1:
asflicense compile findbugs pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-hdds/common 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$CloseContainerRequestProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 18039] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$CloseContainerResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 18601] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$CopyContainerRequestProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 35184] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$CopyContainerResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 36053] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$CreateContainerResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 13089] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$DatanodeBlockID$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 1126] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$DeleteChunkResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 30491] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$DeleteContainerRequestProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 15748] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$DeleteContainerResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 16224] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$DeleteKeyResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 23421] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$KeyValue$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 1767] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$ListContainerRequestProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 16726] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$ListKeyRequestProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 23958] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$PutKeyResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 21216] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$PutSmallFileResponseProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 33434] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$ReadContainerRequestProto$Builder.maybeForceBuilderInitialization()
 At ContainerProtos.java: At ContainerProtos.java:[line 13529] 
   Useless control flow in 
org.apache.hadoop.hdds.protocol.datanode.proto.ContainerProtos$UpdateContainerResponseProto$Builder.maybeForceBuilderInitialization()
 At

Apache Hadoop qbt Report: trunk+JDK9 on Linux/x86

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

[jira] [Created] (HDFS-13597) HDFS memory issues

Re: [ANNOUNCE] Apache Hadoop 2.9.1 Release

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

5 matches

Site Navigation

Mail list logo

Footer information