Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/385/

[Apr 21, 2017 6:35:36 PM] (wang) HADOOP-14261. Some refactoring work for 
erasure coding raw coder.
[Apr 21, 2017 8:36:31 PM] (yzhang) HDFS-11689. New exception thrown by 
DFSClient%isHDFSEncryptionEnabled
[Apr 21, 2017 11:12:01 PM] (rkanter) MAPREDUCE-6871. Allow users to specify 
racks and nodes for strict
[Apr 22, 2017 3:35:48 AM] (yzhang) HDFS-11402. HDFS Snapshots should capture 
point-in-time copies of OPEN
[Apr 22, 2017 9:56:48 AM] (jzhuge) HDFS-11529. Add libHDFS API to return last 
exception. Contributed by
[Apr 24, 2017 7:58:57 AM] (sunilg) YARN-6291. Introduce query parameters (sort, 
filter, etc.) for tables to
[Apr 24, 2017 5:03:28 PM] (epayne) YARN-5617. AMs only intended to run one 
attempt can be run more than
[Apr 24, 2017 6:37:52 PM] (haibochen) YARN-6500. Do not mount inaccessible 
cgroups directories in
[Apr 24, 2017 7:33:19 PM] (stevel) HADOOP-14305 S3A SSE tests won't run in 
parallel: Bad request in
[Apr 24, 2017 8:17:35 PM] (wangda) YARN-6392. Add submit time to Application 
Summary log. (Zhihai Xu via
[Apr 25, 2017 10:30:42 PM] (jlowe) HDFS-11691. Add a proper scheme to the 
datanode links in NN web UI.
[Apr 25, 2017 11:26:09 PM] (rkanter) YARN-6423. Queue metrics doesn't work for 
Fair Scheduler in SLS (yufeigu
[Apr 26, 2017 1:33:41 AM] (liuml07) HADOOP-12856. FileUtil.checkDest() and 
RawLocalFileSystem.mkdirs() to
[Apr 26, 2017 1:45:56 AM] (xyao) HADOOP-14207. "dfsadmin -refreshCallQueue" 
fails with DecayRpcScheduler.
[Apr 26, 2017 3:54:56 AM] (liuml07) HADOOP-14349. Rename ADLS 
CONTRACT_ENABLE_KEY. Contributed by Mingliang
[Apr 26, 2017 5:06:51 AM] (jzhuge) HADOOP-14341. Support multi-line value for
[Apr 26, 2017 6:34:23 AM] (aajisaka) Revert "YARN-5007. Remove deprecated 
constructors of MiniYARNCluster and
[Apr 26, 2017 6:57:00 AM] (cdouglas) HDFS-6708. StorageType should be encoded 
in the block token. Contributed
[Apr 26, 2017 8:43:29 AM] (aajisaka) HDFS-11417. Add datanode admin command to 
get the storage info.
[Apr 26, 2017 6:44:59 PM] (jzhuge) HADOOP-14340. Enable KMS and HttpFS to 
exclude SSL ciphers. Contributed
[Apr 26, 2017 6:46:55 PM] (haibochen) YARN-6510. Fix profs stat file warning 
caused by process names that
[Apr 26, 2017 8:47:18 PM] (liuml07) HADOOP-14351. Azure: 
RemoteWasbAuthorizerImpl and
[Apr 27, 2017 12:28:49 AM] (shv) HDFS-11384. Balancer disperses getBlocks calls 
to avoid NameNode's rpc
[Apr 27, 2017 6:45:33 AM] (aajisaka) MAPREDUCE-6881. Fix warnings from Spotbugs 
in hadoop-mapreduce.
[Apr 27, 2017 7:12:27 AM] (aajisaka) HDFS-11697. Add javadoc for storage policy 
and erasure coding policy.
[Apr 27, 2017 7:57:08 AM] (aajisaka) HADOOP-11614. Remove httpclient dependency 
from hadoop-openstack.
[Apr 27, 2017 9:31:58 AM] (varunsaxena) YARN-6455. Enhance the 
timelinewriter.flush() race condition fix (Haibo
[Apr 27, 2017 11:19:04 AM] (stevel) HADOOP-14346. CryptoOutputStream throws 
IOException if stream is closed.




-1 overall


The following subsystems voted -1:
asflicense findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-common-project/hadoop-minikdc 
   Possible null pointer dereference in 
org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value of called 
method Dereferenced at 
MiniKdc.java:org.apache.hadoop.minikdc.MiniKdc.delete(File) due to return value 
of called method Dereferenced at MiniKdc.java:[line 368] 

FindBugs :

   module:hadoop-common-project/hadoop-auth 
   
org.apache.hadoop.security.authentication.server.MultiSchemeAuthenticationHandler.authenticate(HttpServletRequest,
 HttpServletResponse) makes inefficient use of keySet iterator instead of 
entrySet iterator At MultiSchemeAuthenticationHandler.java:of keySet iterator 
instead of entrySet iterator At MultiSchemeAuthenticationHandler.java:[line 
192] 

FindBugs :

   module:hadoop-common-project/hadoop-common 
   org.apache.hadoop.crypto.CipherSuite.setUnknownValue(int) 
unconditionally sets the field unknownValue At CipherSuite.java:unknownValue At 
CipherSuite.java:[line 44] 
   org.apache.hadoop.crypto.CryptoProtocolVersion.setUnknownValue(int) 
unconditionally sets the field unknownValue At 
CryptoProtocolVersion.java:unknownValue At CryptoProtocolVersion.java:[line 67] 
   Possible null pointer dereference in 
org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to return value of 
called method Dereferenced at 
FileUtil.java:org.apache.hadoop.fs.FileUtil.fullyDeleteOnExit(File) due to 
return value of called method Dereferenced at FileUtil.java:[line 118] 
   Possible null pointer dereference in 

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/296/

[Apr 21, 2017 6:35:36 PM] (wang) HADOOP-14261. Some refactoring work for 
erasure coding raw coder.
[Apr 21, 2017 8:36:31 PM] (yzhang) HDFS-11689. New exception thrown by 
DFSClient%isHDFSEncryptionEnabled
[Apr 21, 2017 11:12:01 PM] (rkanter) MAPREDUCE-6871. Allow users to specify 
racks and nodes for strict
[Apr 22, 2017 3:35:48 AM] (yzhang) HDFS-11402. HDFS Snapshots should capture 
point-in-time copies of OPEN
[Apr 22, 2017 9:56:48 AM] (jzhuge) HDFS-11529. Add libHDFS API to return last 
exception. Contributed by
[Apr 24, 2017 7:58:57 AM] (sunilg) YARN-6291. Introduce query parameters (sort, 
filter, etc.) for tables to
[Apr 24, 2017 5:03:28 PM] (epayne) YARN-5617. AMs only intended to run one 
attempt can be run more than
[Apr 24, 2017 6:37:52 PM] (haibochen) YARN-6500. Do not mount inaccessible 
cgroups directories in
[Apr 24, 2017 7:33:19 PM] (stevel) HADOOP-14305 S3A SSE tests won't run in 
parallel: Bad request in
[Apr 24, 2017 8:17:35 PM] (wangda) YARN-6392. Add submit time to Application 
Summary log. (Zhihai Xu via
[Apr 25, 2017 10:30:42 PM] (jlowe) HDFS-11691. Add a proper scheme to the 
datanode links in NN web UI.
[Apr 25, 2017 11:26:09 PM] (rkanter) YARN-6423. Queue metrics doesn't work for 
Fair Scheduler in SLS (yufeigu
[Apr 26, 2017 1:33:41 AM] (liuml07) HADOOP-12856. FileUtil.checkDest() and 
RawLocalFileSystem.mkdirs() to
[Apr 26, 2017 1:45:56 AM] (xyao) HADOOP-14207. "dfsadmin -refreshCallQueue" 
fails with DecayRpcScheduler.
[Apr 26, 2017 3:54:56 AM] (liuml07) HADOOP-14349. Rename ADLS 
CONTRACT_ENABLE_KEY. Contributed by Mingliang
[Apr 26, 2017 5:06:51 AM] (jzhuge) HADOOP-14341. Support multi-line value for
[Apr 26, 2017 6:34:23 AM] (aajisaka) Revert "YARN-5007. Remove deprecated 
constructors of MiniYARNCluster and
[Apr 26, 2017 6:57:00 AM] (cdouglas) HDFS-6708. StorageType should be encoded 
in the block token. Contributed
[Apr 26, 2017 8:43:29 AM] (aajisaka) HDFS-11417. Add datanode admin command to 
get the storage info.
[Apr 26, 2017 6:44:59 PM] (jzhuge) HADOOP-14340. Enable KMS and HttpFS to 
exclude SSL ciphers. Contributed
[Apr 26, 2017 6:46:55 PM] (haibochen) YARN-6510. Fix profs stat file warning 
caused by process names that
[Apr 26, 2017 8:47:18 PM] (liuml07) HADOOP-14351. Azure: 
RemoteWasbAuthorizerImpl and
[Apr 27, 2017 12:28:49 AM] (shv) HDFS-11384. Balancer disperses getBlocks calls 
to avoid NameNode's rpc
[Apr 27, 2017 6:45:33 AM] (aajisaka) MAPREDUCE-6881. Fix warnings from Spotbugs 
in hadoop-mapreduce.
[Apr 27, 2017 7:12:27 AM] (aajisaka) HDFS-11697. Add javadoc for storage policy 
and erasure coding policy.
[Apr 27, 2017 7:57:08 AM] (aajisaka) HADOOP-11614. Remove httpclient dependency 
from hadoop-openstack.
[Apr 27, 2017 9:31:58 AM] (varunsaxena) YARN-6455. Enhance the 
timelinewriter.flush() race condition fix (Haibo
[Apr 27, 2017 11:19:04 AM] (stevel) HADOOP-14346. CryptoOutputStream throws 
IOException if stream is closed.




-1 overall


The following subsystems voted -1:
compile mvninstall unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.ha.TestZKFailoverControllerStress 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure 
   hadoop.hdfs.TestReadStripedFileWithMissingBlocks 
   hadoop.hdfs.qjournal.server.TestJournalNode 
   hadoop.hdfs.server.blockmanagement.TestBlockManager 
   hadoop.hdfs.server.namenode.ha.TestBootstrapStandby 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.server.datanode.TestDataNodeMultipleRegistrations 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure090 
   hadoop.hdfs.TestDFSRSDefault10x4StripedOutputStreamWithFailure 
   hadoop.hdfs.TestRollingUpgrade 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure000 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.server.datanode.TestDataNodeUUID 
   hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure040 
   hadoop.hdfs.TestDFSStripedOutputStreamWithFailure210 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 
   hadoop.mapred.TestShuffleHandler 
   hadoop.tools.TestHadoopArchiveLogsRunner 
   hadoop.metrics2.impl.TestKafkaMetrics 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.yarn.client.api.impl.TestAMRMClient 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   

Re: About 2.7.4 Release

[Akira Ajisaka]

Thanks Allen for the additional information.

> At one point, JIRA was configured to refuse re-opening after a 
release is cut.


In the past, release manager closed the tickets and the process is 
written in the wiki: https://wiki.apache.org/hadoop/HowToRelease


> 10. In JIRA, close issues resolved in the release. Disable mail 
notifications for this bulk change.


Therefore, let's close them.

On 2017/04/27 3:01, Allen Wittenauer wrote:



On Apr 25, 2017, at 12:35 AM, Akira Ajisaka  wrote:

Maybe we should create a jira to track this?


I think now either way (reopen or create) is fine.

Release doc maker creates change logs by fetching information from JIRA, so 
reopening the tickets should be avoided when a release process is in progress.



Keep in mind that the release documentation is part of the build 
process.  Users who are doing their own builds will have incomplete 
documentation if we keep re-opening JIRAs after a release.  At one point, JIRA 
was configured to refuse re-opening after a release is cut.  I'm not sure why 
it stopped doing that, but it might be time to see if we can re-enable that 
functionality.


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



-
To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org