For more details, see
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/
[Aug 1, 2017 4:56:33 PM] (jianhe) YARN-6872. Ensure apps could run given
NodeLabels are disabled post RM
[Aug 1, 2017 8:31:44 PM] (arp) HDFS-14676. Wrong default value for
fs.df.interval. Contributed by
[Aug 1, 2017 8:34:25 PM] (mackrorysd) HDFS-12151. Hadoop 2 clients cannot
writeBlock to Hadoop 3 DataNodes.
[Aug 1, 2017 8:36:28 PM] (stevel) HADOOP-14660 wasb: improve throughput by 34%
when account limit
[Aug 1, 2017 10:13:29 PM] (wang) HADOOP-14701. Configuration can log misleading
warnings about an attempt
[Aug 1, 2017 11:00:53 PM] (lei) HADOOP-14495. Add set options interface to
FSDataOutputStreamBuilder.
[Aug 1, 2017 11:28:20 PM] (manojpec) HDFS-12217. HDFS snapshots doesn't capture
all open files when one of
[Aug 2, 2017 12:13:02 AM] (junping_du) HADOOP-14683. FileStatus.compareTo
binary compatible issue. Contributed
[Aug 2, 2017 12:28:17 AM] (Carlo Curino) YARN-5300. Exclude generated
federation protobuf sources from YARN
[Aug 2, 2017 12:28:17 AM] (Carlo Curino) YARN-3662. Federation Membership State
Store internal APIs.
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-5406. In-memory based
implementation of the
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-5390. Federation Subcluster
Resolver. Contributed by Ellen Hui.
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-5307. Federation Application
State Store internal APIs
[Aug 2, 2017 12:28:18 AM] (Carlo Curino) YARN-3664. Federation PolicyStore
internal APIs
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5408. Compose Federation
membership/application/policy APIs into an
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5407. In-memory based
implementation of the
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5519. Add SubClusterId in
AddApplicationHomeSubClusterResponse for
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-3672. Create Facade for
Federation State and Policy Store.
[Aug 2, 2017 12:28:19 AM] (Carlo Curino) YARN-5467. InputValidator for the
FederationStateStore internal APIs.
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-3673. Create a FailoverProxy for
Federation services. Contributed
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-3671. Integrate Federation
services with ResourceManager.
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-5612. Return SubClusterId in
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-5601. Make the RM epoch base
value configurable. Contributed by
[Aug 2, 2017 12:28:20 AM] (Carlo Curino) YARN-5323. Policies APIs for
Federation Router and AMRMProxy policies.
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5324. Stateless Federation router
policies implementation. (Carlo
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5325. Stateless ARMRMProxy
policies implementation. (Carlo Curino
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5391. PolicyManager to tie
together Router/AMRM Federation
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5634. Simplify initialization/use
of RouterPolicy via a
[Aug 2, 2017 12:28:21 AM] (Carlo Curino) YARN-5676. Add a
HashBasedRouterPolicy, and small policies and test
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-5905. Update the RM webapp host
that is reported as part of
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-5872. Add AlwayReject policies
for router and amrmproxy. (Carlo
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-6093. Minor bugs with AMRMtoken
renewal and state store
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-5410. Bootstrap Router server
module. (Giovanni Matteo Fumarola via
[Aug 2, 2017 12:28:22 AM] (Carlo Curino) YARN-6190. Validation and
synchronization fixes in
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-6247. Share a single instance of
SubClusterResolver instead of
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-6370. Properly handle rack
requests for non-active subclusters in
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-5602. Utils for Federation State
and Policy Store. (Giovanni Matteo
[Aug 2, 2017 12:28:23 AM] (Carlo Curino) YARN-6203: Occasional test failure in
TestWeightedRandomRouterPolicy
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-3663. Federation State and Policy
Store (DBMS implementation).
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-5411. Create a proxy chain for
ApplicationClientProtocol in the
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-5413. Create a proxy chain for
ResourceManager Admin API in the
[Aug 2, 2017 12:28:24 AM] (Carlo Curino) YARN-5531. UnmanagedAM pool manager
for federating application across
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) Bumping up hadoop-yarn-server-router
module to 3.0.0-alpha4 post rebase.
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) YARN-6666. Fix unit test failure in
TestRouterClientRMService. (Botong
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) YARN-6484. Documenting the YARN
Federation feature. (Carlo Curino via
[Aug 2, 2017 12:28:25 AM] (Carlo Curino) YARN-3666. Federation Intercepting and
propagating AM- home RM
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6511. Federation: transparently
spanning application across
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6691. Update YARN daemon
startup/shutdown scripts to include Router
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6724. Add ability to blacklist
sub-clusters when invoking Routing
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-3659. Federation: routing client
invocations transparently to
[Aug 2, 2017 12:28:26 AM] (Carlo Curino) YARN-6807. Adding required missing
configs to Federation configuration
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) YARN-6815. FederationStateStoreFacade
return behavior should be
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) YARN-6821. Move FederationStateStore
SQL DDL files from test resource to
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) Bumping up yarn-server-router (new)
module pom to beta1 and fixing
[Aug 2, 2017 12:28:27 AM] (Carlo Curino) Bumping up hadoop-yarn-server-router
module to 3.0.0-beta1 post rebase.
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-6866. Minor clean-up and fixes in
anticipation of YARN-2915 merge
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-5412. Create a proxy chain for
ResourceManager REST API in the
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-6902. Update Microsoft JDBC
Driver for SQL Server version in
[Aug 2, 2017 12:28:28 AM] (Carlo Curino) YARN-6853. Add MySql Scripts for
FederationStateStore. (Contributed by
[Aug 2, 2017 1:34:07 AM] (wheat9) HDFS-12107. FsDatasetImpl#removeVolumes
floods the logs when removing
[Aug 2, 2017 6:06:25 AM] (iwasakims) HADOOP-14702. Fix formatting issue and
regression caused by conversion
-1 overall
The following subsystems voted -1:
findbugs unit
The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace
The following subsystems are considered long running:
(runtime bigger than 1h 0m 0s)
unit
Specific tests:
FindBugs :
module:hadoop-hdfs-project/hadoop-hdfs-client
Possible exposure of partially initialized object in
org.apache.hadoop.hdfs.DFSClient.initThreadsNumForStripedReads(int) At
DFSClient.java:object in
org.apache.hadoop.hdfs.DFSClient.initThreadsNumForStripedReads(int) At
DFSClient.java:[line 2906]
org.apache.hadoop.hdfs.server.protocol.SlowDiskReports.equals(Object)
makes inefficient use of keySet iterator instead of entrySet iterator At
SlowDiskReports.java:keySet iterator instead of entrySet iterator At
SlowDiskReports.java:[line 105]
FindBugs :
module:hadoop-hdfs-project/hadoop-hdfs
Possible null pointer dereference in
org.apache.hadoop.hdfs.qjournal.server.JournalNode.getJournalsStatus() due to
return value of called method Dereferenced at
JournalNode.java:org.apache.hadoop.hdfs.qjournal.server.JournalNode.getJournalsStatus()
due to return value of called method Dereferenced at JournalNode.java:[line
302]
org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setClusterId(String)
unconditionally sets the field clusterId At HdfsServerConstants.java:clusterId
At HdfsServerConstants.java:[line 193]
org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setForce(int)
unconditionally sets the field force At HdfsServerConstants.java:force At
HdfsServerConstants.java:[line 217]
org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setForceFormat(boolean)
unconditionally sets the field isForceFormat At
HdfsServerConstants.java:isForceFormat At HdfsServerConstants.java:[line 229]
org.apache.hadoop.hdfs.server.common.HdfsServerConstants$StartupOption.setInteractiveFormat(boolean)
unconditionally sets the field isInteractiveFormat At
HdfsServerConstants.java:isInteractiveFormat At HdfsServerConstants.java:[line
237]
Possible null pointer dereference in
org.apache.hadoop.hdfs.server.datanode.DataStorage.linkBlocksHelper(File, File,
int, HardLink, boolean, File, List) due to return value of called method
Dereferenced at
DataStorage.java:org.apache.hadoop.hdfs.server.datanode.DataStorage.linkBlocksHelper(File,
File, int, HardLink, boolean, File, List) due to return value of called method
Dereferenced at DataStorage.java:[line 1339]
Possible null pointer dereference in
org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager.purgeOldLegacyOIVImages(String,
long) due to return value of called method Dereferenced at
NNStorageRetentionManager.java:org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager.purgeOldLegacyOIVImages(String,
long) due to return value of called method Dereferenced at
NNStorageRetentionManager.java:[line 258]
Possible null pointer dereference in
org.apache.hadoop.hdfs.server.namenode.NNUpgradeUtil$1.visitFile(Path,
BasicFileAttributes) due to return value of called method Dereferenced at
NNUpgradeUtil.java:org.apache.hadoop.hdfs.server.namenode.NNUpgradeUtil$1.visitFile(Path,
BasicFileAttributes) due to return value of called method Dereferenced at
NNUpgradeUtil.java:[line 133]
Useless condition:argv.length >= 1 at this point At DFSAdmin.java:[line
2100]
Useless condition:numBlocks == -1 at this point At
ImageLoaderCurrent.java:[line 727]
FindBugs :
module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager
Useless object stored in variable removedNullContainers of method
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.removeOrTrackCompletedContainersFromContext(List)
At NodeStatusUpdaterImpl.java:removedNullContainers of method
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.removeOrTrackCompletedContainersFromContext(List)
At NodeStatusUpdaterImpl.java:[line 642]
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.removeVeryOldStoppedContainersFromCache()
makes inefficient use of keySet iterator instead of entrySet iterator At
NodeStatusUpdaterImpl.java:keySet iterator instead of entrySet iterator At
NodeStatusUpdaterImpl.java:[line 719]
Hard coded reference to an absolute pathname in
org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(ContainerRuntimeContext)
At DockerLinuxContainerRuntime.java:absolute pathname in
org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.runtime.DockerLinuxContainerRuntime.launchContainer(ContainerRuntimeContext)
At DockerLinuxContainerRuntime.java:[line 490]
org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.createStatus()
makes inefficient use of keySet iterator instead of entrySet iterator At
ContainerLocalizer.java:keySet iterator instead of entrySet iterator At
ContainerLocalizer.java:[line 357]
org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainerMetrics.usageMetrics
is a mutable collection which should be package protected At
ContainerMetrics.java:which should be package protected At
ContainerMetrics.java:[line 134]
Failed junit tests :
hadoop.security.TestKDiag
hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080
hadoop.hdfs.TestDFSStripedInputStreamWithRandomECPolicy
hadoop.hdfs.TestDFSStripedOutputStreamWithFailure150
hadoop.hdfs.TestDFSStripedOutputStreamWithFailure120
hadoop.yarn.server.nodemanager.containermanager.scheduler.TestContainerSchedulerQueuing
hadoop.yarn.client.TestFederationRMFailoverProxyProvider
hadoop.yarn.client.api.impl.TestNMClient
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
hadoop.yarn.sls.nodemanager.TestNMSimulator
Timed out junit tests :
org.apache.hadoop.yarn.server.resourcemanager.TestSubmitApplicationWithRMHA
cc:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-compile-cc-root.txt
[4.0K]
javac:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-compile-javac-root.txt
[308K]
checkstyle:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-checkstyle-root.txt
[17M]
pylint:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-patch-pylint.txt
[20K]
shellcheck:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-patch-shellcheck.txt
[20K]
shelldocs:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-patch-shelldocs.txt
[12K]
whitespace:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/whitespace-eol.txt
[12M]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/whitespace-tabs.txt
[1.2M]
findbugs:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-client-warnings.html
[8.0K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
[16K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager-warnings.html
[12K]
javadoc:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/diff-javadoc-javadoc-root.txt
[1.9M]
unit:
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
[148K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
[244K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
[40K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
[64K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
[40K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice-hbase-tests.txt
[12K]
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/482/artifact/out/patch-unit-hadoop-tools_hadoop-sls.txt
[8.0K]
Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]