This is an automated email from the ASF dual-hosted git repository.
hexiaoqiao pushed a change to branch branch-3.2.2
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
from 0aeef43 HDFS-14395. Remove WARN Logging From Interrupts. Contributed
by David Mollitor.
new 199de87 YARN-10475: Scale RM-NM heartbeat interval based on node
utilization. Contributed by Jim Brennan (Jim_Brennan).
new 8e36204 HDFS-15665. Balancer logging improvements. Contributed by
Konstantin V Shvachko.
new ea9e641 HADOOP-17342. Creating a token identifier should not do
kerberos name resolution. Contributed by Jim Brennan.
new 90e47d1 YARN-10479. RMProxy should retry on SocketTimeout Exceptions.
Contributed by Jim Brennan (Jim_Brennan)
new 91424ca HDFS-15623. Respect configured values of rpc.engine (#2403)
Contributed by Hector Chaverri.
new 968158e HADOOP-17340. TestLdapGroupsMapping failing -string mismatch
in exception validation. (#2427). Contributed by Steve Loughran.
new c68c062 HADOOP-17352. Update PATCH_NAMING_RULE in the personality
file. (#2433)
new 5b2c7c8 HADOOP-17142. Fix outdated properties of JournalNode when
performing rollback. Contributed by Deegue.
new 78cc8a4 HADOOP-17096. Fix ZStandardCompressor input buffer offset
(#2104). Contributed by Stephen Jung (Stripe).
new 9a2a55e HADOOP-17358. Improve excessive reloading of Configurations
(#2436)
new 855db9f HDFS-15538. Fix the documentation for
dfs.namenode.replication.max-streams in hdfs-default.xml. Contributed by
Xieming Li.
new 00e48c3 HADOOP-17362. reduce RPC calls doing ls on HAR file (#2444).
Contributed by Daryn Sharp and Ahmed Hussein
new 30542c2 YARN-10396. Max applications calculation per queue disregards
queue level settings in absolute mode. Contributed by Benjamin Teke.
new afbdf5c YARN-10485. TimelineConnector swallows InterruptedException
(#2450). Contributed by Ahmed Hussein
new 8de47fe HADOOP-17360. Log the remote address for authentication
success (#2441)
new d99f8e7 HADOOP-17367. Add InetAddress api to ProxyUsers.authorize
(#2449). Contributed by Daryn Sharp and Ahmed Hussein
new e10af53 MAPREDUCE-7304. Enhance the map-reduce Job end notifier to be
able to notify the given URL via a custom class. Contributed by Zoltan Erdmann
new 8763406 HADOOP-17346. Fair call queue is defeated by abusive service
principals. Contributed by Ahmed Hussein (ahussein).
new 592bc2f YARN-10470. When building new web ui with root user, the
bower install should support it. Contributed by zhuqi.
new 2f2b690 MAPREDUCE-7309. Improve performance of reading resource
request for mapper/reducers from config. Contributed by Peter Bacsko & Wangda
Tan.
new 922f746 HADOOP-17325. WASB Test Failures
The 21 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
dev-support/bin/hadoop.sh | 2 +-
hadoop-common-project/hadoop-common/pom.xml | 1 -
.../java/org/apache/hadoop/conf/Configuration.java | 34 ++++--
.../java/org/apache/hadoop/fs/HarFileSystem.java | 72 ++++++-----
.../io/compress/zstd/ZStandardCompressor.java | 4 +-
.../org/apache/hadoop/ipc/CallQueueManager.java | 14 +++
.../org/apache/hadoop/ipc/DecayRpcScheduler.java | 59 +++++++--
.../src/main/java/org/apache/hadoop/ipc/RPC.java | 22 +++-
.../main/java/org/apache/hadoop/ipc/Server.java | 19 ++-
.../apache/hadoop/ipc/UserIdentityProvider.java | 2 +-
.../org/apache/hadoop/security/SecurityUtil.java | 20 ++-
.../authorize/DefaultImpersonationProvider.java | 5 +-
.../security/authorize/ImpersonationProvider.java | 26 +++-
.../hadoop/security/authorize/ProxyUsers.java | 37 ++++--
.../authorize/ServiceAuthorizationManager.java | 29 ++---
.../AbstractDelegationTokenIdentifier.java | 2 +-
.../java/org/apache/hadoop/util/MachineList.java | 128 +++++++++-----------
.../hadoop/io/compress/zstd/ZStandardCompressor.c | 4 +-
.../hadoop/conf/TestConfigurationSubclass.java | 3 +-
.../apache/hadoop/fs/TestHarFileSystemBasics.java | 5 +-
.../apache/hadoop/ipc/TestDecayRpcScheduler.java | 3 +-
.../test/java/org/apache/hadoop/ipc/TestRPC.java | 49 ++++++++
.../java/org/apache/hadoop/ipc/TestRpcBase.java | 5 +-
.../hadoop/security/TestLdapGroupsMapping.java | 10 +-
.../hadoop/security/authorize/TestProxyUsers.java | 29 ++++-
.../org/apache/hadoop/util/TestMachineList.java | 117 ++++++++++--------
.../hadoop/hdfs/qjournal/server/JNStorage.java | 4 +
.../hadoop/hdfs/qjournal/server/Journal.java | 2 +
.../hadoop/hdfs/server/balancer/Balancer.java | 33 +++--
.../hadoop/hdfs/server/balancer/Dispatcher.java | 20 ++-
.../hdfs/server/balancer/NameNodeConnector.java | 14 +++
.../src/main/resources/hdfs-default.xml | 2 +-
.../hadoop/hdfs/server/balancer/TestBalancer.java | 2 +-
.../hadoop/mapreduce/v2/app/JobEndNotifier.java | 51 +++++++-
.../mapreduce/v2/app/job/impl/TaskAttemptImpl.java | 12 +-
.../mapreduce/v2/app/TestJobEndNotifier.java | 42 +++++++
.../mapreduce/v2/app/job/impl/TestTaskAttempt.java | 7 ++
.../java/org/apache/hadoop/mapred/JobConf.java | 46 +++++++
.../hadoop/mapreduce/CustomJobEndNotifier.java | 57 +++++++++
.../org/apache/hadoop/mapreduce/MRJobConfig.java | 3 +
.../src/main/resources/mapred-default.xml | 17 +++
.../fs/azure/ITestWasbUriAndConfiguration.java | 4 +-
.../hadoop/fs/azure/InMemoryBlockBlobStore.java | 7 +-
.../hadoop/fs/azure/MockStorageInterface.java | 20 ++-
.../apache/hadoop/fs/azure/TestBlobMetadata.java | 4 +-
.../hadoop/yarn/sls/nodemanager/NodeInfo.java | 7 ++
.../hadoop/yarn/sls/scheduler/RMNodeWrapper.java | 7 ++
.../apache/hadoop/yarn/conf/YarnConfiguration.java | 24 ++++
.../hadoop-yarn/hadoop-yarn-common/pom.xml | 1 -
.../org/apache/hadoop/yarn/client/RMProxy.java | 2 +
.../yarn/client/api/impl/TimelineConnector.java | 4 +-
.../src/main/resources/yarn-default.xml | 50 ++++++++
.../server/nodemanager/TestNodeStatusUpdater.java | 40 ++++--
.../yarn/server/resourcemanager/AdminService.java | 8 ++
.../server/resourcemanager/ClusterMetrics.java | 27 ++++-
.../resourcemanager/ResourceTrackerService.java | 105 ++++++++++++++--
.../yarn/server/resourcemanager/rmnode/RMNode.java | 4 +
.../server/resourcemanager/rmnode/RMNodeImpl.java | 42 +++++++
.../scheduler/ClusterNodeTracker.java | 5 +-
.../scheduler/capacity/ParentQueue.java | 14 ++-
.../yarn/server/resourcemanager/MockNodes.java | 7 ++
.../resourcemanager/TestRMNodeTransitions.java | 109 +++++++++++++++++
.../scheduler/TestClusterNodeTracker.java | 18 +++
.../scheduler/capacity/TestParentQueue.java | 134 ++++++++++++++++++---
.../src/site/markdown/NodeManager.md | 18 +++
.../hadoop-yarn/hadoop-yarn-ui/pom.xml | 2 +-
66 files changed, 1373 insertions(+), 303 deletions(-)
create mode 100644
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/CustomJobEndNotifier.java
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
