This is an automated email from the ASF dual-hosted git repository.
jhung pushed a change to branch branch-2-jhung-test
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
discard 78030cc corrupt stdin
discard be705b5 fix an oopsie
discard 5b580aa Try something
discard 5c02975 Revert "add --no-cache to try to repro branch-2 build
failures"
discard 8aa4c7d Revert "drop thread/dn counts in various tests to avoid OOM
errors"
discard b2bd1c9 Revert "delete maxpermsize for testing"
discard 6669c8b YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics
discard 46f0f4c HADOOP-15950. Failover for LdapGroupsMapping. Contributed by
Lukas Majercak.
discard a121955 Revert "HADOOP-15950. Failover for LdapGroupsMapping.
Contributed by Lukas Majercak."
discard 1f8c879 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by
Lukas Majercak.
discard 15ce8df YARN-7794. SLSRunner is not loading timeline service jars,
causing failure.
discard f9ea6f3 YARN-9036. Escape newlines in health report in YARN UI.
Contributed by Keqiu Hu
discard 7144eef HADOOP-15959. Revert "HADOOP-12751. While using kerberos
Hadoop incorrectly assumes names with '@' to be non-simple"
discard 2c206f1 HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and
DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
discard e320762 HADOOP-15943. AliyunOSS: add missing owner & group attributes
for oss FileStatus. Contributed by wujinhu.
discard a213ea2 Update jdiff.stable.api from 2.9.1 to 2.9.2.
discard 1d539c5 Add 2.9.2 release notes and changes documents.
discard 6de44c0 HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed
by wujinhu.
discard 762df75 HDFS-14056. Fix error messages in HDFS-12716. Contributed by
Ayush Saxena.
discard 0cebbfd HDFS-13963. NN UI is broken with IE11. Contributed by Ayush
Saxena.
discard fc3e979 HADOOP-15925. The config and log of gpg-agent are removed in
create-release script. Contributed by Dinesh Chitlangia.
discard 914716d HADOOP-15930. Exclude MD5 checksum files from release
artifact.
discard 0f9757f HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps
in statistics. Contributed by Jinhu Wu.
discard f64b451 HADOOP-15923. create-release script should set max-cache-ttl
as well as default-cache-ttl for gpg-agent.
discard 00b4455 YARN-8933. [AMRMProxy] Fix potential empty fields in
allocation response, move SubClusterTimeout to FederationInterceptor.
Contributed by Botong Huang.
discard 181e138 YARN-8233. NPE in CapacityScheduler#tryCommit when handling
allocate/reserve proposal whose allocatedOrReservedContainer is null.
Contributed by Tao Yang.
discard b86c651 MAPREDUCE-7156. NullPointerException when reaching max
shuffle connections. Contributed by Peter Bacsko
discard ba89181 HDFS-14048. DFSOutputStream close() throws exception on
subsequent call after DataNode restart. Contributed by Erik Krogen.
discard a4044fd HDFS-14043. Tolerate corrupted seen_txid file. Contributed by
Lukas Majercak.
discard f87ba60 HADOOP-15900. Update JSch versions in LICENSE.txt.
discard 035f710 HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
discard 85c2143 YARN-8905. [Router] Add JvmMetricsInfo and pause monitor.
Contributed by Bilwa S T.
discard 690d808 YARN-8893. [AMRMProxy] Fix thread leak in AMRMClientRelayer
and UAM client. Contributed by Botong Huang.
discard 611b5c7 YARN-7225. Add queue and partition info to RM audit log.
Contributed by Eric Payne
discard 401e104 Addendum: Fix potential FSImage corruption. Contributed by
Xiao Chen.
discard 6d02100 HADOOP-15866. Renamed
HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility.
Contributed by Wei-Chiu Chuang.
discard 091c7cf HADOOP-15868. AliyunOSS: update document for properties of
multiple part download, multiple part upload and directory copy. Contributed by
Jinhu Wu.
discard 5475700 HADOOP-15850. CopyCommitter#concatFileChunks should check
that the blocks per chunk is not 0. Contributed by Ted Yu.
discard 645b311 HADOOP-15822. zstd compressor can fail with a small output
buffer. Contributed by Jason Lowe.
discard b32ef14 YARN-8826. Fix lingering timeline collector after serviceStop
in TimelineCollectorManager. Contributed by Prabha Manepalli.
discard 0c39681 YARN-7502. Nodemanager restart docs should describe
nodemanager supervised property. Contributed by Suma Shivaprasad.
discard 03ff0f1 HADOOP-15859. ZStandardDecompressor.c mistakes a class for an
instance. Contributed by Jason Lowe
discard 04ca639 Fix potential FSImage corruption. Contributed by Daryn Sharp.
discard 6e5d052 HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed
by Fei Hui.
discard ec9a67f HADOOP-15837. DynamoDB table Update can fail S3A FS init.
Contributed by Steve Loughran.
discard be3f13d YARN-3879 [Storage implementation] Create HDFS backing
storage implementation for ATS reads. Contributed by Abhishek Modi.
discard 1045b69 YARN-7274. Ability to disable elasticity at leaf queue level.
(Zian Chen via wangda)
discard 079aedb HADOOP-15679. ShutdownHookManager shutdown time needs to be
configurable & extended.
discard c6cc685 YARN-6989 Ensure timeline service v2 codebase gets UGI from
HttpServletRequest in a consistent way. Contributed by Abhishek Modi
discard c102ebf YARN-8858. CapacityScheduler should respect maximum node
resource when per-queue maximum-allocation is being used. Contributed by Wangda
Tan.
discard d5cb071 YARN-8720. CapacityScheduler does not enforce max resource
allocation check at queue level. Contributed by Tarun Parimi.
discard 9f50f9c YARN-7652. Handle AM register requests asynchronously in
FederationInterceptor. Contributed by Botong Huang.
discard 0c463c2 HADOOP-15818. Fix deprecated maven-surefire-plugin
configuration in hadoop-kms module
discard 709fa7a HDFS-13768. Adding replicas to volume map makes DataNode
start slowly. Contributed by Surendra Singh Lilhore.
discard 1927009 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with
No Active Namenode under nameservice. Contributed by Ayush Saxena.
discard 73558cc HADOOP-15820. ZStandardDecompressor native code sets an
integer field as a long. Contributed by Jason Lowe
discard 0667966 HADOOP-15817. Reuse Object Mapper in KMSJSONReader.
Contributed by Jonathan Eagles.
discard 5792a4f YARN-8840. Add missing cleanupSSLConfig() call for
TestTimelineClient test. Contributed by Aki Tanaka.
discard b666ee0 MAPREDUCE-6896. Document wrong spelling in usage of
MapredTestDriver tools. (Contributed by LiXin Ge via Daniel Templeton)
discard b68c4be YARN-8760. [AMRMProxy] Fix concurrent re-register due to
YarnRM failover in AMRMClientRelayer. Contributed by Botong Huang.
discard c34fc58 YARN-8774. Memory leak when CapacityScheduler allocates from
reserved container with non-default label. Contributed by Tao Yang.
discard 971072d YARN-8804. resourceLimits may be wrongly calculated when
leaf-queue is blocked in cluster with 3+ level queues. Contributed by Tao Yang
discard a60233b HDFS-13790. RBF: Move ClientProtocol APIs to its own module
Contributed by Chao Sun.
discard 9189aea YARN-7974. Allow updating application tracking url after
registration. (Jonathan Hung via asuresh)
discard 20f42a9 HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS.
Contributed by Jinhu Wu.
discard 2e6ab12 YARN-8696. [AMRMProxy] FederationInterceptor upgrade: home
sub-cluster heartbeat async. Contributed by Botong Huang.
discard 742dc4d YARN-8658. [AMRMProxy] Metrics for AMRMClientRelayer inside
FederationInterceptor. Contributed by Young Chen.
discard f8b59ec HADOOP-15726. Create utility to limit frequency of log
statements. Contributed by Erik Krogen.
discard 2768416 HADOOP-15748. S3 listing inconsistency can raise NPE in
globber. Contributed by Steve Loughran.
discard b4e5be2 HADOOP-15772. Remove the 'Path ... should be specified as a
URI' warnings on startup. Contributed by Ayush Saxena.
discard 9a1b52e HDFS-13908. TestDataNodeMultipleRegistrations is flaky.
Contributed by Ayush Saxena.
discard ceff240 MAPREDUCE-7138. ThrottledContainerAllocator in MRAppBenchmark
should implement RMHeartbeatHandler. Contributed by Oleksandr Shevchenko
discard 6658532 MAPREDUCE-7137. MRAppBenchmark.benchmark1() fails with
NullPointerException. Contributed by Oleksandr Shevchenko
discard 1777bd3 HADOOP-15755. StringUtils#createStartupShutdownMessage throws
NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia
discard b01b9b4 MAPREDUCE-3801:
org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator
fails intermittently. Contributed by Jason Lowe
discard 12037f4 HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0.
Contributed by Jinhu Wu.
discard ae471ba HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js.
Contributed by yanghuafeng.
discard e707d1b MAPREDUCE-7133. History Server task attempts REST API returns
invalid data. Contributed by Oleksandr Shevchenko
discard 10983fe HDFS-13914. Fix DN UI logs link broken when https is enabled
after HDFS-13902. Contributed by Jianfei Jiang.
discard 6ebf04d HDFS-13902. Add JMX, conf and stacks menus to the datanode
page. Contributed by fengchuang.
discard 1a26585 HDFS-13051. Fix dead lock during async editlog rolling if
edit queue is full. Contributed by Daryn Sharp.
discard 7c572d6 YARN-8709: CS preemption monitor always fails since one
under-served queue was deleted. Contributed by Tao Yang.
discard de08781 HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to
support minimum number of volumes to be available. Contributed by Ranith Sardar
discard 2f88c46 HADOOP-15731. TestDistributedShell fails on Windows.
Contributed by Botong Huang.
discard 038dbe8 HDFS-13836. RBF: Handle mount table znode with null value.
Contributed by yanghuafeng.
discard cdc4ff6 MAPREDUCE-7131. Job History Server has race condition where
it moves files from intermediate to finished but thinks file is in
intermediate. Contributed by Anthony Hsu
discard 1362e78 HADOOP-15657 Registering MutableQuantiles via Metric
annotation. Contributed by Sushil Ks
discard 6e2f07a HDFS-13812. Fix the inconsistent default refresh interval on
Caching documentation. Contributed by Hrishikesh Gadre.
discard 834708e HDFS-13857. RBF: Choose to enable the default nameservice to
read/write files. Contributed by yanghuafeng.
discard efd4593 HADOOP-10219. ipc.Client.setupIOstreams() needs to check for
ClientCache.stopClient requested shutdowns. Contributed by Kihwal Lee and Lukas
Majercak.
discard c9caa28 HADOOP-15547/ WASB: improve listStatus performance.
Contributed by Thomas Marquardt.
discard 14c609a YARN-8051: TestRMEmbeddedElector#testCallbackSynchronization
is flakey. Contributed by Robert Kanter and Jason Lowe.
discard adf5708 HDFS-13634. RBF: Configurable value in xml for async
connection request queue size. Contributed by CR Hota.
discard 15769cb HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime
should display by JMX with ms unit. Contributed by yanghuafeng.
discard da11092 YARN-8697. LocalityMulticastAMRMProxyPolicy should fallback
to random sub-cluster when cannot resolve resource. Contributed by Botong Huang.
discard 898ab4e HADOOP-15699. Fix some of testContainerManager failures in
Windows. Contributed by Botong Huang.
discard 88d2260 YARN-8705. Refactor the UAM heartbeat thread in preparation
for YARN-8696. Contributed by Botong Huang.
discard 8a85245 HDFS-13831. Make block increment deletion number
configurable. Contributed by Ryan Wu.
discard 292160d HDFS-13848. Refactor NameNode failover proxy providers.
Contributed by Konstantin Shvachko.
discard 166c5b9 YARN-8649. NPE in localizer hearbeat processing if a
container is killed while localizing. Contributed by lujie
discard 479857b HADOOP-14314. The OpenSolaris taxonomy link is dead in
InterfaceClassification.md. Contributed by Rui Gao.
discard d83acb1 HADOOP-15689. Add "*.patch" into .gitignore file of branch-2.
Contributed by Rui Gao.
discard 8d5ed40 HDFS-13821. RBF: Add
dfs.federation.router.mount-table.cache.enable so that users can disable cache.
Contributed by Fei Hui.
discard 1e42cac YARN-8673. [AMRMProxy] More robust responseId resync after an
YarnRM master slave switch. Contributed by Botong Huang.
discard ef7337c YARN-8581. [AMRMProxy] Add sub-cluster timeout in
LocalityMulticastAMRMProxyPolicy. Contributed by Botong Huang.
discard 77877a7 YARN-8129. Improve error message for invalid value in fields
attribute. Contributed by Abhishek Modi.
discard ddd3c36 HDFS-13750. RBF: Router ID in RouterRpcClient is always null.
Contributed by Takanobu Asanuma.
discard 8fb48dc YARN-8679. [ATSv2] If HBase cluster is down for long time,
high chances that NM ContainerManager dispatcher get blocked. Contributed by
Wangda Tan.
discard 9ac2897 HADOOP-15674. Test failure
TestSSLHttpServer.testExcludedCiphers with
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard
Nemeth.
discard a99c74d YARN-8612. Fix NM Collector Service Port issue in
YarnConfiguration. Contributed by Prabha Manepalli.
discard a0eff9a HDFS-13758. DatanodeManager should throw exception if it has
BlockRecoveryCommand but the block is not under construction. Contributed by
chencan.
discard 42ebdfa YARN-8640. Restore previous state in container-executor after
failure. Contributed by Jim Brennan
discard 6117b06 HDFS-13813. Exit NameNode if dangling child inode is detected
when saving FsImage. Contributed by Siyao Meng.
discard 1c2ff8f Remove super user privilege requirement for
NameNode.getServiceStatus. Contributed by Chao Sun.
discard 794096f YARN-8559. Expose mutable-conf scheduler's configuration in
RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
discard 04be932 delete maxpermsize for testing
discard 4819127 drop thread/dn counts in various tests to avoid OOM errors
discard 9bd32e3 add --no-cache to try to repro branch-2 build failures
add 7abffe4 YARN-8559. Expose mutable-conf scheduler's configuration in
RM /scheduler-conf endpoint. Contributed by Weiwei Yang.
add 305b9a6 Remove super user privilege requirement for
NameNode.getServiceStatus. Contributed by Chao Sun.
add ad5c330 HDFS-13813. Exit NameNode if dangling child inode is detected
when saving FsImage. Contributed by Siyao Meng.
add a44e53a YARN-8640. Restore previous state in container-executor after
failure. Contributed by Jim Brennan
add 04c8b5d HDFS-13758. DatanodeManager should throw exception if it has
BlockRecoveryCommand but the block is not under construction. Contributed by
chencan.
add e2210a5 YARN-8612. Fix NM Collector Service Port issue in
YarnConfiguration. Contributed by Prabha Manepalli.
add 8056472 HADOOP-15674. Test failure
TestSSLHttpServer.testExcludedCiphers with
TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256 cipher suite. Contributed by Szilard
Nemeth.
add c68d1d4 YARN-8679. [ATSv2] If HBase cluster is down for long time,
high chances that NM ContainerManager dispatcher get blocked. Contributed by
Wangda Tan.
add 18ebe18 HDFS-13750. RBF: Router ID in RouterRpcClient is always null.
Contributed by Takanobu Asanuma.
add 1a53aab YARN-8129. Improve error message for invalid value in fields
attribute. Contributed by Abhishek Modi.
add 89da0e9 YARN-8581. [AMRMProxy] Add sub-cluster timeout in
LocalityMulticastAMRMProxyPolicy. Contributed by Botong Huang.
add 8e6807e YARN-8673. [AMRMProxy] More robust responseId resync after an
YarnRM master slave switch. Contributed by Botong Huang.
add 8e09ff9 HDFS-13821. RBF: Add
dfs.federation.router.mount-table.cache.enable so that users can disable cache.
Contributed by Fei Hui.
add ac7eef4 HADOOP-15689. Add "*.patch" into .gitignore file of branch-2.
Contributed by Rui Gao.
add 947b9a2 HADOOP-14314. The OpenSolaris taxonomy link is dead in
InterfaceClassification.md. Contributed by Rui Gao.
add c4e3df2 YARN-8649. NPE in localizer hearbeat processing if a
container is killed while localizing. Contributed by lujie
add 64681a3 HDFS-13848. Refactor NameNode failover proxy providers.
Contributed by Konstantin Shvachko.
add 361d0e4 HDFS-13831. Make block increment deletion number
configurable. Contributed by Ryan Wu.
add 548a595 YARN-8705. Refactor the UAM heartbeat thread in preparation
for YARN-8696. Contributed by Botong Huang.
add d4a3be9 HADOOP-15699. Fix some of testContainerManager failures in
Windows. Contributed by Botong Huang.
add bb0e75f YARN-8697. LocalityMulticastAMRMProxyPolicy should fallback
to random sub-cluster when cannot resolve resource. Contributed by Botong Huang.
add 2a8f4ae HDFS-13854. RBF: The ProcessingAvgTime and ProxyAvgTime
should display by JMX with ms unit. Contributed by yanghuafeng.
add 8137b47 HDFS-13634. RBF: Configurable value in xml for async
connection request queue size. Contributed by CR Hota.
add 21aa7f1 YARN-8051: TestRMEmbeddedElector#testCallbackSynchronization
is flakey. Contributed by Robert Kanter and Jason Lowe.
add 4e342f6 HADOOP-15547/ WASB: improve listStatus performance.
Contributed by Thomas Marquardt.
add 5902c06 HADOOP-10219. ipc.Client.setupIOstreams() needs to check for
ClientCache.stopClient requested shutdowns. Contributed by Kihwal Lee and Lukas
Majercak.
add 2e744bd HDFS-13857. RBF: Choose to enable the default nameservice to
read/write files. Contributed by yanghuafeng.
add 0468b6e HDFS-13812. Fix the inconsistent default refresh interval on
Caching documentation. Contributed by Hrishikesh Gadre.
add f6e4b13 HADOOP-15657 Registering MutableQuantiles via Metric
annotation. Contributed by Sushil Ks
add 3eb70d4 MAPREDUCE-7131. Job History Server has race condition where
it moves files from intermediate to finished but thinks file is in
intermediate. Contributed by Anthony Hsu
add 1b12925 HDFS-13836. RBF: Handle mount table znode with null value.
Contributed by yanghuafeng.
add 6c8fc8f HADOOP-15731. TestDistributedShell fails on Windows.
Contributed by Botong Huang.
add e56f183 HDFS-12716. 'dfs.datanode.failed.volumes.tolerated' to
support minimum number of volumes to be available. Contributed by Ranith Sardar
add 121cefd YARN-8709: CS preemption monitor always fails since one
under-served queue was deleted. Contributed by Tao Yang.
add a7b9e7d HDFS-13051. Fix dead lock during async editlog rolling if
edit queue is full. Contributed by Daryn Sharp.
add 9befa5e HDFS-13902. Add JMX, conf and stacks menus to the datanode
page. Contributed by fengchuang.
add bbd0987 HDFS-13914. Fix DN UI logs link broken when https is enabled
after HDFS-13902. Contributed by Jianfei Jiang.
add 1e61f38 MAPREDUCE-7133. History Server task attempts REST API returns
invalid data. Contributed by Oleksandr Shevchenko
add 9bd2616 HDFS-13844. Fix the fmt_bytes function in the dfs-dust.js.
Contributed by yanghuafeng.
add f6ab07e HADOOP-15759. AliyunOSS: Update oss-sdk version to 3.0.0.
Contributed by Jinhu Wu.
add 97a13eb MAPREDUCE-3801:
org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator
fails intermittently. Contributed by Jason Lowe
add 88e2ca4 HADOOP-15755. StringUtils#createStartupShutdownMessage throws
NPE when args is null. Contributed by Lokesh Jain and Dinesh Chitlangia
add f5cc9f7 MAPREDUCE-7137. MRAppBenchmark.benchmark1() fails with
NullPointerException. Contributed by Oleksandr Shevchenko
add 726aee3 MAPREDUCE-7138. ThrottledContainerAllocator in MRAppBenchmark
should implement RMHeartbeatHandler. Contributed by Oleksandr Shevchenko
add 3e476dc HDFS-13908. TestDataNodeMultipleRegistrations is flaky.
Contributed by Ayush Saxena.
add 0dd6861 HADOOP-15772. Remove the 'Path ... should be specified as a
URI' warnings on startup. Contributed by Ayush Saxena.
add 5b77991 HADOOP-15748. S3 listing inconsistency can raise NPE in
globber. Contributed by Steve Loughran.
add 3a6ad9c HADOOP-15726. Create utility to limit frequency of log
statements. Contributed by Erik Krogen.
add 6056597 YARN-8658. [AMRMProxy] Metrics for AMRMClientRelayer inside
FederationInterceptor. Contributed by Young Chen.
add 6937925 YARN-8696. [AMRMProxy] FederationInterceptor upgrade: home
sub-cluster heartbeat async. Contributed by Botong Huang.
add c617dba HADOOP-15671. AliyunOSS: Support Assume Roles in AliyunOSS.
Contributed by Jinhu Wu.
add 4d69741 YARN-7974. Allow updating application tracking url after
registration. (Jonathan Hung via asuresh)
add 3d67080 HDFS-13790. RBF: Move ClientProtocol APIs to its own module
Contributed by Chao Sun.
add 1b0a110 YARN-8804. resourceLimits may be wrongly calculated when
leaf-queue is blocked in cluster with 3+ level queues. Contributed by Tao Yang
add d7d0e55 YARN-8774. Memory leak when CapacityScheduler allocates from
reserved container with non-default label. Contributed by Tao Yang.
add 57caab6 YARN-8760. [AMRMProxy] Fix concurrent re-register due to
YarnRM failover in AMRMClientRelayer. Contributed by Botong Huang.
add 1505058 MAPREDUCE-6896. Document wrong spelling in usage of
MapredTestDriver tools. (Contributed by LiXin Ge via Daniel Templeton)
add 65aaa10 YARN-8840. Add missing cleanupSSLConfig() call for
TestTimelineClient test. Contributed by Aki Tanaka.
add 7b88a57 HADOOP-15817. Reuse Object Mapper in KMSJSONReader.
Contributed by Jonathan Eagles.
add d7e9ea3 HADOOP-15820. ZStandardDecompressor native code sets an
integer field as a long. Contributed by Jason Lowe
add 5539dd9 HDFS-13964. RBF: TestRouterWebHDFSContractAppend fails with
No Active Namenode under nameservice. Contributed by Ayush Saxena.
add c632c6e HDFS-13768. Adding replicas to volume map makes DataNode
start slowly. Contributed by Surendra Singh Lilhore.
add fa4a111 HADOOP-15818. Fix deprecated maven-surefire-plugin
configuration in hadoop-kms module
add b0900ad YARN-7652. Handle AM register requests asynchronously in
FederationInterceptor. Contributed by Botong Huang.
add d412785 YARN-8720. CapacityScheduler does not enforce max resource
allocation check at queue level. Contributed by Tarun Parimi.
add cc1bf7f YARN-8858. CapacityScheduler should respect maximum node
resource when per-queue maximum-allocation is being used. Contributed by Wangda
Tan.
add 7a5d27d YARN-6989 Ensure timeline service v2 codebase gets UGI from
HttpServletRequest in a consistent way. Contributed by Abhishek Modi
add 5da4963 HADOOP-15679. ShutdownHookManager shutdown time needs to be
configurable & extended.
add 91f18a5 YARN-7274. Ability to disable elasticity at leaf queue level.
(Zian Chen via wangda)
add 7ed627a YARN-3879 [Storage implementation] Create HDFS backing
storage implementation for ATS reads. Contributed by Abhishek Modi.
add 437bfa9 HADOOP-15837. DynamoDB table Update can fail S3A FS init.
Contributed by Steve Loughran.
add 0ba6210 HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed
by Fei Hui.
add e212d7d8 Fix potential FSImage corruption. Contributed by Daryn Sharp.
add e412d8f HADOOP-15859. ZStandardDecompressor.c mistakes a class for an
instance. Contributed by Jason Lowe
add 56a2728 YARN-7502. Nodemanager restart docs should describe
nodemanager supervised property. Contributed by Suma Shivaprasad.
add dbf36db YARN-8826. Fix lingering timeline collector after serviceStop
in TimelineCollectorManager. Contributed by Prabha Manepalli.
add ca69977 HADOOP-15822. zstd compressor can fail with a small output
buffer. Contributed by Jason Lowe.
add f2739f3 HADOOP-15850. CopyCommitter#concatFileChunks should check
that the blocks per chunk is not 0. Contributed by Ted Yu.
add a0aa610 HADOOP-15868. AliyunOSS: update document for properties of
multiple part download, multiple part upload and directory copy. Contributed by
Jinhu Wu.
add f23f339 HADOOP-15866. Renamed
HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility.
Contributed by Wei-Chiu Chuang.
add c19baf1 Addendum: Fix potential FSImage corruption. Contributed by
Xiao Chen.
add 62ec800 YARN-7225. Add queue and partition info to RM audit log.
Contributed by Eric Payne
add 81da8b2 YARN-8893. [AMRMProxy] Fix thread leak in AMRMClientRelayer
and UAM client. Contributed by Botong Huang.
add 731b90d YARN-8905. [Router] Add JvmMetricsInfo and pause monitor.
Contributed by Bilwa S T.
add 72ee45a HADOOP-15899. Update AWS Java SDK versions in NOTICE.txt.
add 939827d HADOOP-15900. Update JSch versions in LICENSE.txt.
add 98075d9 HDFS-14043. Tolerate corrupted seen_txid file. Contributed by
Lukas Majercak.
add d9b3b58 HDFS-14048. DFSOutputStream close() throws exception on
subsequent call after DataNode restart. Contributed by Erik Krogen.
add 5e433e5 MAPREDUCE-7156. NullPointerException when reaching max
shuffle connections. Contributed by Peter Bacsko
add ee1cb3b YARN-8233. NPE in CapacityScheduler#tryCommit when handling
allocate/reserve proposal whose allocatedOrReservedContainer is null.
Contributed by Tao Yang.
add b7ca20e YARN-8933. [AMRMProxy] Fix potential empty fields in
allocation response, move SubClusterTimeout to FederationInterceptor.
Contributed by Botong Huang.
add a86b665 HADOOP-15923. create-release script should set max-cache-ttl
as well as default-cache-ttl for gpg-agent.
add 3aac324 HADOOP-15917. AliyunOSS: fix incorrect ReadOps and WriteOps
in statistics. Contributed by Jinhu Wu.
add 4199086 HADOOP-15930. Exclude MD5 checksum files from release
artifact.
add c39e1ee HADOOP-15925. The config and log of gpg-agent are removed in
create-release script. Contributed by Dinesh Chitlangia.
add bc4098e HDFS-13963. NN UI is broken with IE11. Contributed by Ayush
Saxena.
add c3f0681 HDFS-14056. Fix error messages in HDFS-12716. Contributed by
Ayush Saxena.
add 311be88 HADOOP-15919. AliyunOSS: Enable Yarn to use OSS. Contributed
by wujinhu.
add 6cae964 Add 2.9.2 release notes and changes documents.
add d892d82 Update jdiff.stable.api from 2.9.1 to 2.9.2.
add 408f60e HADOOP-15943. AliyunOSS: add missing owner & group attributes
for oss FileStatus. Contributed by wujinhu.
add 50e11dc HDFS-13870. WebHDFS: Document ALLOWSNAPSHOT and
DISALLOWSNAPSHOT API doc. Contributed by Siyao Meng.
add a3470c6 HADOOP-15959. Revert "HADOOP-12751. While using kerberos
Hadoop incorrectly assumes names with '@' to be non-simple"
add 7456da9 YARN-9036. Escape newlines in health report in YARN UI.
Contributed by Keqiu Hu
add 74e4098 YARN-7794. SLSRunner is not loading timeline service jars,
causing failure.
add b98ffbe HADOOP-15950. Failover for LdapGroupsMapping. Contributed by
Lukas Majercak.
add a29eb49 Revert "HADOOP-15950. Failover for LdapGroupsMapping.
Contributed by Lukas Majercak."
add 5cef413 HADOOP-15950. Failover for LdapGroupsMapping. Contributed by
Lukas Majercak.
add eb8b1ea YARN-9085. Add Guaranteed and MaxCapacity to CSQueueMetrics
add 500b2a0 HADOOP-16008. Fix typo in CommandsManual.md
add d62bfaf HADOOP-15973. Configuration: Included properties are not
cached if resource is a stream. Contributed by Eric Payne
add 15286d9 YARN 9108. Fix FederationIntercepter merge home and secondary
allocate response typo. Contributed by Abhishek Modi.
add 10cc02f HDFS-14171. Performance improvement in Tailing EditLog.
Contributed by Kenneth Yang.
add c157ab4 HADOOP-16009. Replace the url of the repository in Apache
Hadoop source code.
add f804d7d HADOOP-16025. Update the year to 2019.
add 37e3661 HADOOP-15323. AliyunOSS: Improve copy file performance for
AliyunOSSFileSystemStore. Contributed wujinhu.
add 2c4e493 Revert "HADOOP-15759. AliyunOSS: Update oss-sdk version to
3.0.0. Contributed by Jinhu Wu."
add 2a416fe HADOOP-16030. AliyunOSS: bring fixes back from HADOOP-15671.
Contributed by wujinhu.
add c54a689 YARN-8833. Avoid potential integer overflow when computing
fair shares. Contributed by liyakun.
add 1684301 HADOOP-16016. TestSSLFactory#testServerWeakCiphers fails on
Java 1.8.0_191 or upper
add 1dbe6c9 HADOOP-16013. DecayRpcScheduler decay thread should run as a
daemon. Contributed by Erik Krogen.
new 3c984df testing
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (78030cc)
\
N -- N -- N refs/heads/branch-2-jhung-test (3c984df)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../java/org/apache/hadoop/conf/Configuration.java | 6 +-
.../org/apache/hadoop/ipc/DecayRpcScheduler.java | 2 +-
.../src/site/markdown/CommandsManual.md | 2 +-
.../apache/hadoop/cli/util/CommandExecutor.java | 8 +-
.../org/apache/hadoop/conf/TestConfiguration.java | 99 ++++++++++++++++++
.../org/apache/hadoop/crypto/key/TestKeyShell.java | 8 +-
.../apache/hadoop/fs/TestFsShellReturnCode.java | 16 +--
.../test/java/org/apache/hadoop/fs/TestTrash.java | 8 +-
.../apache/hadoop/fs/shell/TestXAttrCommands.java | 4 +-
.../apache/hadoop/ipc/TestDecayRpcScheduler.java | 4 +-
.../hadoop/security/alias/TestCredShell.java | 4 +-
.../apache/hadoop/security/ssl/TestSSLFactory.java | 3 +-
.../org/apache/hadoop/test/GenericTestUtils.java | 4 +-
.../java/org/apache/hadoop/util/TestClasspath.java | 8 +-
.../hadoop/util/TestNativeLibraryChecker.java | 4 +-
.../hadoop/crypto/key/kms/server/TestKMSAudit.java | 4 +-
.../federation/router/TestRouterAdminCLI.java | 18 ++--
.../blockmanagement/BlockManagerSafeMode.java | 7 +-
.../java/org/apache/hadoop/hdfs/DFSTestUtil.java | 8 +-
.../apache/hadoop/hdfs/TestBalancerBandwidth.java | 4 +-
.../java/org/apache/hadoop/hdfs/TestDFSShell.java | 88 ++++++++--------
.../apache/hadoop/hdfs/TestFsShellPermission.java | 4 +-
.../apache/hadoop/hdfs/TestMaintenanceState.java | 4 +-
.../java/org/apache/hadoop/hdfs/TestQuota.java | 12 +--
.../hadoop/hdfs/server/namenode/TestClusterId.java | 16 ++-
.../server/namenode/TestDecommissioningStatus.java | 4 +-
.../server/namenode/TestMetadataVersionOutput.java | 4 +-
.../namenode/snapshot/TestSnapshotDeletion.java | 8 +-
.../namenode/snapshot/TestSnapshotFileLength.java | 8 +-
.../namenode/snapshot/TestSnapshotRename.java | 8 +-
.../org/apache/hadoop/hdfs/tools/TestDFSAdmin.java | 8 +-
.../hadoop/hdfs/tools/TestDFSAdminWithHA.java | 8 +-
.../apache/hadoop/hdfs/tools/TestDFSHAAdmin.java | 9 --
.../apache/hadoop/hdfs/tools/TestDebugAdmin.java | 8 +-
.../offlineEditsViewer/TestOfflineEditsViewer.java | 4 +-
.../offlineImageViewer/TestOfflineImageViewer.java | 12 +--
.../java/org/apache/hadoop/tools/TestJMXGet.java | 4 +-
.../java/org/apache/hadoop/tools/TestTools.java | 8 +-
.../org/apache/hadoop/tracing/TestTraceAdmin.java | 8 +-
.../mapreduce/v2/hs/TestJobHistoryParsing.java | 4 +-
.../org/apache/hadoop/mapred/TestNetworkedJob.java | 10 +-
.../hadoop/mapred/pipes/TestPipeApplication.java | 6 +-
.../apache/hadoop/mapreduce/TestMRJobClient.java | 8 +-
hadoop-project/pom.xml | 4 +-
hadoop-project/src/site/site.xml | 2 +-
.../fs/aliyun/oss/AliyunOSSCopyFileTask.java | 7 +-
.../hadoop/fs/aliyun/oss/AliyunOSSFileSystem.java | 10 +-
.../fs/aliyun/oss/AliyunOSSFileSystemStore.java | 31 ++----
.../aliyun/oss/AssumedRoleCredentialProvider.java | 115 ---------------------
.../org/apache/hadoop/fs/aliyun/oss/Constants.java | 22 ----
.../src/site/markdown/tools/hadoop-aliyun/index.md | 58 +----------
.../fs/aliyun/oss/TestAliyunCredentials.java | 30 +-----
.../aliyun/oss/TestAliyunOSSBlockOutputStream.java | 1 -
.../oss/TestAliyunOSSFileSystemContract.java | 14 +--
.../aliyun/oss/TestAliyunOSSFileSystemStore.java | 10 +-
.../oss/contract/TestAliyunOSSContractDistCp.java | 1 -
.../apache/hadoop/tools/TestHadoopArchives.java | 12 +--
.../hadoop/tools/TestDistCpSyncReverseBase.java | 8 +-
.../org/apache/hadoop/tools/TestDistCpSystem.java | 4 +-
.../org/apache/hadoop/tools/TestCopyFiles.java | 4 +-
.../java/org/apache/hadoop/tools/TestDistCh.java | 8 +-
.../mapred/gridmix/TestGridmixSubmission.java | 4 +-
.../hadoop/streaming/TestDumpTypedBytes.java | 4 +-
.../java/org/apache/hadoop/streaming/UtilTest.java | 4 +-
.../hadoop/yarn/client/cli/TestClusterCLI.java | 2 +-
.../apache/hadoop/yarn/client/cli/TestLogsCLI.java | 4 +-
.../hadoop/yarn/client/cli/TestRMAdminCLI.java | 16 +--
.../hadoop/yarn/client/cli/TestSchedConfCLI.java | 4 +-
.../apache/hadoop/yarn/client/cli/TestYarnCLI.java | 2 +-
.../TestLogAggregationIndexFileController.java | 4 +-
.../hadoop/registry/cli/TestRegistryCli.java | 2 +-
.../amrmproxy/FederationInterceptor.java | 5 +-
.../amrmproxy/TestFederationInterceptor.java | 75 ++++++++++++++
.../scheduler/fair/policies/ComputeFairShares.java | 70 ++++++++-----
.../scheduler/fair/FakeSchedulable.java | 15 ++-
.../scheduler/fair/TestComputeFairShares.java | 89 +++++++++++++---
.../yarn/server/router/webapp/JavaProcess.java | 2 +-
77 files changed, 580 insertions(+), 537 deletions(-)
delete mode 100644
hadoop-tools/hadoop-aliyun/src/main/java/org/apache/hadoop/fs/aliyun/oss/AssumedRoleCredentialProvider.java
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
