This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch hadoop-3.4.2
in repository https://gitbox.apache.org/repos/asf/doris-thirdparty.git
at 84e8b89ee2e HADOOP-19657. Updates site landing page. (#7887)
This branch includes the following new commits:
new 9e0b1be3f18 Preparing for 3.4.1 development
new 3bb2ee6af0a HDFS-17312. packetsReceived metric should ignore heartbeat
packet. (#6394)
new eb959cb8852 HADOOP-19034. Fix Download Maven Url Not Found. (#6438).
Contributed by Shilun Fan.
new fa80205ad70 HADOOP-19031. Enhance access control for RunJar. (#6427).
Contributed by He Xiaoqiao.
new 67d985620fd HADOOP-19040. mvn site commands fails due to MetricsSystem
And MetricsSystemImpl changes. (#6450) Contributed by Shilun Fan.
new a38d9026779 YARN-11634. [Addendum] Speed-up TestTimelineClient. (#6419)
new 76887c1b497 Revert "HDFS-16016. BPServiceActor to provide new thread
to handle IBR (#2998)" (#6457) Contributed by Shilun Fan.
new a8818989fdd HADOOP-19038. Improve create-release RUN script. (#6448)
Contributed by Shilun Fan.
new 0898b08d68c HADOOP-18894: upgrade sshd-core due to CVEs (#6060)
Contributed by PJ Fanning.
new a013f06fe5c Revert "HADOOP-18823. Add Labeler Github Action. (#5874).
Contributed by Ayush Saxena."
new 965cb913c39 HADOOP-19004. S3A: Support Authentication through
HttpSigner API (#6324)
new 8c1bc42bf07 HADOOP-19027. S3A: S3AInputStream doesn't recover from
HTTP/channel exceptions (#6425)
new 6591038063c HADOOP-18975 S3A: Add option fs.s3a.endpoint.fips to use
AWS FIPS endpoints (#6277)
new 736ea5e04b5 HADOOP-19015. Increase fs.s3a.connection.maximum to 500
to minimize risk of Timeout waiting for connection from pool. (#6372)
new e13bd988bda HADOOP-19033. S3A: disable checksums when
fs.s3a.checksum.validation = false (#6441)
new 3f03d784dcf HADOOP-19039. Hadoop 3.4.0 Highlight big features and
improvements. (#6462) Contributed by Shilun Fan.
new 7212fbf7ffa HADOOP-19051: Highlight Capacity Scheduler new features in
release for the release 3.4.0 (#6500) Contributed by Benjamin Teke.
new c08d891b924 HADOOP-19046. S3A: update AWS V2 SDK to 2.23.5; v1 to
1.12.599 (#6467)
new 5657c361ece HADOOP-18883. [ABFS]: Expect-100 JDK bug resolution:
prevent multiple server calls (#6022)
new f2cc3655934 HADOOP-19045. S3A: Validate CreateSession Timeout
Propagation (#6470)
new 91ba4848b36 HADOOP-18830. Cut S3 Select (#6144)
new 19c7952aa8a HDFS-17359. EC: recheck failed streamers should only after
flushing all packets. (#6503). Contributed by farmmamba.
new 2e586c12e53 HADOOP-18987. Various fixes to FileSystem API docs (#6292)
new 45eca9e107a HADOOP-19044. S3A: AWS SDK V2 - Update region logic (#6479)
new 36c15c5c8eb HADOOP-19049. Fix StatisticsDataReferenceCleaner
classloader leak (#6488)
new 79ae5166290 HDFS-17370. Fix junit dependency for running parameterized
tests in hadoop-hdfs-rbf (#6522)
new 6dd0f1299ff HADOOP-19045. CreateSession Timeout - followup (#6532)
new 56f3bd998b1 HADOOP-18993. Add option fs.s3a.classloader.isolation
(#6301)
new 2d14dbce3ca HADOOP-19059. S3A: Update AWS Java SDK to 2.23.19 (#6538)
new e40f696c448 HADOOP-18980. S3A credential provider remapping: make
extensible (#6406)
new 02c1273ceb9 HADOOP-19056. Highlight RBF features and improvements
targeting version 3.4. (#6512) Contributed by Takanobu Asanuma.
new 6190423505f YARN-11639. CME and NPE in
PriorityUtilizationQueueOrderingPolicy (#6455)
new e6eeaa05abd HADOOP-19069. Use hadoop-thirdparty 1.2.0. (#6533)
Contributed by Shilun Fan
new 3b115da8dd9 HDFS-17362. RBF: Implement
RouterObserverReadConfiguredFailoverProxyProvider (#6510)
new f1927ede7cb HADOOP-19057. S3A: Landsat bucket used in tests no longer
accessible (#6515)
new ad8b6541117 HADOOP-18088. Replace log4j 1.x with reload4j. (#4052)
new 209729bb38c YARN-11657. Remove protobuf-2.5 from hadoop-yarn-api
module (#6575)
new 80b4bb68159 HADOOP-19084. Prune hadoop-common transitive dependencies
(#6574)
new 175f245107f HADOOP-19065. Update Protocol Buffers installation to
3.21.12 (#6576) Contributed by Zhaobo Huang.
new 552452ba213 HDFS-17333. DFSClient supports lazy resolution from
hostname to IP. (#6430)
new 65a2bdeeead HADOOP-19099. Add Protobuf Compatibility Notes (#6607)
Contributed by Shilun Fan.
new a7a1aac6c6f HADOOP-19097. S3A: Set fs.s3a.connection.establish.timeout
to 30s (#6601)
new 397c10abbd3 HADOOP-19082: S3A: Update AWS SDK V2 to 2.24.6 (#6568)
new fcc6ef6b10e HDFS-17404. Add NN Socket Address to log when processing
command from active NN (#6598)
new 88129202a6e HDFS-17299. Adding rack failure tolerance when creating a
new file (#6566)
new 3cc93d7bc1a HADOOP-19043. S3A: Regression: ITestS3AOpenCost fails on
prefetch test runs (#6465)
new 9009001143d HADOOP-19066. S3A: AWS SDK V2 - Enabling FIPS should be
allowed with central endpoint (#6539)
new 649213bc6d4 Hadoop-18759: [ABFS][Backoff-Optimization] Have a Static
retry policy for connection timeout. (#5881)
new fbfa10d9b00 HADOOP-18910: [ABFS] Adding Support for MD5 Hash based
integrity verification of the request content during transport (#6069)
new 37b75b8303b HADOOP-19119. Spotbugs: possible NPE in
org.apache.hadoop.crypto.key.kms.ValueQueue.getSize() (#6642)
new f33d01cff1c HDFS-17432. Fix junit dependency to enable JUnit4 tests to
run in hadoop-hdfs-rbf (#6639)
new fd89c0d29fb HADOOP-19089: [ABFS] Reverting Back Support of setXAttr()
and getXAttr() on root path (#6592)
new 7a9a2b22229 HADOOP-19116. Update to zookeeper client 3.8.4 due to
CVE-2024-23944. (#6638)
new 6713a96e536 HDFS-17441. Fix junit dependency by adding missing library
in hadoop-hdfs-rbf. (#6669)
new 317d2db219f HDFS-17354:Delay invoke
clearStaleNamespacesInRouterStateIdContext during router start up (#6498)
new 0683ba34fee HDFS-17435. Fix TestRouterRpc failed (#6650)
new 66b0edf7d65 HADOOP-19088. Use jersey-json 1.22.0 (#6585) (#6626)
new b419c3a306d HADOOP-18980. Invalid inputs for
getTrimmedStringCollectionSplitByEquals (ADDENDUM) (#6546)
new f2ea733732f HADOOP-19047: S3A: Support in-memory tracking of Magic
Commit data (#6468)
new 193c72c1e41 HADOOP-19115. Upgrade to nimbus-jose-jwt 9.37.2 due to
CVE-2023-52428. (#6637) (#6682) Contributed by PJ Fanning.
new 30a303b13e0 HADOOP-19024. Use bouncycastle jdk18 1.77 (#6410).
Contributed by PJ Fanning
new 19b3d6848f9 HDFS-17450. Add explicit dependency on httpclient jar
(#6130). Contributed by PJ Fanning
new ca4599b3d8b HADOOP-19123. Update to commons-configuration2 2.10.1 due
to CVE (#6661). Contributed by PJ Fanning
new 0cc807b05c6 HADOOP-19141. Vector IO: Update default values
consistently (#6702)
new 33bbcfa4b04 HADOOP-19098. Vector IO: Specify and validate ranges
consistently. #6604
new e0fcb173964 HADOOP-19124. Update org.ehcache from 3.3.1 to 3.8.2.
(#6665) (#6705) Contributed by Shilun Fan.
new 80662741870 YARN-11663. [Federation] Add Cache Entity Nums Limit.
(#6662) Contributed by Shilun Fan.
new d02ca966ea3 HADOOP-19135. Remove Jcache 1.0-alpha. (#6695) Contributed
by Shilun Fan.
new a715858ac2f Revert "HADOOP-16822. Provide source artifacts for
hadoop-client-api. Contributed by Karel Kolman." (#6458)
new 8c12f28af2b HADOOP-19096. [ABFS] [CST Optimization] Enhance
Client-Side Throttling Metrics Logic (#6276)
new 939c962fa80 HADOOP-19079. HttpExceptionUtils to verify that loaded
class is really an exception before instantiation (#6557)
new 01c0a1346fd HADOOP-19129: [ABFS] Test Fixes and Test Script Bug Fixes
(#6676)
new 4e96b8e8843 HADOOP-18656. [ABFS] Add Support for Paginated Delete for
Large Directories in HNS Account (#6409) (#6718)
new 1bd88a80dba HADOOP-19102. [ABFS] FooterReadBufferSize should not be
greater than readBufferSize (#6617)
new 0108a94c5b2 YARN-11684. Fix general contract violation in
PriorityQueueComparator. (#6753) Contributed by Tamas Domok.
new 89ebb97b0a2 YARN-11191. Fix potentional deadlock in GlobalScheduler
refreshQueues. (#6768) Contributed by Tamas Domok.
new 1ec46fc6925 HADOOP-19150: [ABFS] Fixing Test Code for
ITestAbfsRestOperationException#testAuthFailException (#6756)
new d42ac763f76 HADOOP-19159. S3A. Fix documentation of
fs.s3a.committer.abort.pending.uploads (#6778)
new 26bd557572a HADOOP-19146. S3A: noaa-cors-pds test bucket access with
global endpoint fails (#6723)
new 504754b4c3a HADOOP-19160. hadoop-auth should not depend on
kerb-simplekdc (#6791)
new 49da40426b5 HADOOP-19170. Fixes compilation issues on non-Linux
systems (#6822)
new affb7259006 MAPREDUCE-7474. Improve Manifest committer resilience
(#6716)
new 707246f8d7c HADOOP-19172. S3A: upgrade AWS v1 sdk to 1.12.720 (#6823)
new 8a7ec5cf871 HADOOP-19013. Adding
x-amz-server-side-encryption-aws-kms-key-id in the get file attributes for S3A.
(#6646)
new 82f6d1184c8 MAPREDUCE-7475. Fix non-idempotent unit tests (#6785)
(#6837)
new 2428368a747 HADOOP-18679. Add API for bulk/paged delete of files
(#6726)
new 183a1f15097 HADOOP-19184. S3A Fix
TestStagingCommitter.testJobCommitFailure (#6843)
new f0a24849e84 HADOOP-19188. Fix TestHarFileSystem and
TestFilterFileSystem failing after bulk delete API got added. (#6848)
new ac8a890f93a HADOOP-18679. Followup: change method name case (#6854)
new 34ecfd0265d HADOOP-19190. Skip
ITestS3AEncryptionWithDefaultS3Settings.testEncryptionFileAttributes when
bucket not encrypted with sse-kms (#6859)
new 935bc184fa2 HADOOP-19114. Upgrade to commons-compress 1.26.1 due to
CVEs. (#6636)
new f2e16c58695 HADOOP-19178: [WASB Deprecation] Updating Documentation on
Upcoming Plans for Hadoop-Azure (#6862)
new 59b29800bdc HADOOP-19154. Upgrade bouncycastle to 1.78.1 due to CVEs
(#6755) (#6866)
new 93c787be00d HADOOP-18516: [ABFS][Authentication] Support Fixed SAS
Token for ABFS Authentication (#6552)
new 5826b15fe6a HADOOP-19189. ITestS3ACommitterFactory failing (#6857)
new b69e7d1e2b6 HADOOP-19137. [ABFS] Prevent ABFS initialization for
non-hierarchal-namespace account if Customer-provided-key configs given.
(#6752) (#6880)
new 5693cc69b8a HADOOP-19196. Allow base path to be deleted as well using
Bulk Delete. (#6872)
new 4eeb10318f0 HADOOP-19192. Log level is WARN when fail to load native
hadoop libs (#6863)
new acec539ab33 HADOOP-18931. FileSystem.getFileSystemClass() to log the
jar the .class came from (#6197)
new 3173b72aeaa HADOOP-18508. S3A: Support parallel integration test runs
on same bucket (#5081)
new 468b7e5ab2d HADOOP-18610: [ABFS] [Backport to 3.4] OAuth2 Token
Provider support for Azure Workload Identity (#6881)
new 30aaad808ac HADOOP-19204. VectorIO regression: empty ranges are now
rejected (#6887)
new b8a390122fd HADOOP-19203. WrappedIO BulkDelete API to raise IOEs as
UncheckedIOExceptions (#6885)
new 2b46ca4ba59 HADOOP-19194:Add test to find unshaded dependencies in the
aws sdk (#6865)
new b5e21f94950 HADOOP-19210. S3A: Speed up some slow unit tests (#6907)
new b7630e2b36b HADOOP-19205. S3A: initialization/close slower than with
v1 SDK (#6892)
new fc86a52c884 HADOOP-19195. S3A: Upgrade aws sdk v2 to 2.25.53 (#6900)
new 69806dee9da HADOOP-19222. Switch yum repo baseurl due to CentOS 7
sunset (#6932) Contributed by Cheng Pan.
new 5f0b151652a HADOOP-19208: [ABFS] Fixing logic to determine HNS nature
of account to avoid extra getAcl() calls (#6893) (#6946)
new ef119c79316 HADOOP-19218 Avoid DNS lookup while creating IPC
Connection object (#6916). Contributed by Viraj Jasani.
new a005c432b26 HADOOP-19218. Addendum. Update TestFSNamesystemLockReport
to exclude hostname resolution from regex. (#6951). Contributed by Viraj Jasani.
new 414c4a2529a HADOOP-19161. S3A: option "fs.s3a.performance.flags" to
take list of performance flags (#6789) (#6966)
new e56bdfc2097 HADOOP-19238. Fix create-release script for arm64 based
MacOS (#6962)
new 071440c9242 HADOOP-19120. ApacheHttpClient adaptation in ABFS. (#6633)
new 029fb54b7b5 HDFS-17591. RBF: Router should follow X-FRAME-OPTIONS
protection setting (#6963)
new b9b650b8437 HADOOP-19245. S3ABlockOutputStream no longer sends
progress events in close() (#6974)
new d56e7153b11 HADOOP-19237. Upgrade to dnsjava 3.6.1 due to CVEs (#6961)
(#6971)
new 6dc13bdc077 HADOOP-17609. Make SM4 support optional for OpenSSL native
code. (#3019)
new 845f1f5e826 Preparing for 3.4.2 development
new 0755b93ce45 HADOOP-19072. S3A: expand optimisations on stores with
"fs.s3a.performance.flags" for mkdir (#6543)
new 54c90d70942 HADOOP-19072 S3A: Override fs.s3a.performance.flags for
tests (ADDENDUM 2) (#6993)
new 91c8360a385 HADOOP-19131. Assist reflection IO with WrappedOperations
class (#6686)
new d93e0b0f02a HADOOP-19153. hadoop-common exports logback as a
transitive dependency (#6999)
new 8a3a9509765 HADOOP-19136. Upgrade commons-io to 2.16.1. (#6704)
new ed23a83b3cc HADOOP-19253. Google GCS compilation fails due to VectorIO
changes (#7002)
new 337f2fc5660 HADOOP-18962. Upgrade kafka to 3.4.0 (#6247)
new a455823e879 HADOOP-19249. KMSClientProvider raises NPE with unauthed
user (#6984)
new e4d46d89e75 HADOOP-18542. Keep MSI tenant ID and client ID optional
(#4262)
new 6bee9db424a HADOOP-19248. Protobuf code generate and replace should
happen together (#6975)
new edfd10e0be7 HADOOP-19257. S3A:
ITestAssumeRole.testAssumeRoleBadInnerAuth failure (#7021)
new 343bf5ffdb8 HADOOP-18938. S3A: Fix endpoint region parsing for vpc
endpoints. (#6466)
new 6d66a003d84 HADOOP-19252. Upgrade hadoop-thirdparty from 1.2.0 to
1.3.0 (#7007) (#7014)
new 87e4b0a3a08 HDFS-16084. Fix getJNIEnv crash due to incorrect state set
to tls var (#6969). Contributed by Kevin Cai.
new 5635e34e5f2 HADOOP-19201 S3A. Support external-id in assume role
(#6876)
new b8d14d94ac2 HADOOP-19262. Upgrade wildfly-openssl:1.1.3.Final to
2.1.4.Final to support Java17+ (#7032)
new ea4137b0100 HADOOP-19250. Fix test
TestServiceInterruptHandling.testRegisterAndRaise. (#7020)
new 97abdb447aa HADOOP-19221. S3A: Unable to recover from failure of
multipart block upload attempt (#6938) (#7044)
new 42bd83366a3 HADOOP-19271. NPE in
AbfsManagedApacheHttpConnection.toString() when not connected (#7040)
new f3600d28ab9 HADOOP-19272. S3A: AWS SDK 2.25.53 warnings logged by
transfer manager (#7048)
new f01adaf855c HADOOP-19279. ABFS: Disabling Apache Http Client as
Default Http Client for ABFS Driver(#7055)
new e268d017c3b HADOOP-19164. Hadoop CLI MiniCluster is broken (#7050).
Contributed by Ayush Saxena.
new 4b386455214 HADOOP-19285. [ABFS] Restore ETAGS_AVAILABLE to abfs path
capabilities (#7064)
new afe644c88dd HADOOP-19281. MetricsSystemImpl should not print INFO
message in CLI (#7071)
new cf699efcaa7 HADOOP-19284: [ABFS] Allow "fs.azure.account.hns.enabled"
to be set as Account Specific Config (#7062) (#7076)
new 8d60333447c HDFS-17376. Distcp creates Factor 1 replication file on
target if Source is EC. (#6540) (#7073)
new 35e88705f70 HADOOP-19261. Support force close a DomainSocket for
server service (#7057)
new bb9bbc06e86 HADOOP-19294. NPE on maven enforcer with -Pnative on arm
mac (#7082)
new b0102360368 HADOOP-19288. hadoop-client-runtime to exclude dnsjava
InetAddressResolverProvider (#7070)
new 9a53df2c0bf HADOOP-19290. Operating on / in ChecksumFileSystem throws
NPE. (#7074). Contributed by Ayush Saxena.
new 404e05905e8 HDFS-17381. Distcp of EC files should not be limited to
DFS. (#6551)
new 520ded41d2b HDFS-17461. Fix spotbugs in PeerCache#getInternal (#6721).
new 7303f5be569 HADOOP-19299. HttpReferrerAuditHeader resilience (#7095)
new cf5800a9827 HADOOP-19286: S3A: Support cross region access when S3
region/endpoint is set (#7093) (#7067)
new db00daabbac HADOOP-19295. S3A: large uploads can timeout over slow
links (#7089) (#7100)
new af0b841c85d HADOOP-19107. Drop support for HBase v1 timeline service &
upgrade HBase v2 (#6629). (#7017)
new 23f45d0b26d HADOOP-19291. RawLocalFileSystem to allow overlapping
ranges (#7101)
new 85b5bd2a2df HADOOP-19219. Add JPMS options required by hadoop-common
(#7084) (#7091)
new 0fc27df8511 YARN-11732. Fix potential NPE when calling
SchedulerNode#reservedContainer for CapacityScheduler (#7065). Contributed by
Tao Yang.
new 4b3438a9981 HADOOP-19310. (3.4) Add JPMS options required by Java 17+
(#7114) (#7118)
new 3809627d1b2 HADOOP-15760. Upgrade commons-collections to
commons-collections4 (#7006) (#7097)
new 46fc04513d5 HADOOP-19309: S3A: CopyFromLocalFile operation fails when
the source file does not contain file scheme (#7113)
new f5cdb2658dd HADOOP-18583. Fix loading of OpenSSL 3.x symbols (#5256)
(#7149)
new 5a9404e4ba1 HADOOP-19297. [JDK17] Upgrade maven.plugin-tools.version
to 3.10.2 (#7125) (#7147) Contributed by Min Yan.
new 8a5350d05ea HADOOP-18960: [ABFS] Making Contract tests run in
sequential and Other Test Fixes (#7104) (#7153)
new b5b5e3f9c22 HADOOP-19330. S3A: Add LeakReporter; use in S3AInputStream
(#7151) (#7160)
new e3cba684cd8 HADOOP-19317. S3A: fs.s3a.connection.expect.continue
controls 100 CONTINUE behavior (#7134)
new 0b74fbe9479 HDFS-17637. [BackPort] Fix spotbugs in
HttpFSFileSystem#getXAttr (#7099) (#7195) Contributed by Hualong Zhang.
new eb656c016fa HADOOP-19197. S3A: Support AWS KMS Encryption Context
(#7193)
new b4f7b90655f YARN-11734. [BackPort] Fix spotbugs in
ServiceScheduler#load. (#7088) (#7204) Contributed by Hualong Zhang.
new 765a357085d HADOOP-19360. Disable releases for apache.snapshots repo
(#7221)
new 57d821e6aad HADOOP-19143. Upgrade commons-cli to 1.9.0. (#7126)
(#7146) Contributed by Min Yan.
new 46c1ee1a383 HADOOP-19367. Fix setting final field value on Java 17
(#7228)
new 23b0559dabc HADOOP-19357: [ABFS] Optimizations for Retry Handling and
Client Side Throttling (#7216) (#7234)
new 0cd6ab59390 YARN-11744. Tackle flaky test
testGetRunningContainersToKill (#7227) (#7241) Contributed by Cheng Pan.
new f1180b97126 HADOOP-19366. Install OpenJDK 17 in default ubuntu build
container (#7226) (#7240) Contributed by Cheng Pan.
new 36849dd7d44 HADOOP-19371. JVM GC Metrics supports ZGC pause time and
count (#7230) Contributed by cxzl25.
new fcefb62932e HADOOP-19187: [ABFS][FNSOverBlob][Backport to 3.4]
AbfsClient Refactoring to Support Multiple Implementation of Clients. (#7198)
new fa2fd60d4f9 HADOOP-19380. Update the year to 2025 (#7262). Contributed
by Ayush Saxena.
new f6b57131b3c HADOOP-19335. Bump netty to 4.1.116 due to CVE-2024-47535
(#7158). Contributed by PJ Fanning (#7259)
new 83cdbca1e66 HDFS-17080. fix ec connection leak. (#5807)
new 77844e9115c HDFS-17706. TestBlockTokenWithDFSStriped fails due to
closed streams. (#7275). Contribtued by Felix N.
new 0006912c4f0 HADOOP-19226: [ABFS][FNSOverBlob][Backport 3.4]
Implementing Azure Rest APIs on Blob Endpoint for AbfsBlobClient (#7253)
new 5dd6272561d HADOOP-19229. S3A/ABFS: Vector IO on cloud storage:
increase threshold for range merging (#7281)
new 2b83e2e2289 HADOOP-19207: [ABFS][FNSOverBlob] Response Handling of
Blob Endpoint APIs and Metadata APIs (#7210) (#7289)
new 07fdc1a48fa HADOOP-18325: ABFS: Add correlated metric support for ABFS
operations (#6314) (#7303)
new 0358b900d1e HADOOP-19280. [ABFS] Initialize client timer only if
metric collection is enabled (#7307)
new e5ce6c04596 HDFS-17711: Change fsimage loading progress percentage
discontinuous to continuous
new 8532d9e6f33 HADOOP-18325: [ABFS] Fix metric related test failures due
to missing config (#6847) (#7306)
new 3fc18c8afed HADOOP-19389: Optimize shell -text command I/O with
multi-byte read. (#7291)
new 7d699e5ffb7 HADOOP-19401: Improve error message when OS can't identify
the current user.
new 0a96b030253 YARN-11759: Fix log statement in
RMAppImpl#processNodeUpdate
new fd445c21545 HADOOP-19407: Update 3.4.1 docs landing page to highlight
changes shipped in the release.
new 5e4f963a46d HDFS-17724: Set recover.lease.on.close.exception as an
instance member in the DfsClientConf.java
new 7d377283f60 HADOOP-19375: Organize JDK version-specific code in IDEA
friendly approach
new 436d87174f3 HADOOP-19377: Avoid initializing useless HashMap in
protocolImplMapArray.
new 662faed88cd HADOOP-19232: [ABFS][FNSOverBlob][Backport 3.4]
Implementing Ingress Support with various Fallback Handling (#7272) (#7385)
new 302cf3661fc HADOOP-19233: [ABFS][FnsOverBlob][Backport 3.4]
Implementing Rename and Delete APIs over Blob Endpoint (#7392)
new 4a217aa3430 HADOOP-19448: [ABFS][FNSOverBlob][Optimizations] Reduce
Network Calls In Create and Mkdir Flow (#7353) (#7395)
new f7d352d070c HADOOP-19443: [ABFS][FnsOverBlob][Backport to 3.4]
Updating hadoop-azure Test Scripts and Adding Tests For Metadata APIs (#7400)
new fc388f782c1 HADOOP-19404: [ABFS][FNSOverBlob] Update documentation for
FNS Blob Onboard (#7341) (#7398)
new e76699bca2d HADOOP-18708: S3A: Support S3 Client Side Encryption(CSE)
(#6884)
new 382b347635b HADOOP-19354. S3A: S3AInputStream to be created by factory
under S3AStore (#7214)
new e72495b22f4 HADOOP-19336: S3A: Test failures after CSE support added
(#7164)
new 50e55eea1ec HADOOP-19349: S3A : Improve Client Side Encryption
Documentation (#7191)
new 21651565185 YARN-11745: Fix TimSort contract violation in
PriorityQueueComparator Class (#7278) (#7310)
new 08cfb233fb0 HADOOP-19456. Upgrade kafka to 3.9.0 to fix
CVE-2024-31141. (#7416) Contributed by Palakur Eshwitha Sai.
new 30eb66e68c2 HADOOP-19465. Upgrade to netty 4.1.118 due to
CVE-2025-24970 Contributed by PJ Fanning. (#7413) (#7423)
new 461276a9ba3 HADOOP-19393. [ABFS] Return FileAlreadyExistsException for
UnauthorizedBlobOverwrite Rename Errors (#7312) (#7403)
new cce6306478f HADOOP-19311 [branch-3.4]: [ABFS] Implement Backoff and
Read Footer metrics using IOStatistics Class (#7394)
new 298a3607136 HADOOP-19467: [ABFS][FnsOverBlob] Fixing Config Name and
Value in Documnatation (#7420) (#7429)
new 6eb1c4805dc HADOOP-19383: upgrade Mina 2.0.27 due to CVE-2024-52046
new 2814d917085 HADOOP-19450: [ABFS] Rename/Create path idempotency
client-level resolution (#7364) (#7436)
new 7be4f85c8d7 HADOOP-19303. VectorIO API: support pass-down of a
release() operator (#7418)
new 04ca53410be Integrate analytics accelerator into S3A. (#7471)
new b3ae9d1eb68 HADOOP-19152. Do not hard code security providers. (#6739)
(#7439)
new f05974ba0a4 YARN-11785. Race condition in QueueMetrics due to
non-thread-safe HashMap causes MetricsException. (#7459) Contributed by Tao
Yang.
new 0d284516562 YARN-11790. TestAmFilter#testProxyUpdate fails in some
networks (#7478) Contributed by Chris Nauroth.
new c122ff33b82 [YARN-11776] Handle NPE in the RMDelegationTokenIdentifier
if localServiceAddress is null (#7431) Contributed by Abhey Rana.
new f7a476eb22e HADOOP-19086. Update commons-logging to 1.3.0 (#7472)
new 7e682e0f976 YARN-11793: Remove grizzly-http-* dependencies from Hadoop
to avoid transitive inclusions.
new 474f5343a46 Revert "YARN-11793: Remove grizzly-http-* dependencies
from Hadoop to avoid transitive inclusions."
new 2789fa75f3a HDFS-17754. Add uriparser2 to notices (#7481)
new c7d631ec56f HADOOP-19400: Expand specification and contract test
coverage for InputStream reads.
new a5fb37e6547 HADOOP-18940. [ABFS] Remove commons IOUtils.close() from
AbfsOutputStream (#7506)
new 7f2bb435897 HADOOP-19446. ABFS: [FnsOverBlob][Tests] Add Tests For
Negative Scenarios Identified for Delete Operation (#7376) (#7522)
new 2c0c1299fef HADOOP-19445: ABFS: [FnsOverBlob][Tests] Add Tests For
Negative Scenarios Identified for Rename Operation (#7386) (#7525)
new 10bd4ccfbfc HDFS-17759. Explicitly depend on jackson-core in
hadoop-hdfs (#7508) Contributed by Istvan Toth.
new c7d292ecd10 HADOOP-19488 fix temporary directory creation (branch-3.4)
(#7530)
new cc0580c6ac4 HDFS-16644. java.io.IOException Invalid token in
javax.security.sasl.qop (#5962)
new 9d3082e1302 Revert "HDFS-14884. Add sanity check that zone key equals
feinfo key while setting Xattrs. Contributed by Mukul Kumar Singh." (#7529)
new fc5b23336b7 HADOOP-19444. [ABFS][FnsOverBlob][Tests] Add Tests For
Negative Scenarios Identified for Ingress Operations (#7572)
new 1ce05fd0961 HADOOP-19485. S3A: Upgrade AWS V2 SDK to 2.29.52 (#7479)
new 7646d889aae HADOOP-19485. S3A: Test Failures after SDK 2.29.52 Upgrade
new 02925dd4efe HADOOP-19455. S3A: Enable logging of SDK client metrics
new f3ec55b5911 HADOOP-19516. S3A: SDK reads content twice during PUT to
S3 Express store.
new d2e861dcb5a HADOOP-15224. S3A: Add option to set checksum on S3
objects (#7396) (#7550)
new ea5f65700a7 HADOOP-19474: [ABFS][FnsOverBlob] Listing Optimizations to
avoid multiple iteration over list response. (#7421) (#7581)
new 7827dc63204 HADOOP-19494: [ABFS][FnsOverBlob] Fix Case Sensitivity
Issue for hdi_isfolder metadata (#7496) (#7584)
new 0f1ddf45c78 HADOOP-19531. [ABFS][FnsOverBlob] Streaming List Path
Result Should Happen Inside Retry Loop (#7582) (#7585)
new 55472fe7ca4 HADOOP-19515. ABFS: Updating Documentations of Hadoop
Drivers for Azure (#7540) (#7595)
new a6b2a21ea80 HADOOP-19256. S3A: Support Conditional Writes (#7594)
new 8d353d56276 HADOOP-19471. [ABFS] Support Fixed SAS Token at Container
Level (#7461) (#7597)
new c293424de85 HADOOP-19497: [ABFS] Enable rename and create recovery
from client transaction id over DFS endpoint (#7509) (#7612)
new 8eb2211b3ff HDFS-17768. Observer namenode network delay causing empty
block location for getBatchedListing (#7593)
new bd7659e8fad HADOOP-19518. ABFS: [FNSOverBlob] WASB to ABFS Migration
Config Support Script (#7564) (#7625)
new a13f5307366 HADOOP-19543. [ABFS][FnsOverBlob] Remove Duplicates from
Blob Endpoint Listing Across Iterations (#7614) (#7632)
new 64ea869f050 HADOOP-19522: ABFS: [FnsOverBlob] Rename Recovery Should
Succeed When Marker File Exists with Destination Directory (#7559) (#7633)
new 5173c0e934d HADOOP-19546. Include cipher feature for HttpServer2 and
SSLFactory (#7629)
new c239f617a78 HADOOP-19315. Upgrade Apache Avro to 1.11.4 (#7128) (#7615)
new a43b2c94425 HDFS-17226. Building native libraries fails on Fedora 38.
(#6191)
new 24ce3c49560 HADOOP-19406. ABFS: [FNSOverBlob] Support User Delegation
SAS for FNS Blob (#7523) (#7649)
new 6fb831e9b4c HADOOP-19523. Upgrade to hadoop-thirdparty 1.4.0 (#7560)
(#7606)
new ebd1ab0f3b5 HADOOP-19527. S3A: Skip AAL tests if encryption is set.
(#7592) (#7604)
new 471e00d3760 HADOOP-19532. Update commons-lang3 to 3.17.0 (#7591)
(#7648) Contributed by Istvan Toth.
new 64bc773ad79 HADOOP-19480. S3A: Upgrades AAL version to 1.0.0. (#7469)
(#7603)
new 9aba17e1114 HADOOP-19542. S3A: Close AAL factory on service stop.
(#7616) (#7658)
new 7f170e9788f HADOOP-19548: [ABFS] Fix Logging in FSDataInputStream to
Mention Correct Buffersize (#7642) (#7660)
new 8194b823e92 HADOOP-19557. S3A: S3ABlockOutputStream to never
log/reject hflush() calls (#7662)
new 0e81a54b1c8 HADOOP-19551. Fix compilation error of native libraries on
newer GCC. (#7644)
new 02b4849886c Preparing for 3.4.2 release
new 16f7be78904 HADOOP-19572. [ABFS][BugFix] Empty Page Issue on
Subsequent ListBlob call with NextMarker (#7698) (#7709)
new f8e3a26cbd5 HADOOP-19567. S3A: error stack traces printed on analytics
stream factory close (#7701)
new 09870840ec3 updates SDK dependency to provided (#7688)
new a435bff946f HADOOP-19580. [ABFS][BugFix][Bakport 3.4.2]
IsNonEmptyDirectory Check should loop on listing using updated continuation
token (#7717)
new e5c3884de0c YARN-11713. yarn-ui build fails in ARM docker in MacOs
phantomjs error. (#7729)
new 8d15657b093 YARN-11712. Yarn-ui build fails in ARM docker looking for
python2. (#7730)
new 5986095d03e HADOOP-18568. magic committer optional cleanup
new 276526d4ebb HADOOP-18991 Remove commons-beanutils dependency from
Hadoop 3 (#7524) (#7778)
new 8c27442888f HADOOP-19576. S3A: Disable Purging Pending MPUs Before
Directory Purge (#7722)
new 09a4950b653 HADOOP-19225. Upgrade Jetty to 9.4.57.v20241219 due to
CVE-2024-8184 (#7116)
new e5a851d378a HADOOP-19384. S3A: Add support for
ProfileCredentialsProvider (#7284)
new 9677363829c HADOOP-19554. LocalDirAllocator still doesn't always
recover from directory deletion (#7683) (#7685)
new a1c1511c2c2 HADOOP-19573. S3A:
ITestS3AConfiguration.testDirectoryAllocatorDefval() failing (#7699)
new 6a4ea9b1155 HADOOP-19626. S3A: Updates AAL version to 1.2.1 (#7807)
(#7815)
new dc727079f42 HADOOP-18296. Memory fragmentation in ChecksumFileSystem
readVectored() (#7732)
new f0b48f7c8f6 HADOOP-19634 fix source header on LimitInputStream (#7821)
new 99f371d1535 Revert "HADOOP-19197. S3A: Support AWS KMS Encryption
Context (#7193)"
new 84db3333d68 Revert "S3A: updates SDK dependency to provided (#7688)"
(#7838)
new e1c0dee8818 HADOOP-19627. S3A: testIfMatchOverwriteWithOutdatedEtag()
fails when not using SSE-KMS #7816
new 84e8b89ee2e HADOOP-19657. Updates site landing page. (#7887)
The 280 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
