Author: ahmar
Date: Wed May 28 11:31:56 2025
New Revision: 77194
Log:
rc1 artifacts
Added:
dev/hadoop/hadoop-3.4.2-RC1/
dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md
dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.asc
dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.sha512
dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md
dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.asc
dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.sha512
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-rat.txt
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-rat.txt.asc
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-rat.txt.sha512
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-site.tar.gz (with props)
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-site.tar.gz.asc
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-site.tar.gz.sha512
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-src.tar.gz (with props)
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-src.tar.gz.asc
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2-src.tar.gz.sha512
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2.tar.gz (with props)
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2.tar.gz.asc
dev/hadoop/hadoop-3.4.2-RC1/hadoop-3.4.2.tar.gz.sha512
Added: dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md
==============================================================================
--- dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md (added)
+++ dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md Wed May 28 11:31:56 2025
@@ -0,0 +1,183 @@
+
+<!---
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+-->
+# Apache Hadoop Changelog
+
+## Release 3.4.2 - 2025-05-27
+
+
+
+### IMPORTANT ISSUES:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-19107](https://issues.apache.org/jira/browse/HADOOP-19107) | Drop
support for HBase v1 timeline service & upgrade HBase v2 | Major | . | Ayush
Saxena | Ayush Saxena |
+
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-19261](https://issues.apache.org/jira/browse/HADOOP-19261) | Support
force close a DomainSocket for server service | Major | . | Sammi Chen | Sammi
Chen |
+| [HADOOP-19197](https://issues.apache.org/jira/browse/HADOOP-19197) | S3A:
Support AWS KMS Encryption Context | Major | fs/s3 | Raphael Azzolini | |
+| [HDFS-17657](https://issues.apache.org/jira/browse/HDFS-17657) | The
balancer service supports httpserver. | Minor | balancer & mover | Zhaobo
Huang | Zhaobo Huang |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-19195](https://issues.apache.org/jira/browse/HADOOP-19195) | Upgrade
aws sdk v2 to 2.25.53 | Major | fs/s3 | Harshit Gupta | Harshit Gupta |
+| [YARN-11711](https://issues.apache.org/jira/browse/YARN-11711) | Improve
ServiceScheduler Code | Minor | scheduler, yarn | Shilun Fan | Shilun Fan |
+| [HADOOP-15760](https://issues.apache.org/jira/browse/HADOOP-15760) | Upgrade
commons-collections to commons-collections4 | Major | . | David Mollitor |
Nihal Jain |
+| [HADOOP-19281](https://issues.apache.org/jira/browse/HADOOP-19281) |
MetricsSystemImpl should not print INFO message in CLI | Major | metrics |
Tsz-wo Sze | Sarveksha Yeshavantha Raju |
+| [YARN-11734](https://issues.apache.org/jira/browse/YARN-11734) | Fix
spotbugs in ServiceScheduler#load | Major | yarn | Hualong Zhang | Hualong
Zhang |
+| [HADOOP-19349](https://issues.apache.org/jira/browse/HADOOP-19349) | S3A :
Improve Client Side Encryption Documentation | Major | documentation, fs/s3 |
Syed Shameerur Rahman | Syed Shameerur Rahman |
+| [HADOOP-19357](https://issues.apache.org/jira/browse/HADOOP-19357) | ABFS:
Optimizations for Retry Handling and Throttling | Minor | fs/azure | Manika
Joshi | Manika Joshi |
+| [HADOOP-19366](https://issues.apache.org/jira/browse/HADOOP-19366) | Install
OpenJDk 17 in default ubuntu build container | Major | build | Cheng Pan |
Cheng Pan |
+| [HADOOP-19371](https://issues.apache.org/jira/browse/HADOOP-19371) | JVM GC
Metrics supports ZGC pause time and count | Minor | common | dzcxzl | dzcxzl |
+| [HDFS-17711](https://issues.apache.org/jira/browse/HDFS-17711) | Change
fsimage loading progress percentage discontinuous to continuous | Minor | . |
Sungdong Kim | Sungdong Kim |
+| [HADOOP-19389](https://issues.apache.org/jira/browse/HADOOP-19389) |
Optimize shell -text command I/O with multi-byte read. | Minor | command, fs,
fs/azure, fs/gcs, fs/s3 | Chris Nauroth | Chris Nauroth |
+| [HADOOP-19375](https://issues.apache.org/jira/browse/HADOOP-19375) |
Organize JDK version-specific code in IDEA friendly approach | Major | . |
Cheng Pan | Cheng Pan |
+| [HADOOP-19377](https://issues.apache.org/jira/browse/HADOOP-19377) | Avoid
initializing useless HashMap in protocolImplMapArray. | Minor | common |
farmmamba | farmmamba |
+| [HADOOP-19086](https://issues.apache.org/jira/browse/HADOOP-19086) | Update
commons-logging to 1.3.0 | Minor | build | Steve Loughran | Steve Loughran |
+| [HDFS-17754](https://issues.apache.org/jira/browse/HDFS-17754) | Add
uriparser2 to notices | Minor | hdfs-client | Chris Nauroth | Chris Nauroth |
+| [HADOOP-19400](https://issues.apache.org/jira/browse/HADOOP-19400) | Expand
specification and contract test coverage for InputStream reads. | Major |
documentation, fs, test | Chris Nauroth | Chris Nauroth |
+| [HADOOP-19546](https://issues.apache.org/jira/browse/HADOOP-19546) | Include
cipher feature for HttpServer2 and SSLFactory | Major | hadoop-common, hdfs,
yarn | Bence Kosztolnik | Bence Kosztolnik |
+| [HDFS-17226](https://issues.apache.org/jira/browse/HDFS-17226) | Building
native libraries fails on Fedora 38 | Major | libhdfs++, native | Kengo Seki |
Kengo Seki |
+| [HADOOP-19523](https://issues.apache.org/jira/browse/HADOOP-19523) | Upgrade
to hadoop-thirdparty 1.4.0 | Major | build | Steve Loughran | Steve Loughran |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HDFS-17376](https://issues.apache.org/jira/browse/HDFS-17376) | Distcp
creates Factor 1 replication file on target if Source is EC | Major | distcp |
Sadanand Shenoy | Sadanand Shenoy |
+| [HDFS-16084](https://issues.apache.org/jira/browse/HDFS-16084) | getJNIEnv()
returns invalid pointer when called twice after getGlobalJNIEnv() failed |
Major | libhdfs | Antoine Pitrou | kevin cai |
+| [HADOOP-19248](https://issues.apache.org/jira/browse/HADOOP-19248) |
Protobuf code generate and replace should happen together | Major | common |
Cheng Pan | Cheng Pan |
+| [HADOOP-19250](https://issues.apache.org/jira/browse/HADOOP-19250) | Fix
test TestServiceInterruptHandling.testRegisterAndRaise | Major | test | Chenyu
Zheng | Chenyu Zheng |
+| [HADOOP-19272](https://issues.apache.org/jira/browse/HADOOP-19272) | S3A:
AWS SDK 2.25.53 warnings logged about transfer manager not using CRT client |
Major | fs/s3 | Steve Loughran | Steve Loughran |
+| [HADOOP-19164](https://issues.apache.org/jira/browse/HADOOP-19164) | Hadoop
CLI MiniCluster is broken | Major | . | Ayush Saxena | Ayush Saxena |
+| [HADOOP-19290](https://issues.apache.org/jira/browse/HADOOP-19290) |
Operating on / in ChecksumFileSystem throws NPE | Major | . | Ayush Saxena |
Ayush Saxena |
+| [HADOOP-19280](https://issues.apache.org/jira/browse/HADOOP-19280) | ABFS:
Initialize ABFS client timer only when metric collection is enabled | Major |
fs/azure | Manish Bhatt | Manish Bhatt |
+| [YARN-11732](https://issues.apache.org/jira/browse/YARN-11732) | Potential
NPE when calling SchedulerNode#reservedContainer for CapacityScheduler | Major
| capacityscheduler | Tao Yang | Tao Yang |
+| [HADOOP-19309](https://issues.apache.org/jira/browse/HADOOP-19309) | S3A
CopyFromLocalFile operation fails when the source file does not contain file
scheme. | Major | fs/s3 | Syed Shameerur Rahman | Syed Shameerur Rahman |
+| [HADOOP-18583](https://issues.apache.org/jira/browse/HADOOP-18583) | hadoop
checknative fails to load openssl 3.x | Major | native | Sebastian Klemke |
Sebastian Klemke |
+| [HADOOP-19106](https://issues.apache.org/jira/browse/HADOOP-19106) | [ABFS]
All tests of. ITestAzureBlobFileSystemAuthorization fails with NPE | Major |
fs/azure | Mukund Thakur | Anuj Modi |
+| [HADOOP-19360](https://issues.apache.org/jira/browse/HADOOP-19360) | Disable
releases for apache.snapshots repo | Major | build | Attila Doroszlai | Attila
Doroszlai |
+| [HADOOP-19382](https://issues.apache.org/jira/browse/HADOOP-19382) | [ABFS]
ITestAzureBlobFileSystemInitAndCreate failure | Minor | fs/azure, test | Steve
Loughran | Anuj Modi |
+| [HDFS-17706](https://issues.apache.org/jira/browse/HDFS-17706) |
TestBlockTokenWithDFSStriped fails due to closed streams | Minor | . | Felix N
| Felix N |
+| [YARN-11759](https://issues.apache.org/jira/browse/YARN-11759) | Fix log
statement in RMAppImpl#processNodeUpdate | Major | resourcemanager | yang yang
| yang yang |
+| [HDFS-17724](https://issues.apache.org/jira/browse/HDFS-17724) | Set
recover.lease.on.close.exception as an instance member in the
DfsClientConf.java | Minor | hadoop-client | Abhey Rana | Abhey Rana |
+| [YARN-11745](https://issues.apache.org/jira/browse/YARN-11745) | YARN
ResourceManager throws java.lang.IllegalArgumentExceptio: Comparison method
violates its general contract! | Major | yarn | chhinlinghean | chhinlinghean |
+| [YARN-11785](https://issues.apache.org/jira/browse/YARN-11785) | Race
condition in QueueMetrics due to non-thread-safe HashMap causes
MetricsException | Major | capacityscheduler | Tao Yang | Tao Yang |
+| [HDFS-17759](https://issues.apache.org/jira/browse/HDFS-17759) | Explicitly
depend on jackson-core in hadoop-hdfs | Critical | hdfs | Istvan Toth | Istvan
Toth |
+| [HDFS-16644](https://issues.apache.org/jira/browse/HDFS-16644) |
java.io.IOException Invalid token in javax.security.sasl.qop | Major | . |
Walter Su | Zilong Zhu |
+| [HDFS-15230](https://issues.apache.org/jira/browse/HDFS-15230) | Sanity
check should not assume key base name can be derived from version name | Major
| . | Wei-Chiu Chuang | Wei-Chiu Chuang |
+| [YARN-11810](https://issues.apache.org/jira/browse/YARN-11810) | Fix SQL
script in SQLServer/FederationStateStoreTables.sql | Major | federation |
Peter Szucs | Peter Szucs |
+| [HDFS-17768](https://issues.apache.org/jira/browse/HDFS-17768) | Observer
namenode network delay causing empty block location for getBatchedListing |
Major | namenode | Dimas Shidqi Parikesit | Dimas Shidqi Parikesit |
+| [HADOOP-19532](https://issues.apache.org/jira/browse/HADOOP-19532) | Update
commons-lang3 to 3.17.0 | Major | . | Istvan Toth | Istvan Toth |
+| [HADOOP-19551](https://issues.apache.org/jira/browse/HADOOP-19551) | Fix
compilation error of native libraries on newer GCC | Major | native | Masatake
Iwasaki | Masatake Iwasaki |
+| [YARN-11801](https://issues.apache.org/jira/browse/YARN-11801) | NPE in
FifoCandidatesSelector.selectCandidates when preempting resources for an
auto-created queue without child queues | Major | yarn | Susheel Gupta |
Susheel Gupta |
+
+
+### TESTS:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [YARN-11744](https://issues.apache.org/jira/browse/YARN-11744) | Tackle
flaky test testGetRunningContainersToKill | Major | test, yarn-service | Cheng
Pan | Cheng Pan |
+| [YARN-11790](https://issues.apache.org/jira/browse/YARN-11790) |
TestAmFilter#testProxyUpdate fails in some networks | Minor | test, webproxy |
Chris Nauroth | Chris Nauroth |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-18325](https://issues.apache.org/jira/browse/HADOOP-18325) | ABFS:
Add correlated metric support for ABFS operations | Major | fs/azure | Anmol
Asrani | Anmol Asrani |
+| [HADOOP-19187](https://issues.apache.org/jira/browse/HADOOP-19187) | ABFS:
[FnsOverBlob] Making AbfsClient Abstract for supporting both DFS and Blob
Endpoint | Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19262](https://issues.apache.org/jira/browse/HADOOP-19262) | [JDK17]
Upgade wildfly-openssl:1.1.3.Final to 2.1.4.Final+ | Major | fs/azure, fs/s3 |
Steve Loughran | Saikat Roy |
+| [HADOOP-19284](https://issues.apache.org/jira/browse/HADOOP-19284) | ABFS:
Allow "fs.azure.account.hns.enabled" to be set as Account Specific Config |
Major | fs/azure | Descifrado | Anuj Modi |
+| [HADOOP-19219](https://issues.apache.org/jira/browse/HADOOP-19219) | Resolve
Certificate error in Hadoop-auth tests. | Major | build, common | Muskan
Mishra | Muskan Mishra |
+| [HADOOP-19296](https://issues.apache.org/jira/browse/HADOOP-19296) | [JDK17]
Upgrade maven-war-plugin to 3.4.0 | Major | build, common | Shilun Fan |
Shilun Fan |
+| [HADOOP-19286](https://issues.apache.org/jira/browse/HADOOP-19286) | Support
S3A cross region access when S3 region/endpoint is set | Major | fs/s3 | Syed
Shameerur Rahman | Syed Shameerur Rahman |
+| [HADOOP-19310](https://issues.apache.org/jira/browse/HADOOP-19310) | [JDK17]
Add JPMS options required by Java 17+ | Major | build, common | Cheng Pan |
Cheng Pan |
+| [HADOOP-19297](https://issues.apache.org/jira/browse/HADOOP-19297) | [JDK17]
Upgrade maven.plugin-tools.version to 3.10.2 | Major | build, common | Shilun
Fan | Shilun Fan |
+| [HADOOP-19330](https://issues.apache.org/jira/browse/HADOOP-19330) | S3A:
Add LeakReporter; use in S3AInputStream | Major | fs/s3 | Steve Loughran |
Steve Loughran |
+| [HADOOP-18708](https://issues.apache.org/jira/browse/HADOOP-18708) | AWS SDK
V2 - Implement CSE | Major | fs/s3 | Ahmar Suhail | Syed Shameerur Rahman |
+| [HADOOP-19317](https://issues.apache.org/jira/browse/HADOOP-19317) | S3A:
fs.s3a.connection.expect.continue controls 100 CONTINUE behavior | Major |
fs/s3 | Steve Loughran | Steve Loughran |
+| [HADOOP-18960](https://issues.apache.org/jira/browse/HADOOP-18960) | ABFS
contract-tests with Hadoop-Commons intermittently failing | Minor | fs/azure |
Pranav Saxena | Anuj Modi |
+| [HADOOP-19336](https://issues.apache.org/jira/browse/HADOOP-19336) | S3A:
Test failures after CSE support added | Major | fs/s3 | Steve Loughran | Syed
Shameerur Rahman |
+| [HADOOP-19226](https://issues.apache.org/jira/browse/HADOOP-19226) | ABFS:
[FnsOverBlob] Implementing Azure Rest APIs on Blob Endpoint for AbfsBlobClient
| Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19367](https://issues.apache.org/jira/browse/HADOOP-19367) | Fix
setting final field value on Java 17 | Major | test | Cheng Pan | Cheng Pan |
+| [HADOOP-19207](https://issues.apache.org/jira/browse/HADOOP-19207) | ABFS:
[FnsOverBlob] Response Handling of Blob Endpoint APIs and Metadata APIs |
Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19229](https://issues.apache.org/jira/browse/HADOOP-19229) | Vector
IO on cloud storage: what is a good minimum seek size? | Major | fs/s3 | Steve
Loughran | Steve Loughran |
+| [HADOOP-19393](https://issues.apache.org/jira/browse/HADOOP-19393) | ABFS:
Returning FileAlreadyExists Exception for UnauthorizedBlobOverwrite Rename
Errors | Minor | fs/azure | Manika Joshi | Manika Joshi |
+| [HADOOP-19232](https://issues.apache.org/jira/browse/HADOOP-19232) | ABFS:
[FnsOverBlob] Implementing Ingress Support with various Fallback Handling |
Major | fs/azure | Anuj Modi | Anmol Asrani |
+| [HADOOP-19233](https://issues.apache.org/jira/browse/HADOOP-19233) | ABFS:
[FnsOverBlob] Implementing Rename and Delete APIs over Blob Endpoint | Major |
fs/azure | Anuj Modi | Manish Bhatt |
+| [HADOOP-19404](https://issues.apache.org/jira/browse/HADOOP-19404) | ABFS:
[FNS Over Blob] Update documentation for FNS Blob Onboard | Major | fs/azure |
Anmol Asrani | Anmol Asrani |
+| [HADOOP-19448](https://issues.apache.org/jira/browse/HADOOP-19448) | ABFS:
[FnsOverBlob][Optimizations] Reduce Network Calls In Create and Mkdir Flow |
Major | fs/azure | Anuj Modi | Anmol Asrani |
+| [HADOOP-19354](https://issues.apache.org/jira/browse/HADOOP-19354) | S3A:
InputStreams to be created by factory under S3AStore | Major | fs/s3 | Steve
Loughran | Steve Loughran |
+| [HADOOP-19467](https://issues.apache.org/jira/browse/HADOOP-19467) |
HADOOP-19467: [ABFS][FnsOverBlob] Fixing Config Name in Documenatation | Major
| fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19443](https://issues.apache.org/jira/browse/HADOOP-19443) | ABFS:
[FnsOverBlob][Tests] Update Test Scripts to Run Tests with Blob Endpoint |
Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19445](https://issues.apache.org/jira/browse/HADOOP-19445) | ABFS:
[FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Rename
Operation | Major | fs/azure | Anuj Modi | Manish Bhatt |
+| [HADOOP-19185](https://issues.apache.org/jira/browse/HADOOP-19185) | Improve
ABFS metric integration with iOStatistics | Major | fs/azure | Steve Loughran
| Manish Bhatt |
+| [HADOOP-19348](https://issues.apache.org/jira/browse/HADOOP-19348) | S3A:
Add initial support for analytics-accelerator-s3 | Major | fs/s3 | Ahmar
Suhail | Ahmar Suhail |
+| [HADOOP-19303](https://issues.apache.org/jira/browse/HADOOP-19303) |
VectorIO API to support releasing buffers on failure | Major | fs, fs/s3 |
Steve Loughran | Steve Loughran |
+| [HADOOP-19446](https://issues.apache.org/jira/browse/HADOOP-19446) | ABFS:
[FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Delete
Operation | Major | fs/azure | Anuj Modi | Manika Joshi |
+| [HADOOP-15224](https://issues.apache.org/jira/browse/HADOOP-15224) | S3A:
Add option to set checksum on S3 objects | Minor | fs/s3 | Steve Loughran |
Raphael Azzolini |
+| [HADOOP-19455](https://issues.apache.org/jira/browse/HADOOP-19455) |
HADOOP-19455. S3A: Enable logging of SDK client metrics | Minor | fs/s3 |
Steve Loughran | Steve Loughran |
+| [HADOOP-19512](https://issues.apache.org/jira/browse/HADOOP-19512) | S3A:
Test failures during AWS SDK upgrade | Minor | fs/s3, test | Steve Loughran |
Steve Loughran |
+| [HADOOP-19494](https://issues.apache.org/jira/browse/HADOOP-19494) | ABFS:
Fix Case Sensitivity Issue for hdi\_isfolder metadata | Major | fs/azure |
Manish Bhatt | Manish Bhatt |
+| [HADOOP-19531](https://issues.apache.org/jira/browse/HADOOP-19531) | ABFS:
[FnsOverBlob] Streaming List Path Result Should Happen Inside Retry Loop |
Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19474](https://issues.apache.org/jira/browse/HADOOP-19474) | ABFS:
[FnsOverBlob] Listing Optimizations to avoid multiple iteration over list
response. | Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19444](https://issues.apache.org/jira/browse/HADOOP-19444) | ABFS:
[FnsOverBlob][Tests] Add Tests For Negative Scenarios Identified for Ingress
Operations | Major | fs/azure | Anuj Modi | Anmol Asrani |
+| [HADOOP-19515](https://issues.apache.org/jira/browse/HADOOP-19515) | ABFS:
[FnsOverBlob] Updating Documentations of Hadoop Drivers for Azure | Minor |
fs/azure | Manika Joshi | Manika Joshi |
+| [HADOOP-19256](https://issues.apache.org/jira/browse/HADOOP-19256) | S3A:
Support S3 Conditional Writes | Major | fs/s3 | Ahmar Suhail | Saikat Roy |
+| [HADOOP-19543](https://issues.apache.org/jira/browse/HADOOP-19543) | ABFS:
[FnsOverBlob] Remove Duplicates from Blob Endpoint Listing Across Iterations |
Blocker | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19522](https://issues.apache.org/jira/browse/HADOOP-19522) | ABFS:
[FnsOverBlob] Rename Recovery Should Succeed When Marker File Exists with
Destination Directory | Blocker | fs/azure | Manish Bhatt | Manish Bhatt |
+| [HADOOP-19518](https://issues.apache.org/jira/browse/HADOOP-19518) | ABFS:
[FnsOverBlob] WASB to ABFS Migration Config Support Script | Major | fs/azure
| Manika Joshi | Manika Joshi |
+| [HADOOP-19497](https://issues.apache.org/jira/browse/HADOOP-19497) | [ABFS]
Enable rename and create recovery from client transaction id over DFS endpoint
| Major | fs/azure | Manish Bhatt | Manish Bhatt |
+| [HADOOP-19471](https://issues.apache.org/jira/browse/HADOOP-19471) | ABFS:
[FnsOverBlob] Support Fixed SAS token at container level | Major | fs/azure |
Manika Joshi | Manika Joshi |
+| [HADOOP-19234](https://issues.apache.org/jira/browse/HADOOP-19234) | ABFS:
[FnsOverBlob] Adding Integration Tests for Special Scenarios in Blob Endpoint |
Major | fs/azure | Anuj Modi | Anuj Modi |
+| [HADOOP-19527](https://issues.apache.org/jira/browse/HADOOP-19527) | S3A:
testVectoredReadAfterNormalRead() failing with 412 response from S3 | Blocker
| fs/s3 | Steve Loughran | Ahmar Suhail |
+| [HADOOP-19485](https://issues.apache.org/jira/browse/HADOOP-19485) | S3A:
Upgrade AWS V2 SDK to 2.29.52 | Major | build, fs/s3 | Steve Loughran | Steve
Loughran |
+| [HADOOP-19406](https://issues.apache.org/jira/browse/HADOOP-19406) | ABFS:
[FNS Over Blob] Support User Delegation SAS for FNS Blob | Major | fs/azure |
Anmol Asrani | Manika Joshi |
+| [HADOOP-19557](https://issues.apache.org/jira/browse/HADOOP-19557) | S3A:
S3ABlockOutputStream to never log/reject hflush(): calls | Critical | fs/s3 |
Steve Loughran | Steve Loughran |
+| [HADOOP-19480](https://issues.apache.org/jira/browse/HADOOP-19480) | S3A
Analytics-Accelerator: Upgrade AAL to 1.0.0 | Major | fs/s3 | Ahmar Suhail | |
+| [HADOOP-19542](https://issues.apache.org/jira/browse/HADOOP-19542) | S3A
Analytics-Accelerator: AAL stream factory not being closed | Blocker | fs/s3 |
Ahmar Suhail | Ahmar Suhail |
+| [HADOOP-19567](https://issues.apache.org/jira/browse/HADOOP-19567) | S3A:
error stack traces printed on analytics stream factory close | Major | fs/s3 |
Steve Loughran | Steve Loughran |
+| [HADOOP-19572](https://issues.apache.org/jira/browse/HADOOP-19572) | ABFS:
[FnsOverBlob] Empty Page Issue on Subsequent ListBlob call | Major | fs/azure
| Anuj Modi | Anuj Modi |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component | Reporter | Contributor |
+|:---- |:---- | :--- |:---- |:---- |:---- |
+| [HADOOP-19123](https://issues.apache.org/jira/browse/HADOOP-19123) | Update
commons-configuration2 to 2.10.1 due to CVE | Major | build | PJ Fanning | PJ
Fanning |
+| [HADOOP-19315](https://issues.apache.org/jira/browse/HADOOP-19315) | Bump
avro from 1.9.2 to 1.11.4 | Major | build | Dominik Diedrich | Dominik
Diedrich |
+| [HADOOP-19335](https://issues.apache.org/jira/browse/HADOOP-19335) | Bump
netty to 4.1.116 due to CVE-2024-47535 | Major | . | PJ Fanning | PJ Fanning |
+| [HADOOP-19380](https://issues.apache.org/jira/browse/HADOOP-19380) | Update
the year to 2025 | Major | . | Ayush Saxena | Ayush Saxena |
+| [HDFS-17080](https://issues.apache.org/jira/browse/HDFS-17080) | Fix ec
connection leak (GitHub PR#5807) | Major | . | Wei-Chiu Chuang | Wei-Chiu
Chuang |
+| [HADOOP-19456](https://issues.apache.org/jira/browse/HADOOP-19456) | Upgrade
kafka to 3.9.0 to fix CVE-2024-31141 | Major | build | Palakur Eshwitha Sai |
Palakur Eshwitha Sai |
+| [HADOOP-19465](https://issues.apache.org/jira/browse/HADOOP-19465) | upgrade
to netty 4.1.118 due to CVE-2025-24970 | Major | build | PJ Fanning | PJ
Fanning |
+| [HADOOP-19311](https://issues.apache.org/jira/browse/HADOOP-19311) | [ABFS]
Implement Backoff and Read Footer metrics using IOStatistics Class | Major |
fs/azure | Manish Bhatt | Manish Bhatt |
+| [HADOOP-19383](https://issues.apache.org/jira/browse/HADOOP-19383) | upgrade
Mina 2.0.27 due to CVE-2024-52046 | Major | . | PJ Fanning | PJ Fanning |
+| [HADOOP-19450](https://issues.apache.org/jira/browse/HADOOP-19450) | [ABFS]
Rename/Create path idempotency client-level resolution | Major | fs/azure |
Manish Bhatt | Manish Bhatt |
+| [HADOOP-19491](https://issues.apache.org/jira/browse/HADOOP-19491) | Abfs:
Fix Case Sensitivity Issue for hdi\_isfolder metadata | Major | fs/azure |
Manish Bhatt | Manish Bhatt |
+
+
Added: dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.asc
==============================================================================
--- dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.asc (added)
+++ dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.asc Wed May 28 11:31:56 2025
@@ -0,0 +1,16 @@
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCgAdFiEEAgha+2UveWo7AdEf1zem9SKB+pgFAmg28KQACgkQ1zem9SKB
++phmcA/9Ejq/gHnd+dzNnxK7SODlcAEbAiQ0iLOxT5U4o19ma8uaCzPiz+wFvi+W
+NG0Dq+CV53G/jz23wekCVRv7T+lHToXdV3wQQMJ0Rk1DNawlF16sDuGKJh6ngb0a
+8JHOM5ZB6CSbc1IMHlj07hxm+fb1kKbuAL8543tR1HwGY9iJm6ChdzNkQYwux5E0
+DZYLj6l3wtLMn1TGcMXKy9nK8MZwKVk5nHxNHYXi00Ffz87YSUjkbG5r8sxmypcR
+zvPnCekESKTU642bkutZ0vtaRoYR8Gg5qqyhvUk+0ykvBmxa2D6ZBX1rSyrF+GeE
+qsNRM9fKXCSrzjzNg1WCi1oC7Lm4PS8FOfML7Y+nesHzMjZxXbraZ+4JGygtEPzg
+vwk5W7TvzeohxjctdMU8Y/1fWqo3eFyK+CX1Txv43E144Gm8jsSSn8zFNcVJAqEm
+Z589y7RPd5lI9NE4NFDf5sBG3AgzkGabwLGQq347oc+WS8H5BHNu+9cXHpOWoG5s
+rsdmOPucG1Xdgjz68vRhzdgG27K5gEgHxR0WMEQnt2ilJ3UYQIeryR9nclV7B5tR
+8I83ZkEAS8zlr4nSAQjyMD9xzxJcpFTqMPDrnWcNmKGAVdUC2BMukEXiI/FGAcx0
+881cMEzNY2i4qDEDiaPnZfouwn8ZA9mdCzQPRV9iIrzexQdQ0ks=
+=O0E9
+-----END PGP SIGNATURE-----
Added: dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.sha512
==============================================================================
--- dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.sha512 (added)
+++ dev/hadoop/hadoop-3.4.2-RC1/CHANGELOG.md.sha512 Wed May 28 11:31:56 2025
@@ -0,0 +1 @@
+SHA512 (CHANGELOG.md) =
37970cc5c20d6b2a74e93a3e5be8e5a2afe94bc107cfde2075caaf6bef34d9f61ecc485e33994f9fed523cfb8498aca3957009ee1b0b4a400620cf9cbfcc3d84
Added: dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md
==============================================================================
--- dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md (added)
+++ dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md Wed May 28 11:31:56 2025
@@ -0,0 +1,97 @@
+
+<!---
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+-->
+# Apache Hadoop 3.4.2 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities,
important issues, features, and major improvements.
+
+
+---
+
+* [HADOOP-19107](https://issues.apache.org/jira/browse/HADOOP-19107) | *Major*
| **Drop support for HBase v1 timeline service & upgrade HBase v2**
+
+Drop support for Hbase V1 as the back end of the YARN Application Timeline
service, which becomes HBase 2 only. The supported version HBase version is
2.5.8
+
+This does not have any effect on HBase deployments themselves
+
+
+---
+
+* [HADOOP-15760](https://issues.apache.org/jira/browse/HADOOP-15760) | *Major*
| **Upgrade commons-collections to commons-collections4**
+
+Hadoop has upgraded to commons-collections4-4.4. Applications which require
the older "commons-collections" binaries on their classpath may have to
explicitly add them.
+
+
+---
+
+* [HADOOP-19315](https://issues.apache.org/jira/browse/HADOOP-19315) | *Major*
| **Bump avro from 1.9.2 to 1.11.4**
+
+Backwards-incompatible upgrade for security reasons. All field access is now
via setter/getter methods. To marshal Serializable objects the packages they
are in must be declared in the system property
"{{org.apache.avro.SERIALIZABLE\_PACKAGES}}"
+
+This upgrade does break our compatibility policy -but this is a critical
security issue. Everyone using an avro version before 1.11.4 MUST upgrade.
+
+
+---
+
+* [HADOOP-19229](https://issues.apache.org/jira/browse/HADOOP-19229) | *Major*
| **Vector IO on cloud storage: what is a good minimum seek size?**
+
+The thresholds at which adjacent vector IO read ranges are coalesced into a
+single range has been increased, as has the limit at which point they are
+considered large enough that parallel reads are faster.
+
+\* The min/max for local filesystems and any other FS without custom support
are
+now 16K and 1M
+\* s3a and abfs use 128K as the minimum size, 2M for max.
+
+These values are based on the Facebook Velox paper which stated
+their thresholds for merging were 20K for local SSD and 500K for cloud storage
+
+
+---
+
+* [HADOOP-15224](https://issues.apache.org/jira/browse/HADOOP-15224) | *Minor*
| **S3A: Add option to set checksum on S3 objects**
+
+The option fs.s3a.create.checksum.algorithm allows checksums to be set on
file upload; It supports the following values: 'CRC32', 'CRC32C', 'SHA1',
and 'SHA256'
+
+
+---
+
+* [HDFS-16644](https://issues.apache.org/jira/browse/HDFS-16644) | *Major* |
**java.io.IOException Invalid token in javax.security.sasl.qop**
+
+A Hadoop 2.10.1 or 2.10.2 client connecting to a Hadoop 3.4.0~3.4.1,
3.3.0~3.3.6, 3.2.1~3.2.4 (any version with HDFS-13541) cluster could cause the
DataNode to disconnect any subsequent client connections due to an incompatible
binary protocol change.
+
+HDFS-16644 provides a partial fix: a Hadoop 3 cluster will reject Hadoop
2.10.1/2.10.2 clients, but it will not fail other subsequent client connections.
+
+For Hadoop 2 cluster wishing to upgrade to Hadoop 3 in a rolling fashion, the
workaround is to perform a two-step upgrade: upgrade to an earlier Hadoop 3
version without HDFS-13541, and then upgrade again to the newer Hadoop 3
version. Or revert HDFS-13541 from your version and rebuild.
+
+
+---
+
+* [HADOOP-19485](https://issues.apache.org/jira/browse/HADOOP-19485) | *Major*
| **S3A: Upgrade AWS V2 SDK to 2.29.52**
+
+AWS SDK 2.30.0 and later are (currently) incompatible with third party stores.
Accordingly, this release is kept at a 2.29 version. See HADOOP-19490. There
may now be some problems using the AWS4SignerType and S3.
+
+
+---
+
+* [HADOOP-19557](https://issues.apache.org/jira/browse/HADOOP-19557) |
*Critical* | **S3A: S3ABlockOutputStream to never log/reject hflush(): calls**
+
+S3A output streams no longer log warnings on use of hflush()/raise exceptions
if fs.s3a.downgrade.syncable.exceptions = false. hsync() is reported with a
warning/rejected, as appropriate. That method us absolutely unsupported when
writing to S3
+
+
+
Added: dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.asc
==============================================================================
--- dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.asc (added)
+++ dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.asc Wed May 28 11:31:56 2025
@@ -0,0 +1,16 @@
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCgAdFiEEAgha+2UveWo7AdEf1zem9SKB+pgFAmg1zIEACgkQ1zem9SKB
++pgVVQ//emACSP42+OwOjn6CiMcA/1Jt5fI5EWfjtQhs+i4ltwMsDGUXGHBckbxF
+sMWSW9vrBsduLalRtgsyTPhvopueytWIsaA4PugtJYJcWNpOtnHf0VoxfDxz3EIu
+pm4wgTC0MFC1asjIeKn7xghve1x4loOM4IfbWB3QRuQgWqk2iSxJOMEN9DX4iHlA
+5FkjrO6AHAe3KnAmFdATFhvybyiEqmMZqfU/aI2QIogqJzrLYzTGonLy55CguWjl
+6Fr8ZH2Q6tZq2qBpDBZ95T6kLv/GX6MMeMI1uvt7cDBCZ3fVrQSCYkzCFny5mEYJ
+Mpajq6Al2harAbU9PMFIEwGEqK4zTR8Bi4rRax48ioCZKilXYIGxWx1MDY/6WZjm
+Muyp0e7H2ZzCQk1TPDPEVnhTbk1MgjGNldmwXK1BGzHgomefVaBA3ATmigTu5a6m
+NVBv87ItfbUcL2IC2RlogKQeBLTCsWpmm8KuNzWZBaFy3tPq2HrJLzDWK77UutGe
+qAq215T5MW/KIeVJVYsPfHdVKtNkk6rrxE9JhrFCb3s/tjWa+qtrifAJAs3kPoiK
+n+xPorNnei5XI8z2wrXIcb3GV67qiLrUqd9WLQSWyd5ul6MWkqRyJ58FALQKiQ6T
+N5wHDj3I3ydq1MzH7FcRmeA0Wzye9BYUDpvP+LcP34MxqXug4iM=
+=kVTZ
+-----END PGP SIGNATURE-----
Added: dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.sha512
==============================================================================
--- dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.sha512 (added)
+++ dev/hadoop/hadoop-3.4.2-RC1/RELEASENOTES.md.sha512 Wed May 28 11:31:56 2025
@@ -0,0 +1 @@
+SHA512 (RELEASENOTES.md) =
7bfae79f7606fb4bc3f101a73afd03d2878bea698b0b84057c69cdfd508e38d862e768f99e910f6bf4a4672fdace10a10e5dd8fd8a724fea4d4391df6a6fee4c
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-commits-h...@hadoop.apache.org
