* git_jira_fix_version_check.py reported some inconsistencies between commits
and JIRA.
I updated JIRA's "Fix Versions/s" and "Resolution" along with the commit status.
Since HADOOP-19580 was commited to branch-3.4.2 but not in the RC1,
it will be contained if RC2 is created.
"Fix Versions/s" should be updated later.
https://issues.apache.org/jira/browse/HADOOP-19580
On 2025/06/02 18:47, Masatake Iwasaki wrote:
Thanks for driving the release, Ahmar.
I found some issues on documentations.
While it is not worth for sinking the RC1, it would be nice to fix if we cut
RC2.
* The top page of site documentation looks mentioning changes of 3.4.1.
https://github.com/apache/hadoop/blob/release-3.4.2-RC1/hadoop-project/src/site/markdown/index.md.vm
* git_jira_fix_version_check.py reported some inconsistencies between commits
and JIRA.
https://github.com/apache/hadoop/tree/release-3.4.2-RC1/dev-support/git-jira-validation
Jira/Git commit message diff starting:
##############################################
WARN: Jira not found. Commit:
09870840ec35b48cd107972eb24d25e8aece04c9 updates SDK dependency to provided
(#7688)
WARN: Jira not found. Commit:
02b4849886c943be635af521714934b5bf6c32c1 Preparing for 3.4.2 release
Jira not present with version: 3.4.2. Commit:
7f170e9788f8074091f98527cdd9552acd1d05db HADOOP-19548: [ABFS] Fix Logging in
FSDataInputStream to Mention Correct Buffersize (#7642) (#7660)
Jira is not resolved yet? Commit:
f3ec55b5911d1e5e7da438c64f614a59a7db62a3 HADOOP-19516. S3A: SDK reads content
twice during PUT to S3 Express store.
Commit seems reverted. Commit:
9d3082e130227fdd05216eb4a0ecd374bce447f2 Revert "HDFS-14884. Add sanity check that
zone key equals feinfo key while setting Xattrs. Contributed by Mukul Kumar Singh."
(#7529)
Jira not present with version: 3.4.2. Commit:
c7d292ecd1078f72e234ae1e84e70d7ee280ad92 HADOOP-19488 fix temporary directory
creation (branch-3.4) (#7530)
Jira not present with version: 3.4.2. Commit:
a5fb37e6547e152fabbc47520b9c8f7fc448a1df HADOOP-18940. [ABFS] Remove commons
IOUtils.close() from AbfsOutputStream (#7506)
Commit seems reverted. Commit:
474f5343a4676832cf514ff37c03d25915472752 Revert "YARN-11793: Remove grizzly-http-*
dependencies from Hadoop to avoid transitive inclusions."
Jira not present with version: 3.4.2. Commit:
7e682e0f976694bf3030309f73ac2264694f6d70 YARN-11793: Remove grizzly-http-*
dependencies from Hadoop to avoid transitive inclusions.
Jira not present with version: 3.4.2. Commit:
c122ff33b82a727ac1f6c83760efcb7fd5c0bac7 [YARN-11776] Handle NPE in the
RMDelegationTokenIdentifier if localServiceAddress is null (#7431) Contributed
by Abhey Rana.
Jira not present with version: 3.4.2. Commit:
b3ae9d1eb6841a6c9f9928a917cc50818a319f71 HADOOP-19152. Do not hard code
security providers. (#6739) (#7439)
WARN: Jira not found. Commit:
04ca53410beb18bbd279219275f59f04e6df293a Integrate analytics accelerator into
S3A. (#7471)
Jira not present with version: 3.4.2. Commit:
fd445c215459f2b7604e2cd383af98c040861cc2 HADOOP-19407: Update 3.4.1 docs
landing page to highlight changes shipped in the release.
Jira not present with version: 3.4.2. Commit:
7d699e5ffb7dee613ac6bc6bccb529ef6bb4a2a6 HADOOP-19401: Improve error message
when OS can't identify the current user.
Jira not present with version: 3.4.2. Commit:
57d821e6aad23b604833272071c8481567363e63 HADOOP-19143. Upgrade commons-cli to
1.9.0. (#7126) (#7146) Contributed by Min Yan.
Jira not present with version: 3.4.2. Commit:
0b74fbe9479a88b154c5d5d5acc5920c4a50e65d HDFS-17637. [BackPort] Fix spotbugs in
HttpFSFileSystem#getXAttr (#7099) (#7195) Contributed by Hualong Zhang.
Found first commit hash after which git history is redundant. commit:
23f45d0b26d4a883e7a29278df0ec75bc5c1fda3
Exiting successfully
Jira/Git commit message diff completed:
##############################################
Any resolved Jira with fixVersion 3.4.2 but corresponding commit not present
Starting diff: ##############################################
HADOOP-19580 is marked resolved with fixVersion 3.4.2 but no corresponding
commit found
HADOOP-19512 is marked resolved with fixVersion 3.4.2 but no corresponding
commit found
HADOOP-19492 is marked resolved with fixVersion 3.4.2 but no corresponding
commit found
HADOOP-19491 is marked resolved with fixVersion 3.4.2 but no corresponding
commit found
HADOOP-19382 is marked resolved with fixVersion 3.4.2 but no corresponding
commit found
Completed diff: ##############################################
I will vote after some more local testing.
Thanks,
Masatake Iwasaki
On 2025/05/28 21:24, Ahmar Suhail wrote:
Hey all,
The first release candidate for Hadoop 3.4.2 is now available for voting.
There are a couple of things to note:
1/ No Arm64 artifacts. This is due to previously reported issues:
https://issues.apache.org/jira/projects/YARN/issues/YARN-11712 and
ttps://issues.apache.org/jira/projects/YARN/issues/YARN-11713
<https://issues.apache.org/jira/projects/YARN/issues/YARN-11713>, which
mean that the build fails on arm64.
2/ Relevant for anyone testing S3A: We've removed the AWS SDK bundle
from hadoop-3.4.2.tar.gz. This is because the SDK bundle is now ~600MB,
which makes the size of tar > 1GB, and it can no longer be uploaded to SVN.
For S3A, download SDK bundle v2.29.52 from:
https://mvnrepository.com/artifact/software.amazon.awssdk/bundle/2.29.52,
and drop it into /share/hadoop/common/lib. Release notes will be updated
with these instructions.
The RC is available at:
https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.2-RC1/
The git tag is release-3.4.2-RC1, commit
09870840ec35b48cd107972eb24d25e8aece04c9
The maven artifacts are staged at:
https://repository.apache.org/content/repositories/orgapachehadoop-1437
You can find my public key (02085AFB652F796A3B01D11FD737A6F52281FA98) at:
https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
This release has been created off of branch-3.4. Key changes include:
* S3A: Integration with S3 Analytics Accelerator input stream
* S3A: Support for S3 conditional writes
* ABFS: Deprecation of WASB driver
* ABFS: Support for Non-Heirarchical Namespace Accounts on ABFS Driver
This is my first attempt at managing a release, please do test the release
and let me know in case of any issues.
Thanks,
Ahmar
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org