We should consider including https://issues.apache.org/jira/browse/HDFS-17129
Which looks like inducing some misorder between IBR & FBR which can potentially lead to strange issues, if that can’t be merged, should revert the one which causes that. I think we should check for any ticket which has a target version or affect version & is marked critica/blockerl for 3.4.0 before spinning up a new RC, I think I mentioned that somewhere before. -1, in case HDFS-17129 is not a false alarm or we can prove it won't cause any issues. There is a comment which says a block was reported missing post the patch that induced it: [1] [1] https://github.com/apache/hadoop/pull/6244#issuecomment-1793981740 -Ayush On Fri, 12 Jan 2024 at 07:37, slfan1989 <slfan1...@apache.org> wrote: > Thank you very much for your help in verifying this version! We will use > version 3.5.0 for fix jira in the future. > > Best Regards, > Shilun Fan. > > > wonderful! I'll be testing over the weekend > > > Meanwhile, new changes I'm putting in to trunk are tagged as fixed in > 3.5.0 > > -correct? > > > steve > > > > On Thu, 11 Jan 2024 at 05:15, slfan1989 wrote: > > > Hello all, > > > > We plan to release hadoop 3.4.0 based on hadoop trunk, which is the first > > hadoop 3.4.0-RC version. > > > > The RC is available at: > > https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/ (for amd64) > > https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-arm64/ (for arm64) > > > > Maven artifacts is built by x86 machine and are staged at > > https://repository.apache.org/content/repositories/orgapachehadoop-1391/ > > > > My public key: > > https://dist.apache.org/repos/dist/release/hadoop/common/KEYS > > > > Changelog: > > https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/CHANGELOG.md > > > > Release notes: > > > https://home.apache.org/~slfan1989/hadoop-3.4.0-RC0-amd64/RELEASENOTES.md > > > > This is a relatively big release (by Hadoop standard) containing about > 2852 > > commits. > > > > Please give it a try, this RC vote will run for 7 days. > > > > Feature highlights: > > > > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool > > ---------------------------------------- > > [HDFS-15180](https://issues.apache.org/jira/browse/HDFS-15180) Split > > FsDatasetImpl datasetLock via blockpool to solve the issue of heavy > > FsDatasetImpl datasetLock > > When there are many namespaces in a large cluster. > > > > YARN Federation improvements > > ---------------------------------------- > > [YARN-5597](https://issues.apache.org/jira/browse/YARN-5597) brings many > > improvements, including the following: > > > > 1. YARN Router now boasts a full implementation of all relevant > interfaces > > including the ApplicationClientProtocol, > > ResourceManagerAdministrationProtocol, and RMWebServiceProtocol. > > 2. Enhanced support for Application cleanup and automatic offline > > mechanisms for SubCluster are now facilitated by the YARN Router. > > 3. Code optimization for Router and AMRMProxy was undertaken, coupled > with > > improvements to previously pending functionalities. > > 4. Audit logs and Metrics for Router received upgrades. > > 5. A boost in cluster security features was achieved, with the inclusion > of > > Kerberos support. > > 6. The page function of the router has been enhanced. > > > > Upgrade AWS SDK to V2 > > ---------------------------------------- > > [HADOOP-18073](https://issues.apache.org/jira/browse/HADOOP-18073) > > The S3A connector now uses the V2 AWS SDK. This is a significant change > at > > the source code level. > > Any applications using the internal extension/override points in the > > filesystem connector are likely to break. > > Consult the document aws\_sdk\_upgrade for the full details. > > > > hadoop-thirdparty will also provide the new RC0 soon. > > > > Best Regards, > > Shilun Fan. > > >
