Re: [DISCUSS] Hadoop 3.4.0 release
Thanks Ahmar for starting this thread. Strong +1 to have 3.4.0 from trunk rather than from 3.3.*. We should keep release line clear, and it's not standard operation to cut a branch from another line. Let's move the trunk to 3.5.0-SNAPSHOT when we come to an agreement at this thread. About this release line plan we have discussed months ago[1], I think we could include both modules upgrade this time(such as HDFS/YARN/AWS etc.). IIUC, it is near to be ready for YARN module, and Shilun is working on it now. For this release plan Shilun and Ahmar could be co- release manager to make this happen if you are willing to be involved. Thanks. Now we have an additional release line, we can start a thread and > think about marking some existing release lines as EOL, so, the number > of active release lines stay in control, maybe 3.2 +1, I would like to launch another thread to discuss it recently. Thanks everyone here for trying to move this release forward! Best Regards, - He Xiaoqiao [1] https://lists.apache.org/thread/l16jc8or6czqmvbwvzw5n7dds7jxlzk8 On Fri, Dec 1, 2023 at 9:59 PM Ayush Saxena wrote: > Hi Ahmar, > > Makes sense to have a 3.4.0 rather than a 3.3.x if there are major > changes. Few things on the process: > > * trunk should now point to 3.5.0-SNAPSHOT > * Fix Versions of all the tickets merged to trunk would be 3.4.0 as of > now, you need to move it to 3.5.0, else while chasing the release, the > release notes will get messed up. > * Since we are moving to 3.4.x, we can even explore a few more changes > in trunk as well, which weren't merged to 3.3.x due to compat issues. > HADOOP-13386 is one such change, which was asked for some time back. > * Now we have an additional release line, we can start a thread and > think about marking some existing release lines as EOL, so, the number > of active release lines stay in control, maybe 3.2 > > Rest, Good Luck, Thanx for volunteering!!! > > -Ayush > > On Fri, 1 Dec 2023 at 17:30, Ahmar Suhail wrote: > > > > Hey all, > > > > > > HADOOP-18073 was recently merged to trunk, which upgrades the AWS SDK to > > V2. Since this merge, there has been work for stabilising this SDK > version > > upgrade, as tracked in HADOOP-18886. Further, HADOOP-18995 and > HADOOP-18996 > > added support for Amazon Express One Zone. > > > > > > The SDK upgrade has brought major code changes to the hadoop-aws module. > > For example, In the v2 SDK, all package, class and method names have > > changed. Due to the upgrade being a large change, it might be good to > > release these changes as Hadoop 3.4.0. For this, I started creating a > > branch-3.4 from branch-3.3 and branch-3.4.0 for a possible release early > > next year. > > > > > > The other option would be to release from trunk as a 3.3.x release, but > due > > to the large number of changes there this will be really difficult. > > > > > > Thoughts on a 3.4.0 release? > > - > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org > >
Re: [DISCUSS] Hadoop 3.4.0 release
Hey all, With Inigo's assistance, we collaborated to enhance the functionality of YARN Federation. Currently, YARN-5597 is ready, and I look forward to releasing a new version that includes our modifications. I agree to release a new version based on 3.4.0 and am willing to assist in the tasks associated with the release process. Once again, I express gratitude to Inigo and Xiaoqiao He for their valuable assistance. Thanks for Ayush's reply! Looking forward to the opinions of Inigo and Xiaoqiao He. Best Regards, Shilun Fan. Original From:"Ayush Saxena"< ayush...@gmail.com >; Date:2023/12/1 22:28 To:"Ahmar Suhail"< ah...@apache.org >; CC:"common-dev"< common-...@hadoop.apache.org >;"hdfs-dev"< hdfs-...@hadoop.apache.org >;"yarn-dev"< yarn-dev@hadoop.apache.org >; "mapreduce-dev"< mapreduce-...@hadoop.apache.org >; Subject:Re: [DISCUSS] Hadoop 3.4.0 release Hi Ahmar, Makes sense to have a 3.4.0 rather than a 3.3.x if there are major changes. Few things on the process: * trunk should now point to 3.5.0-SNAPSHOT * Fix Versions of all the tickets merged to trunk would be 3.4.0 as of now, you need to move it to 3.5.0, else while chasing the release, the release notes will get messed up. * Since we are moving to 3.4.x, we can even explore a few more changes in trunk as well, which weren't merged to 3.3.x due to compat issues. HADOOP-13386 is one such change, which was asked for some time back. * Now we have an additional release line, we can start a thread and think about marking some existing release lines as EOL, so, the number of active release lines stay in control, maybe 3.2 Rest, Good Luck, Thanx for volunteering!!! -Ayush On Fri, 1 Dec 2023 at 17:30, Ahmar Suhail wrote: > > Hey all, > > > HADOOP-18073 was recently merged to trunk, which upgrades the AWS SDK to > V2. Since this merge, there has been work for stabilising this SDK version > upgrade, as tracked in HADOOP-18886. Further, HADOOP-18995 and HADOOP-18996 > added support for Amazon Express One Zone. > > > The SDK upgrade has brought major code changes to the hadoop-aws module. > For example, In the v2 SDK, all package, class and method names have > changed. Due to the upgrade being a large change, it might be good to > release these changes as Hadoop 3.4.0. For this, I started creating a > branch-3.4 from branch-3.3 and branch-3.4.0 for a possible release early > next year. > > > The other option would be to release from trunk as a 3.3.x release, but due > to the large number of changes there this will be really difficult. > > > Thoughts on a 3.4.0 release? - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org a
Re: [DISCUSS] Hadoop 3.4.0 release
Hi Ahmar, Makes sense to have a 3.4.0 rather than a 3.3.x if there are major changes. Few things on the process: * trunk should now point to 3.5.0-SNAPSHOT * Fix Versions of all the tickets merged to trunk would be 3.4.0 as of now, you need to move it to 3.5.0, else while chasing the release, the release notes will get messed up. * Since we are moving to 3.4.x, we can even explore a few more changes in trunk as well, which weren't merged to 3.3.x due to compat issues. HADOOP-13386 is one such change, which was asked for some time back. * Now we have an additional release line, we can start a thread and think about marking some existing release lines as EOL, so, the number of active release lines stay in control, maybe 3.2 Rest, Good Luck, Thanx for volunteering!!! -Ayush On Fri, 1 Dec 2023 at 17:30, Ahmar Suhail wrote: > > Hey all, > > > HADOOP-18073 was recently merged to trunk, which upgrades the AWS SDK to > V2. Since this merge, there has been work for stabilising this SDK version > upgrade, as tracked in HADOOP-18886. Further, HADOOP-18995 and HADOOP-18996 > added support for Amazon Express One Zone. > > > The SDK upgrade has brought major code changes to the hadoop-aws module. > For example, In the v2 SDK, all package, class and method names have > changed. Due to the upgrade being a large change, it might be good to > release these changes as Hadoop 3.4.0. For this, I started creating a > branch-3.4 from branch-3.3 and branch-3.4.0 for a possible release early > next year. > > > The other option would be to release from trunk as a 3.3.x release, but due > to the large number of changes there this will be really difficult. > > > Thoughts on a 3.4.0 release? - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
[DISCUSS] Hadoop 3.4.0 release
Hey all, HADOOP-18073 was recently merged to trunk, which upgrades the AWS SDK to V2. Since this merge, there has been work for stabilising this SDK version upgrade, as tracked in HADOOP-18886. Further, HADOOP-18995 and HADOOP-18996 added support for Amazon Express One Zone. The SDK upgrade has brought major code changes to the hadoop-aws module. For example, In the v2 SDK, all package, class and method names have changed. Due to the upgrade being a large change, it might be good to release these changes as Hadoop 3.4.0. For this, I started creating a branch-3.4 from branch-3.3 and branch-3.4.0 for a possible release early next year. The other option would be to release from trunk as a 3.3.x release, but due to the large number of changes there this will be really difficult. Thoughts on a 3.4.0 release?
