Hi! Thanks, Aman for opening this discussion. After fixing some ShuffleHandler issues, I feel there is much sense in making 0.10.3. What I really want to see in the next release is https://issues.apache.org/jira/browse/TEZ-4460
Regards, Laszlo Bodor Aman Raj <raja...@microsoft.com.invalid> ezt írta (időpont: 2023. febr. 24., P, 11:07): > Hi team, > > I would like to make a proposal for initiating the Tez 0.10.3 release in > the Open Source. This release is needed primarily because we want to > upgrade Tez to use Hadoop 3.3.4 (newest). There are compatibility issues if > we upgrade Hive to 3.3.4 Hadoop [1] because Tez 0.10.2 uses Hadoop 3.3.1. > This release would make sure that if we upgrade to Hadoop to 3.3.4 in both > Hive (3.2.0 & 4.x release) and Tez(0.10.3), we can be confident that this > ecosystem is compatible as well as the most upgraded stack for Hive, Hadoop > and Tez. > > We have already upgraded to Hadoop 3.3.4 in Tez master. Thanks to Lazlo > for the review and merge, so it makes sense to make a 0.10.3 release. Link > to the PR : https://github.com/apache/tez/pull/272 > > Some of the patches I can suggest for this release: > > 1. https://github.com/apache/tez/pull/272 > 2. > https://github.com/apache/tez/pull/267 > 3. > https://github.com/apache/tez/pull/263 > > This release can also target to fix certain CVEs as part of these patches: > > 1. https://github.com/apache/tez/pull/253 > 2. https://github.com/apache/tez/pull/258 > 3. https://github.com/apache/tez/pull/258 > > Please feel free to suggest any concerns you have. I would like to have a > vote on this and then we can come up with a comprehensive list of patches > that can be taken up in this release. I welcome all your suggestions. > > Thanks, > Aman. > > [1] - Link to the Hive PR for discussion - > https://github.com/apache/hive/pull/4025 & > https://github.com/apache/hive/pull/3578 > [ > https://opengraph.githubassets.com/a78fcb85b398b0f0eff63f5874aa8a363c892951eb406bea7a37a7947de51b9a/apache/hive/pull/3578 > ]<https://github.com/apache/hive/pull/3578> > Upgrade Hadoop to 3.3.4 by zhangbutao · Pull Request #3578 · apache/hive< > https://github.com/apache/hive/pull/3578> > What changes were proposed in this pull request? Why are the changes > needed? Does this PR introduce any user-facing change? How was this patch > tested? > github.com > > [ > https://opengraph.githubassets.com/822c1ef791b78940bba7ffca0c00ade1eec1317212bda9b0ba7eb0272d383291/apache/hive/pull/4025 > ]<https://github.com/apache/hive/pull/4025> > HIVE-27030 : Upgrade HIVE to Hadoop 3.3.4 by amanraj2520 · Pull Request > #4025 · apache/hive<https://github.com/apache/hive/pull/4025> > JIRA link : https://issues.apache.org/jira/browse/HIVE-27030 What changes > were proposed in this pull request? Why are the changes needed? Does this > PR introduce any user-facing change? How was ... > github.com > >
