Hi team, Thanks Lazlo for your suggestions. I have created the following Tez ticket to track the items you mentioned as well as what I suggested - TEZ-4481<https://issues.apache.org/jira/browse/TEZ-4481>. This is what I am thinking can be next action plan :
1. Creating a consolidated list of tickets that need to go in this release. This is a preliminary list. Will wait for 1 week if someone wants to add any new tickets. 2. Lazlo, I also need your help in cutting out a branch branch-0.10.3 from branch-0.10.2 (from where 0.10.2 release was taken). This would ensure that we are including all changes that went in 0.10.2 on top of what we will add. I welcome everyone's suggestions on this. Please feel free to suggest any concerns you may have. Thanks, Aman. ________________________________ From: László Bodor <bodorlaszlo0...@gmail.com> Sent: Sunday, February 26, 2023 4:06 PM To: dev@tez.apache.org <dev@tez.apache.org> Subject: [EXTERNAL] Re: Proposal for Tez 0.10.3 release And another one which is quite old but needs attention finally: https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FTEZ-4334&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989001110%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=fTqlJ9atgNYoSqbPJQF9Cq%2FjoOT70EKHNWFpoCjepDA%3D&reserved=0 László Bodor <bodorlaszlo0...@gmail.com> ezt írta (időpont: 2023. febr. 26., V, 8:19): > Hi! > > Thanks, Aman for opening this discussion. After fixing some ShuffleHandler > issues, I feel there is much sense in making 0.10.3. > What I really want to see in the next release is > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FTEZ-4460&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989001110%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2FP8LdIiTgxCJfEzhXzbqS%2BImKSxkL4bifcWffxPMmsg%3D&reserved=0 > > Regards, > Laszlo Bodor > > > Aman Raj <raja...@microsoft.com.invalid> ezt írta (időpont: 2023. febr. > 24., P, 11:07): > >> Hi team, >> >> I would like to make a proposal for initiating the Tez 0.10.3 release in >> the Open Source. This release is needed primarily because we want to >> upgrade Tez to use Hadoop 3.3.4 (newest). There are compatibility issues if >> we upgrade Hive to 3.3.4 Hadoop [1] because Tez 0.10.2 uses Hadoop 3.3.1. >> This release would make sure that if we upgrade to Hadoop to 3.3.4 in both >> Hive (3.2.0 & 4.x release) and Tez(0.10.3), we can be confident that this >> ecosystem is compatible as well as the most upgraded stack for Hive, Hadoop >> and Tez. >> >> We have already upgraded to Hadoop 3.3.4 in Tez master. Thanks to Lazlo >> for the review and merge, so it makes sense to make a 0.10.3 release. Link >> to the PR : >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F272&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989001110%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=SHRtT2Ga9gsoWQHsH91cO14BpU2O2ZjQrZvadh3iA8E%3D&reserved=0 >> >> Some of the patches I can suggest for this release: >> >> 1. >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F272&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ALVG51%2FvVflwYy74sy77FkDxSX%2FoUmwLaY5Y6vi4SBc%3D&reserved=0 >> 2. >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F267&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MJqibAqUZLbpTiCoM%2F0FdZikZi53Hwdh4DMoYMoIP1w%3D&reserved=0 >> 3. >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F263&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bKVAEty6o4y48LtTv7S7kY0Ui16Gc4Rj%2FBNNosffwHY%3D&reserved=0 >> >> This release can also target to fix certain CVEs as part of these patches: >> >> 1. >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F253&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=cSpbbHq7itb3tTLHOG2yktQRVSen3RRYbJDiWqzH0I0%3D&reserved=0 >> 2. >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F258&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ufj0NGqq%2FbnU3DMlJ4TQTMD9OY2qxSolXX5sBKype2E%3D&reserved=0 >> 3. >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Ftez%2Fpull%2F258&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ufj0NGqq%2FbnU3DMlJ4TQTMD9OY2qxSolXX5sBKype2E%3D&reserved=0 >> >> Please feel free to suggest any concerns you have. I would like to have a >> vote on this and then we can come up with a comprehensive list of patches >> that can be taken up in this release. I welcome all your suggestions. >> >> Thanks, >> Aman. >> >> [1] - Link to the Hive PR for discussion - >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F4025&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2FfdNClNrqCFxmlIKF5v9B3OwSWEIIBzwzJnxh51NP20%3D&reserved=0 >> & >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3578&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tiBdl7OJP9RA2rM8zbfSLyK%2BJaKDeblhKHHhnv7cnE8%3D&reserved=0 >> [ >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fopengraph.githubassets.com%2Fa78fcb85b398b0f0eff63f5874aa8a363c892951eb406bea7a37a7947de51b9a%2Fapache%2Fhive%2Fpull%2F3578&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=wdKpMsXJf2Z1plBQ9azGyk%2FN8qIGUvF%2FCcnEED6jDzw%3D&reserved=0 >> ]<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3578&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tiBdl7OJP9RA2rM8zbfSLyK%2BJaKDeblhKHHhnv7cnE8%3D&reserved=0> >> Upgrade Hadoop to 3.3.4 by zhangbutao · Pull Request #3578 · apache/hive< >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F3578&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tiBdl7OJP9RA2rM8zbfSLyK%2BJaKDeblhKHHhnv7cnE8%3D&reserved=0> >> What changes were proposed in this pull request? Why are the changes >> needed? Does this PR introduce any user-facing change? How was this patch >> tested? >> github.com >> >> [ >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fopengraph.githubassets.com%2F822c1ef791b78940bba7ffca0c00ade1eec1317212bda9b0ba7eb0272d383291%2Fapache%2Fhive%2Fpull%2F4025&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=MdSeENbu%2BgiVraTSf6BrPyj2VWQvtooxBjwz6V3ov2s%3D&reserved=0 >> ]<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F4025&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2FfdNClNrqCFxmlIKF5v9B3OwSWEIIBzwzJnxh51NP20%3D&reserved=0> >> HIVE-27030 : Upgrade HIVE to Hadoop 3.3.4 by amanraj2520 · Pull Request >> #4025 · >> apache/hive<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fhive%2Fpull%2F4025&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2FfdNClNrqCFxmlIKF5v9B3OwSWEIIBzwzJnxh51NP20%3D&reserved=0> >> JIRA link : >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-27030&data=05%7C01%7Crajaman%40microsoft.com%7Cadcc0a00aba2419887e108db17e553e2%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638130045989157318%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vIB4qcw3uZOkpbJQpqpEneOTuJfvpW6C43xFFLMn%2FmY%3D&reserved=0 >> What >> changes were proposed in this pull request? Why are the changes needed? >> Does this PR introduce any user-facing change? How was ... >> github.com >> >>
