Hi Brahma, Thank you for preparing the release. Could you cut branch-3.3.0? I would like to backport some fixes for 3.3.1 and not for 3.3.0.
Thanks and regards, Akira On Fri, Apr 17, 2020 at 11:11 AM Brahma Reddy Battula <bra...@apache.org> wrote: > Hi All, > > we are down to two blockers issues now (YARN-10194 and YARN-9848) which > are in patch available state.Hopefully we can out the RC soon. > > thanks to @Prabhu Joseph <prabhujose.ga...@gmail.com> ,@masakate,@akira > and @Wei-Chiu Chuang <weic...@cloudera.com> and others for helping > resloving the blockers. > > > > On Tue, Apr 14, 2020 at 10:49 PM Brahma Reddy Battula <bra...@apache.org> > wrote: > >> >> @Prabhu Joseph <prabhujose.ga...@gmail.com> >> >>> Have committed the YARN blocker YARN-10219 to trunk and cherry-picked >> to branch-3.3. Right now, there are two blocker Jiras - YARN-10233 and >> HADOOP-16982 >> which i will help to review and commit. Thanks. >> >> Looks you committed YARN-10219. Noted YARN-10233 and HADOOP-16982 as a >> blockers. (without YARN-10233 we have given so many releases,it's not newly >> introduced.).. Thanks >> >> @Vinod Kumar Vavilapalli <vino...@hortonworks.com> ,@adam Antal, >> >> I noted YARN-9848 as a blocker as you mentioned above. >> >> @All, >> >> Currently following four blockers are pending for 3.3.0 RC. >> >> HADOOP-16963,YARN-10233,HADOOP-16982 and YARN-9848. >> >> >> >> On Tue, Apr 14, 2020 at 8:11 PM Vinod Kumar Vavilapalli < >> vino...@apache.org> wrote: >> >>> Looks like a really bad bug to me. >>> >>> +1 for revert and +1 for making that a 3.3.0 blocker. I think should >>> also revert it in a 3.2 maintenance release too. >>> >>> Thanks >>> +Vinod >>> >>> > On Apr 14, 2020, at 5:03 PM, Adam Antal <adam.an...@cloudera.com.INVALID> >>> wrote: >>> > >>> > Hi everyone, >>> > >>> > Sorry for coming a bit late with this, but there's also one jira that >>> can >>> > have potential impact on clusters and we should talk about it. >>> > >>> > Steven Rand found this problem earlier and commented to >>> > https://issues.apache.org/jira/browse/YARN-4946. >>> > The bug has impact on the RM state store: the RM does not delete apps >>> - see >>> > more details in his comment here: >>> > >>> https://issues.apache.org/jira/browse/YARN-4946?focusedCommentId=16898599&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16898599 >>> > . >>> > (FYI He also created https://issues.apache.org/jira/browse/YARN-9848 >>> with >>> > the revert task). >>> > >>> > It might not be an actual blocker, but since there wasn't any consensus >>> > about a follow up action, I thought we should decide how to proceed >>> before >>> > release 3.3.0. >>> > >>> > Regards, >>> > Adam >>> > >>> > On Tue, Apr 14, 2020 at 9:35 AM Prabhu Joseph < >>> prabhujose.ga...@gmail.com> >>> > wrote: >>> > >>> >> Thanks Brahma for the update. >>> >> >>> >> Have committed the YARN blocker YARN-10219 to trunk and cherry-picked >>> to >>> >> branch-3.3. Right now, there are two blocker Jiras - YARN-10233 and >>> >> HADOOP-16982 >>> >> which i will help to review and commit. Thanks. >>> >> >>> >> [image: Screen Shot 2020-04-14 at 1.01.51 PM.png] >>> >> >>> >> project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, >>> >> Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 >>> ORDER >>> >> BY priority DESC >>> >> >>> >> >>> >> On Sun, Apr 12, 2020 at 12:19 AM Brahma Reddy Battula < >>> bra...@apache.org> >>> >> wrote: >>> >> >>> >>> *Pending for 3.3.0 Release:* >>> >>> >>> >>> One Blocker(HADOOP-16963) confirmation and following jira's are open >>> as >>> >>> these needs to merged to other branches(I am tracking the same, >>> Ideally >>> >>> this can be closed and can raise seperate jira's to track). >>> >>> >>> >>> >>> >>> 1–4 of 4Refresh results >>> >>> < >>> >>> >>> https://issues.apache.org/jira/issues/?jql=project%20in%20(%22Hadoop%20HDFS%22)%20AND%20resolution%20%3D%20Unresolved%20AND%20(cf%5B12310320%5D%20%3D%203.3.0%20OR%20fixVersion%20%3D%203.3.0)%20ORDER%20BY%20priority%20DESC# >>> >>>> >>> >>> Columns >>> >>> Patch InfoKeyTSummaryAssigneeReporterP >>> StatusResolutionUpdatedDueCreated >>> >>> <https://issues.apache.org/jira/browse/HDFS-14353> HDFS-14353 >>> >>> <https://issues.apache.org/jira/browse/HDFS-14353> [image: Sub-task] >>> >>> <https://issues.apache.org/jira/browse/HDFS-14353> >>> >>> >>> >>> HDFS-8031 <https://issues.apache.org/jira/browse/HDFS-8031> Erasure >>> >>> Coding: >>> >>> metrics xmitsInProgress become to negative. >>> >>> <https://issues.apache.org/jira/browse/HDFS-14353> >>> >>> maobaolong >>> >>> < >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=maobaolong> >>> >>> maobaolong >>> >>> < >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=maobaolong> >>> >>> [image: >>> >>> Major] REOPENED *Unresolved* 11/Apr/20 11/Mar/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13220750/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/HDFS-14788> HDFS-14788 >>> >>> <https://issues.apache.org/jira/browse/HDFS-14788> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/HDFS-14788> >>> >>> >>> >>> Use dynamic regex filter to ignore copy of source files in Distcp >>> >>> <https://issues.apache.org/jira/browse/HDFS-14788> >>> >>> Mukund Thakur >>> >>> < >>> >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mukund-thakur >>> >>>> >>> >>> Mukund >>> >>> Thakur >>> >>> < >>> >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mukund-thakur >>> >>>> >>> >>> [image: >>> >>> Major] OPEN *Unresolved* 11/Apr/20 28/Aug/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13253437/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/HDFS-12862> HDFS-12862 >>> >>> <https://issues.apache.org/jira/browse/HDFS-12862> [image: Bug] >>> >>> <https://issues.apache.org/jira/browse/HDFS-12862> >>> >>> >>> >>> CacheDirective becomes invalid when NN restart or failover >>> >>> <https://issues.apache.org/jira/browse/HDFS-12862> >>> >>> Wang XL >>> >>> < >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=Wang%20XL> >>> >>> Wang >>> >>> XL < >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=Wang%20XL >>> >>>> >>> >>> [image: >>> >>> Major] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/17 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13121225/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/HDFS-14476> HDFS-14476 >>> >>> <https://issues.apache.org/jira/browse/HDFS-14476> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/HDFS-14476> >>> >>> >>> >>> lock too long when fix inconsistent blocks between disk and in-memory >>> >>> <https://issues.apache.org/jira/browse/HDFS-14476> >>> >>> Sean Chow >>> >>> < >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seanlook> >>> >>> Sean >>> >>> Chow < >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seanlook >>> > >>> >>> [image: >>> >>> Major] PATCH AVAILABLE *Unresolved* 12/Apr/20 07/May/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13231926/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> >>> >>> >>> >>> 1–5 of 5Refresh results >>> >>> < >>> >>> >>> https://issues.apache.org/jira/issues/?jql=project%20in%20(%22Hadoop%20YARN%22)%20AND%20resolution%20%3D%20Unresolved%20AND%20(cf%5B12310320%5D%20%3D%203.3.0%20OR%20fixVersion%20%3D%203.3.0)%20ORDER%20BY%20priority%20DESC# >>> >>>> >>> >>> Columns >>> >>> Patch InfoKeyTSummaryAssigneeReporterP >>> StatusResolutionUpdatedDueCreated >>> >>> <https://issues.apache.org/jira/browse/YARN-10001> YARN-10001 >>> >>> <https://issues.apache.org/jira/browse/YARN-10001> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/YARN-10001> >>> >>> >>> >>> Add explanation of unimplemented methods in >>> InMemoryConfigurationStore >>> >>> <https://issues.apache.org/jira/browse/YARN-10001> >>> >>> Siddharth Ahuja >>> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=sahuja> >>> >>> Szilard >>> >>> Nemeth < >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >>> >>> [image: >>> >>> Major] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13271213/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/YARN-9997> YARN-9997 >>> >>> <https://issues.apache.org/jira/browse/YARN-9997> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/YARN-9997> >>> >>> >>> >>> Code cleanup in ZKConfigurationStore >>> >>> <https://issues.apache.org/jira/browse/YARN-9997> >>> >>> Andras Gyori >>> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=gandras >>> > >>> >>> Szilard >>> >>> Nemeth < >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >>> >>> [image: >>> >>> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13271201/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/YARN-10002> YARN-10002 >>> >>> <https://issues.apache.org/jira/browse/YARN-10002> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/YARN-10002> >>> >>> >>> >>> Code cleanup and improvements in ConfigurationStoreBaseTest >>> >>> <https://issues.apache.org/jira/browse/YARN-10002> >>> >>> Benjamin Teke >>> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=bteke> >>> >>> Szilard >>> >>> Nemeth < >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >>> >>> [image: >>> >>> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13271215/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/YARN-9998> YARN-9998 >>> >>> <https://issues.apache.org/jira/browse/YARN-9998> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/YARN-9998> >>> >>> >>> >>> Code cleanup in LeveldbConfigurationStore >>> >>> <https://issues.apache.org/jira/browse/YARN-9998> >>> >>> Benjamin Teke >>> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=bteke> >>> >>> Szilard >>> >>> Nemeth < >>> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >>> >>> [image: >>> >>> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >>> >>> < >>> >>> >>> https://issues.apache.org/jira/rest/api/1.0/issues/13271202/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >>> >>>> >>> >>> <https://issues.apache.org/jira/browse/YARN-9354> YARN-9354 >>> >>> <https://issues.apache.org/jira/browse/YARN-9354> [image: >>> Improvement] >>> >>> <https://issues.apache.org/jira/browse/YARN-9354> >>> >>> >>> >>> Resources sh <https://issues.apache.org/jira/browse/YARN-9354> >>> >>> >>> >>> On Thu, Apr 9, 2020 at 11:41 PM Brahma Reddy Battula < >>> bra...@apache.org> >>> >>> wrote: >>> >>> >>> >>>> thanks a lot Akira and Prabhu for ping. >>> >>>> >>> >>>> All the blockers/critical issues are fixed. Recently two are >>> reported >>> >>>> again like HADOOP-16955 and HADOOP-16963 waiting for confirmation. >>> >>>> >>> >>>> @prabhu, Those 156 jira's are non-blocker issues which needs to >>> moved to >>> >>>> 3.4.0. and filter for blocker/critical is following. >>> >>>> >>> >>>> project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, >>> >>>> Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 >>> >>> ORDER >>> >>>> BY priority DESC >>> >>>> >>> >>>> >>> >>>> On Thu, Apr 9, 2020 at 12:09 PM Prabhu Joseph < >>> >>> prabhujose.ga...@gmail.com> >>> >>>> wrote: >>> >>>> >>> >>>>> Hi Brahma, >>> >>>>> >>> >>>>> Please let me know if i can be of any help in review and >>> commit / >>> >>>>> clear the pending issues in YARN and MapReduce targeted for 3.3.0. >>> >>>>> I see there are 156 YARN + MapReduce Unresolved Jiras which are >>> either >>> >>>>> with >>> >>>>> target or fix version set to 3.3.0. >>> >>>>> >>> >>>>> project in (YARN, MAPREDUCE) AND resolution = Unresolved AND >>> >>> (cf[12310320] >>> >>>>> = 3.3.0 OR fixVersion = 3.3.0) ORDER BY priority DESC >>> >>>>> >>> >>>>> Thanks, >>> >>>>> Prabhu Joseph >>> >>>>> >>> >>>>> On Tue, Apr 7, 2020 at 1:27 PM Akira Ajisaka <aajis...@apache.org> >>> >>> wrote: >>> >>>>> >>> >>>>>> Hi Brahma, >>> >>>>>> >>> >>>>>> How is this issue going? >>> >>>>>> If there are some blockers, I can help you. >>> >>>>>> >>> >>>>>> -Akira >>> >>>>>> >>> >>>>>> On Mon, Mar 30, 2020 at 3:50 AM Brahma Reddy Battula < >>> >>> bra...@apache.org >>> >>>>>> >>> >>>>>> wrote: >>> >>>>>> >>> >>>>>>> Hi All, >>> >>>>>>> >>> >>>>>>> branch-3.3 created[1] and trunk set to 3.4.0-SNAPSHOT. >>> >>>>>>> >>> >>>>>>> while committing jira's please set the proper fix version and if >>> >>>>> there is >>> >>>>>>> any blocker/critical please commit to branch-3.3 or let me know. >>> >>>>>>> >>> >>>>>>> Planning start 3.3.0 RC0 voting on April-4th,2020(as per previous >>> >>>>>>> communication in another thread[2]). >>> >>>>>>> >>> >>>>>>> >>> >>>>>>> 1.https://github.com/apache/hadoop/commits/branch-3.3 >>> >>>>>>> 2. >>> >>>>> >>> https://lists.apache.org/list.html?common-...@hadoop.apache.org:2020-3 >>> >>>>>>> >>> >>>>>>> >>> >>>>>>> >>> >>>>>>> >>> >>>>>>> --Brahma Reddy Battula >>> >>>>>>> >>> >>>>>> >>> >>>>> >>> >>>> >>> >>>> >>> >>>> -- >>> >>>> >>> >>>> >>> >>>> >>> >>>> --Brahma Reddy Battula >>> >>>> >>> >>> >>> >>> >>> >>> -- >>> >>> >>> >>> >>> >>> >>> >>> --Brahma Reddy Battula >>> >>> >>> >> >>> >>> >> >> -- >> >> >> >> --Brahma Reddy Battula >> > > > -- > > > > --Brahma Reddy Battula >