Hi everyone, Sorry for coming a bit late with this, but there's also one jira that can have potential impact on clusters and we should talk about it.
Steven Rand found this problem earlier and commented to https://issues.apache.org/jira/browse/YARN-4946. The bug has impact on the RM state store: the RM does not delete apps - see more details in his comment here: https://issues.apache.org/jira/browse/YARN-4946?focusedCommentId=16898599&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16898599 . (FYI He also created https://issues.apache.org/jira/browse/YARN-9848 with the revert task). It might not be an actual blocker, but since there wasn't any consensus about a follow up action, I thought we should decide how to proceed before release 3.3.0. Regards, Adam On Tue, Apr 14, 2020 at 9:35 AM Prabhu Joseph <prabhujose.ga...@gmail.com> wrote: > Thanks Brahma for the update. > > Have committed the YARN blocker YARN-10219 to trunk and cherry-picked to > branch-3.3. Right now, there are two blocker Jiras - YARN-10233 and > HADOOP-16982 > which i will help to review and commit. Thanks. > > [image: Screen Shot 2020-04-14 at 1.01.51 PM.png] > > project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, > Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 ORDER > BY priority DESC > > > On Sun, Apr 12, 2020 at 12:19 AM Brahma Reddy Battula <bra...@apache.org> > wrote: > >> *Pending for 3.3.0 Release:* >> >> One Blocker(HADOOP-16963) confirmation and following jira's are open as >> these needs to merged to other branches(I am tracking the same, Ideally >> this can be closed and can raise seperate jira's to track). >> >> >> 1–4 of 4Refresh results >> < >> https://issues.apache.org/jira/issues/?jql=project%20in%20(%22Hadoop%20HDFS%22)%20AND%20resolution%20%3D%20Unresolved%20AND%20(cf%5B12310320%5D%20%3D%203.3.0%20OR%20fixVersion%20%3D%203.3.0)%20ORDER%20BY%20priority%20DESC# >> > >> Columns >> Patch InfoKeyTSummaryAssigneeReporterP StatusResolutionUpdatedDueCreated >> <https://issues.apache.org/jira/browse/HDFS-14353> HDFS-14353 >> <https://issues.apache.org/jira/browse/HDFS-14353> [image: Sub-task] >> <https://issues.apache.org/jira/browse/HDFS-14353> >> >> HDFS-8031 <https://issues.apache.org/jira/browse/HDFS-8031> Erasure >> Coding: >> metrics xmitsInProgress become to negative. >> <https://issues.apache.org/jira/browse/HDFS-14353> >> maobaolong >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=maobaolong> >> maobaolong >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=maobaolong> >> [image: >> Major] REOPENED *Unresolved* 11/Apr/20 11/Mar/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13220750/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/HDFS-14788> HDFS-14788 >> <https://issues.apache.org/jira/browse/HDFS-14788> [image: Improvement] >> <https://issues.apache.org/jira/browse/HDFS-14788> >> >> Use dynamic regex filter to ignore copy of source files in Distcp >> <https://issues.apache.org/jira/browse/HDFS-14788> >> Mukund Thakur >> < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mukund-thakur >> > >> Mukund >> Thakur >> < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mukund-thakur >> > >> [image: >> Major] OPEN *Unresolved* 11/Apr/20 28/Aug/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13253437/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/HDFS-12862> HDFS-12862 >> <https://issues.apache.org/jira/browse/HDFS-12862> [image: Bug] >> <https://issues.apache.org/jira/browse/HDFS-12862> >> >> CacheDirective becomes invalid when NN restart or failover >> <https://issues.apache.org/jira/browse/HDFS-12862> >> Wang XL >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=Wang%20XL> >> Wang >> XL <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=Wang%20XL >> > >> [image: >> Major] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/17 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13121225/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/HDFS-14476> HDFS-14476 >> <https://issues.apache.org/jira/browse/HDFS-14476> [image: Improvement] >> <https://issues.apache.org/jira/browse/HDFS-14476> >> >> lock too long when fix inconsistent blocks between disk and in-memory >> <https://issues.apache.org/jira/browse/HDFS-14476> >> Sean Chow >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seanlook> >> Sean >> Chow < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seanlook> >> [image: >> Major] PATCH AVAILABLE *Unresolved* 12/Apr/20 07/May/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13231926/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> >> >> 1–5 of 5Refresh results >> < >> https://issues.apache.org/jira/issues/?jql=project%20in%20(%22Hadoop%20YARN%22)%20AND%20resolution%20%3D%20Unresolved%20AND%20(cf%5B12310320%5D%20%3D%203.3.0%20OR%20fixVersion%20%3D%203.3.0)%20ORDER%20BY%20priority%20DESC# >> > >> Columns >> Patch InfoKeyTSummaryAssigneeReporterP StatusResolutionUpdatedDueCreated >> <https://issues.apache.org/jira/browse/YARN-10001> YARN-10001 >> <https://issues.apache.org/jira/browse/YARN-10001> [image: Improvement] >> <https://issues.apache.org/jira/browse/YARN-10001> >> >> Add explanation of unimplemented methods in InMemoryConfigurationStore >> <https://issues.apache.org/jira/browse/YARN-10001> >> Siddharth Ahuja >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=sahuja> >> Szilard >> Nemeth < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> [image: >> Major] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13271213/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/YARN-9997> YARN-9997 >> <https://issues.apache.org/jira/browse/YARN-9997> [image: Improvement] >> <https://issues.apache.org/jira/browse/YARN-9997> >> >> Code cleanup in ZKConfigurationStore >> <https://issues.apache.org/jira/browse/YARN-9997> >> Andras Gyori >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=gandras> >> Szilard >> Nemeth < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> [image: >> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13271201/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/YARN-10002> YARN-10002 >> <https://issues.apache.org/jira/browse/YARN-10002> [image: Improvement] >> <https://issues.apache.org/jira/browse/YARN-10002> >> >> Code cleanup and improvements in ConfigurationStoreBaseTest >> <https://issues.apache.org/jira/browse/YARN-10002> >> Benjamin Teke >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=bteke> >> Szilard >> Nemeth < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> [image: >> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13271215/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/YARN-9998> YARN-9998 >> <https://issues.apache.org/jira/browse/YARN-9998> [image: Improvement] >> <https://issues.apache.org/jira/browse/YARN-9998> >> >> Code cleanup in LeveldbConfigurationStore >> <https://issues.apache.org/jira/browse/YARN-9998> >> Benjamin Teke >> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=bteke> >> Szilard >> Nemeth < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> [image: >> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> < >> https://issues.apache.org/jira/rest/api/1.0/issues/13271202/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> > >> <https://issues.apache.org/jira/browse/YARN-9354> YARN-9354 >> <https://issues.apache.org/jira/browse/YARN-9354> [image: Improvement] >> <https://issues.apache.org/jira/browse/YARN-9354> >> >> Resources sh <https://issues.apache.org/jira/browse/YARN-9354> >> >> On Thu, Apr 9, 2020 at 11:41 PM Brahma Reddy Battula <bra...@apache.org> >> wrote: >> >> > thanks a lot Akira and Prabhu for ping. >> > >> > All the blockers/critical issues are fixed. Recently two are reported >> > again like HADOOP-16955 and HADOOP-16963 waiting for confirmation. >> > >> > @prabhu, Those 156 jira's are non-blocker issues which needs to moved to >> > 3.4.0. and filter for blocker/critical is following. >> > >> > project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, >> > Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 >> ORDER >> > BY priority DESC >> > >> > >> > On Thu, Apr 9, 2020 at 12:09 PM Prabhu Joseph < >> prabhujose.ga...@gmail.com> >> > wrote: >> > >> >> Hi Brahma, >> >> >> >> Please let me know if i can be of any help in review and commit / >> >> clear the pending issues in YARN and MapReduce targeted for 3.3.0. >> >> I see there are 156 YARN + MapReduce Unresolved Jiras which are either >> >> with >> >> target or fix version set to 3.3.0. >> >> >> >> project in (YARN, MAPREDUCE) AND resolution = Unresolved AND >> (cf[12310320] >> >> = 3.3.0 OR fixVersion = 3.3.0) ORDER BY priority DESC >> >> >> >> Thanks, >> >> Prabhu Joseph >> >> >> >> On Tue, Apr 7, 2020 at 1:27 PM Akira Ajisaka <aajis...@apache.org> >> wrote: >> >> >> >> > Hi Brahma, >> >> > >> >> > How is this issue going? >> >> > If there are some blockers, I can help you. >> >> > >> >> > -Akira >> >> > >> >> > On Mon, Mar 30, 2020 at 3:50 AM Brahma Reddy Battula < >> bra...@apache.org >> >> > >> >> > wrote: >> >> > >> >> > > Hi All, >> >> > > >> >> > > branch-3.3 created[1] and trunk set to 3.4.0-SNAPSHOT. >> >> > > >> >> > > while committing jira's please set the proper fix version and if >> >> there is >> >> > > any blocker/critical please commit to branch-3.3 or let me know. >> >> > > >> >> > > Planning start 3.3.0 RC0 voting on April-4th,2020(as per previous >> >> > > communication in another thread[2]). >> >> > > >> >> > > >> >> > > 1.https://github.com/apache/hadoop/commits/branch-3.3 >> >> > > 2. >> >> https://lists.apache.org/list.html?common-...@hadoop.apache.org:2020-3 >> >> > > >> >> > > >> >> > > >> >> > > >> >> > > --Brahma Reddy Battula >> >> > > >> >> > >> >> >> > >> > >> > -- >> > >> > >> > >> > --Brahma Reddy Battula >> > >> >> >> -- >> >> >> >> --Brahma Reddy Battula >> >
