[jira] [Created] (YARN-9556) Most containers will go through the process of ending twice when they are finished

2019-05-14 Thread liyakun (JIRA)
liyakun created YARN-9556: - Summary: Most containers will go through the process of ending twice when they are finished Key: YARN-9556 URL: https://issues.apache.org/jira/browse/YARN-9556 Project: Hadoop

[jira] [Updated] (YARN-9554) TimelineEntity DAO has java.util.Set interface which JAXB can't handle

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9554: Component/s: timelineservice > TimelineEntity DAO has java.util.Set interface which JAXB can't

[jira] [Updated] (YARN-9553) TimelineWebService Rest Api {entityType}/events throws NPE

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9553: Description: TimelineWebService Rest Api entityType/events throws NPE {code}

[jira] [Updated] (YARN-9553) TimelineWebService Rest Api {entityType}/events throws NPE

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9553: Component/s: timelineservice > TimelineWebService Rest Api {entityType}/events throws NPE >

[jira] [Updated] (YARN-9553) TimelineWebService Rest Api {entityType}/events throws NPE

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9553: Affects Version/s: 3.2.0 > TimelineWebService Rest Api {entityType}/events throws NPE >

[jira] [Updated] (YARN-9550) Suspect wrong way to calculate container utilized vcore.

2019-05-14 Thread Sihai Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihai Ke updated YARN-9550: --- Summary: Suspect wrong way to calculate container utilized vcore. (was: Suspect wrong way to calculater

[jira] [Created] (YARN-9555) Yarn Docs : single cluster yarn setup - Step 1 configure parameters - multiple roots

2019-05-14 Thread Vishva (JIRA)
Vishva created YARN-9555: Summary: Yarn Docs : single cluster yarn setup - Step 1 configure parameters - multiple roots Key: YARN-9555 URL: https://issues.apache.org/jira/browse/YARN-9555 Project: Hadoop

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2019-05-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839830#comment-16839830 ] Weiwei Yang commented on YARN-9538: --- Hi [~Tao Yang] Thanks for working on the documentation. I just did

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839812#comment-16839812 ] Weiwei Yang commented on YARN-9497: --- Thanks [~Tao Yang] for the updates, it looks good now. I have one

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839764#comment-16839764 ] Prabhu Joseph commented on YARN-8625: - [~eepayne], Can you check if hadoop on your test cluster has

[jira] [Created] (YARN-9554) TimelineEntity DAO has java.util.Set interface which JAXB can't handle

2019-05-14 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9554: --- Summary: TimelineEntity DAO has java.util.Set interface which JAXB can't handle Key: YARN-9554 URL: https://issues.apache.org/jira/browse/YARN-9554 Project: Hadoop

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839741#comment-16839741 ] Hadoop QA commented on YARN-2194: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839719#comment-16839719 ] Jim Brennan commented on YARN-2194: --- As I mentioned in [YARN-9518], I am also +1 on this patch for

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839715#comment-16839715 ] Haibo Chen commented on YARN-2194: -- +1 on the patch pending Jenkins. > Cgroups cease to work in RHEL7 >

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839709#comment-16839709 ] Hadoop QA commented on YARN-9518: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839699#comment-16839699 ] Jonathan Hung commented on YARN-9518: - Yes, makes sense [~Jim_Brennan]. Attached a patch to YARN-2194.

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-2194: Attachment: YARN-2194-branch-2.7.001.patch > Cgroups cease to work in RHEL7 >

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839698#comment-16839698 ] Jonathan Hung commented on YARN-2194: - Attaching a branch-2.7 patch. (Ref: YARN-9518) > Cgroups cease

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-2194: Attachment: YARN-9518-branch-2.7.002.patch > Cgroups cease to work in RHEL7 >

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-2194: Attachment: (was: YARN-9518-branch-2.7.002.patch) > Cgroups cease to work in RHEL7 >

[jira] [Reopened] (YARN-2194) Cgroups cease to work in RHEL7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reopened YARN-2194: - > Cgroups cease to work in RHEL7 > -- > > Key: YARN-2194

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-05-14 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839693#comment-16839693 ] Jim Brennan commented on YARN-9518: --- Thanks [~jhung]!  The patch looks good to me.  I also built it and

[jira] [Commented] (YARN-9519) TFile log aggregation file format is not working for yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839675#comment-16839675 ] Hudson commented on YARN-9519: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16548 (See

[jira] [Updated] (YARN-9519) TFile log aggregation file format is not working for yarn.log-aggregation.TFile.remote-app-log-dir config

2019-05-14 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-9519: - Summary: TFile log aggregation file format is not working for

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839643#comment-16839643 ] Jonathan Hung commented on YARN-9518: - Yes, I agree with [~Jim_Brennan]. Actually we had this patch

[jira] [Updated] (YARN-9518) can't use CGroups with YARN in centos7

2019-05-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9518: Attachment: YARN-9518-branch-2.7.002.patch > can't use CGroups with YARN in centos7 >

[jira] [Commented] (YARN-9518) can't use CGroups with YARN in centos7

2019-05-14 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839570#comment-16839570 ] Jim Brennan commented on YARN-9518: --- [~shurong.mai], ideally we would use the same solution in 2.7 that

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839525#comment-16839525 ] Prabhu Joseph commented on YARN-9545: - [~zsiegl] Yes separate endpoint health looks fine to me since

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839464#comment-16839464 ] Hadoop QA commented on YARN-9552: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-05-14 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839456#comment-16839456 ] Zoltan Siegl commented on YARN-9545: Thanks for the thoughts. Pros: no new endpoint is necessary.

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839432#comment-16839432 ] Szilard Nemeth commented on YARN-9552: -- Hi [~pbacsko]! Please add a javadoc to the newly added test

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-002.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839356#comment-16839356 ] Hadoop QA commented on YARN-9552: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9553) TimelineWebService Rest Api {entityType}/events throws NPE

2019-05-14 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9553: --- Summary: TimelineWebService Rest Api {entityType}/events throws NPE Key: YARN-9553 URL: https://issues.apache.org/jira/browse/YARN-9553 Project: Hadoop YARN

[jira] [Commented] (YARN-9508) YarnConfiguration areNodeLabel enabled is costly in allocation flow

2019-05-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839300#comment-16839300 ] Bibin A Chundatt commented on YARN-9508: Thank you [~BilwaST] for updated patch +1 for latest

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-001.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Summary: FairScheduler: NODE_UPDATE can cause NoSuchElementException (was: FairScheduler:

[jira] [Created] (YARN-9552) FairScheduler: NODE_UPDATE can cause a NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9552: -- Summary: FairScheduler: NODE_UPDATE can cause a NoSuchElementException Key: YARN-9552 URL: https://issues.apache.org/jira/browse/YARN-9552 Project: Hadoop YARN

[jira] [Commented] (YARN-9508) YarnConfiguration areNodeLabel enabled is costly in allocation flow

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839207#comment-16839207 ] Hadoop QA commented on YARN-9508: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9547) ContainerStatusPBImpl default execution type is not returned

2019-05-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839188#comment-16839188 ] Bibin A Chundatt commented on YARN-9547: Thank you [~BilwaST] for patch Fix looks good to me.

[jira] [Commented] (YARN-9542) LogsCLI guessAppOwner ignores custom file format suffix

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839187#comment-16839187 ] Prabhu Joseph commented on YARN-9542: - [~giovanni.fumarola] Can you review this jira when you get

[jira] [Created] (YARN-9551) TestTimelineClientV2Impl.testSyncCall fails intermittent

2019-05-14 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9551: --- Summary: TestTimelineClientV2Impl.testSyncCall fails intermittent Key: YARN-9551 URL: https://issues.apache.org/jira/browse/YARN-9551 Project: Hadoop YARN

[jira] [Updated] (YARN-9551) TestTimelineClientV2Impl.testSyncCall fails intermittent

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9551: Priority: Minor (was: Major) > TestTimelineClientV2Impl.testSyncCall fails intermittent >

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839182#comment-16839182 ] Hadoop QA commented on YARN-8625: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8625: Attachment: ApplicationHistoryServer_UI.png ApplicationHistoryServer_Rest_Api.png >

[jira] [Commented] (YARN-8625) Aggregate Resource Allocation for each job is not present in ATS

2019-05-14 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839177#comment-16839177 ] Prabhu Joseph commented on YARN-8625: - [~eepayne] Suspect Resourcemanager address and port is used.

[jira] [Commented] (YARN-9547) ContainerStatusPBImpl default execution type is not returned

2019-05-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839175#comment-16839175 ] Hadoop QA commented on YARN-9547: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9547) ContainerStatusPBImpl default execution type is not returned

2019-05-14 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9547: Attachment: YARN-9547-001.patch > ContainerStatusPBImpl default execution type is not returned >

[jira] [Commented] (YARN-9508) YarnConfiguration areNodeLabel enabled is costly in allocation flow

2019-05-14 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839135#comment-16839135 ] Bilwa S T commented on YARN-9508: - {quote}Hi [~bibinchundatt]                  

[jira] [Updated] (YARN-9508) YarnConfiguration areNodeLabel enabled is costly in allocation flow

2019-05-14 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9508: Attachment: YARN-9508-003.patch > YarnConfiguration areNodeLabel enabled is costly in allocation flow >