[jira] [Updated] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5097: - Attachment: YARN-5097-YARN-2928.02.patch Uploading patch v2 with unit tests added > NPE in

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292736#comment-15292736 ] Hadoop QA commented on YARN-5097: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292696#comment-15292696 ] Joep Rottinghuis commented on YARN-5109: I have an almost working prototype where we can combined

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292678#comment-15292678 ] Hadoop QA commented on YARN-5024: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5097: - Attachment: YARN-5097-YARN-2928.01.patch Uploading patch v1. > NPE in Separator.joinEncoded() >

[jira] [Created] (YARN-5116) Failed to execute "yarn application"

2016-05-19 Thread Jun Gong (JIRA)
Jun Gong created YARN-5116: -- Summary: Failed to execute "yarn application" Key: YARN-5116 URL: https://issues.apache.org/jira/browse/YARN-5116 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292632#comment-15292632 ] Bibin A Chundatt commented on YARN-5024: Uploaded patch after using default sleep >

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

2016-05-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292630#comment-15292630 ] Rohith Sharma K S commented on YARN-5068: - backported to 2.8.. Thanks!! > Expose scheduler queue

[jira] [Updated] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5024: --- Attachment: 0006-YARN-5024.patch >

[jira] [Updated] (YARN-5068) Expose scheduler queue to application master

2016-05-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5068: Fix Version/s: (was: 2.9.0) 2.8.0 > Expose scheduler queue to

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292603#comment-15292603 ] Hadoop QA commented on YARN-5112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5112: -- Attachment: YARN-5112.6.patch > Excessive log warnings on NM recovery > - >

[jira] [Commented] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292561#comment-15292561 ] Hadoop QA commented on YARN-5077: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292523#comment-15292523 ] Junping Du commented on YARN-5112: -- bq. it's no straightforward to test the log message occurence, given

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292510#comment-15292510 ] Yufei Gu commented on YARN-4866: All test failures are unrelated. > FairScheduler: AMs can consume all

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292507#comment-15292507 ] Hadoop QA commented on YARN-5018: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292501#comment-15292501 ] Hadoop QA commented on YARN-5112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5098: -- Attachment: YARN-5098.1.patch > Yarn Application log Aggreagation fails due to NM can not get correct HDFS >

[jira] [Commented] (YARN-5097) NPE in Separator.joinEncoded()

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292498#comment-15292498 ] Sangjin Lee commented on YARN-5097: --- I suspect this is indeed related with YARN-5018. The entire context

[jira] [Commented] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292496#comment-15292496 ] Hadoop QA commented on YARN-5113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5112: -- Attachment: YARN-5112.5.patch > Excessive log warnings on NM recovery > - >

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292479#comment-15292479 ] Hadoop QA commented on YARN-4866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292478#comment-15292478 ] Li Lu commented on YARN-5111: - Thanks for the info [~sjlee0]! Probably some wire-up issues in the collector

[jira] [Updated] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5018: Attachment: YARN-5018-YARN-2928.002.patch New patch applies to the latest YARN-2928 branch. > Online aggregation

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2016-05-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5113: -- Description: This JIRA focuses on the refactoring of classes related to Distributed Scheduling (was:

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2016-05-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5113: - Description: This JIRA focuses on the refactoring of classes related to YARN-2885.

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292448#comment-15292448 ] Hadoop QA commented on YARN-5112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2016-05-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292450#comment-15292450 ] Arun Suresh commented on YARN-5113: --- [~kkaranasos], the changes to {{MiniYarnCluster}} can be reverted.

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling

2016-05-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5113: -- Summary: Refactoring and other clean-up for distributed scheduling (was: Refactoring and other clean-up

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292446#comment-15292446 ] Sangjin Lee commented on YARN-5018: --- I don't think it is a band-aid. I think it is more than acceptable

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292442#comment-15292442 ] Sangjin Lee commented on YARN-5111: --- I saw this with a sleep job that ran for 5 minutes. I also checked

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

2016-05-19 Thread Harish Jaiprakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292439#comment-15292439 ] Harish Jaiprakash commented on YARN-5068: - Thanks Rohith. Is it possible to get this patch on 2.8.0

[jira] [Commented] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292438#comment-15292438 ] Hadoop QA commented on YARN-5018: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2016-05-19 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292429#comment-15292429 ] Larry McCay commented on YARN-4006: --- Hi [~aw] - I am familiar with AltKerberosAuthenticationHandler if

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling interceptor

2016-05-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5113: - Attachment: YARN-5113.002.patch Attaching new version of the patch. > Refactoring

[jira] [Updated] (YARN-5018) Online aggregation logic should not run immediately after collectors got started

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5018: Attachment: YARN-5018-YARN-2928.001.patch OK let me do a first-aid style fix to this problem. The problem occurs

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for distributed scheduling interceptor

2016-05-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5113: - Summary: Refactoring and other clean-up for distributed scheduling interceptor

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for YARN-2885

2016-05-19 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5113: - Summary: Refactoring and other clean-up for YARN-2885 (was: Refactoring and other

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292421#comment-15292421 ] Li Lu commented on YARN-5050: - Sorry I mean, a +1 from Jenkins... I'm not trying to +1 my own patch... > Code

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292416#comment-15292416 ] Li Lu commented on YARN-5111: - Here I think I forgot one thing which could be the cause. I forgot to send the

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292414#comment-15292414 ] Hadoop QA commented on YARN-1942: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292408#comment-15292408 ] Jian He commented on YARN-5112: --- Fixing the checkstyle, it's no straightforward to test the log message

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292411#comment-15292411 ] Sangjin Lee commented on YARN-5050: --- +1. I'll commit it shortly. > Code cleanup for TestDistributedShell

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292410#comment-15292410 ] Li Lu commented on YARN-5050: - +1, finally! > Code cleanup for TestDistributedShell >

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292407#comment-15292407 ] Hadoop QA commented on YARN-5050: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

2016-05-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292405#comment-15292405 ] Yufei Gu commented on YARN-5024: Thanks [~bibinchundatt] for working on this. Looks good to me. A nit:

[jira] [Updated] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5112: -- Attachment: YARN-5112.4.patch > Excessive log warnings on NM recovery > - >

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292399#comment-15292399 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292379#comment-15292379 ] Sangjin Lee commented on YARN-5050: --- Thanks for the explanation. I'll wait for the jenkins run. > Code

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292378#comment-15292378 ] Junping Du commented on YARN-5112: -- Thanks Jian for the patch. Latest patch LGTM. However, can we add a

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

2016-05-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.006.patch The patch 006 fixed the style issues and the bug, add some test code to test

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292349#comment-15292349 ] Karthik Kambatla commented on YARN-4464: bq. The patch is changing the config for max number of

[jira] [Updated] (YARN-5050) Code cleanup for TestDistributedShell

2016-05-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5050: Attachment: YARN-5050-YARN-2928.002.patch 002 patch to fix the intermittent UT failure. I changed the async

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292288#comment-15292288 ] Hadoop QA commented on YARN-5112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292278#comment-15292278 ] Sangjin Lee commented on YARN-5096: --- Committed it: {noformat} commit

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292277#comment-15292277 ] Hadoop QA commented on YARN-4766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292275#comment-15292275 ] Sangjin Lee commented on YARN-5096: --- Ah I missed that one. Thanks for letting me know. I'll make that

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292270#comment-15292270 ] Sangjin Lee commented on YARN-5109: --- Another related issue I see is currently the event id and the info

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292268#comment-15292268 ] Hadoop QA commented on YARN-4878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-05-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292245#comment-15292245 ] John Zhuge commented on YARN-5007: -- Like your idea of including MiniMRYarnCluster and MiniYarnCluster in

[jira] [Updated] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5112: -- Attachment: YARN-5112.3.patch Thanks for the review, sounds good to me. Uploaded a new patch to address the

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292233#comment-15292233 ] Hadoop QA commented on YARN-5093: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292229#comment-15292229 ] Sangjin Lee commented on YARN-5109: --- Joep, Vrushali, and I discussed some more offline, and we realized

[jira] [Commented] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-05-19 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292224#comment-15292224 ] Andras Bokor commented on YARN-5007: [~jzhuge] This issue came up on YARN-4494. Either

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: yarn4766.005.patch > NM should not aggregate logs older than the retention policy >

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-05-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292217#comment-15292217 ] Haibo Chen commented on YARN-4766: -- Thanks Ray for your comment, the name you suggested is much better.

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

2016-05-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292213#comment-15292213 ] Junping Du commented on YARN-5112: -- Thanks [~jianhe] for updating the patch. Remove

[jira] [Commented] (YARN-5076) YARN web interfaces lack XFS protection

2016-05-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292192#comment-15292192 ] Hudson commented on YARN-5076: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9826 (See

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292175#comment-15292175 ] Jian He commented on YARN-4464: --- The patch is changing the config for max number of completed apps RM keeps

[jira] [Updated] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

2016-05-19 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4878: --- Attachment: YARN-4878.004.patch The patch 004 fixed the style issue except the first one. The first style

[jira] [Commented] (YARN-5114) TestRMWebServicesApps#testInvalidAppAttempts failure

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292140#comment-15292140 ] Hadoop QA commented on YARN-5114: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5076) YARN web interfaces lack XFS protection

2016-05-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292130#comment-15292130 ] Junping Du commented on YARN-5076: -- The other check-style issue is just a minor whitespace issue. Will fix

[jira] [Commented] (YARN-5076) YARN web interfaces lack XFS protection

2016-05-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292126#comment-15292126 ] Junping Du commented on YARN-5076: -- That's right. Just check again that it sounds like we were not adding

[jira] [Updated] (YARN-5093) created time shows 0 in most REST output

2016-05-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5093: --- Attachment: YARN-5093-YARN-2928.01.patch > created time shows 0 in most REST output >

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292113#comment-15292113 ] Karthik Kambatla commented on YARN-4464: +1. Will commit this to trunk tomorrow if no one objects.

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2016-05-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292111#comment-15292111 ] Allen Wittenauer commented on YARN-4006: Talking with my client, they've tried their AltKerb

[jira] [Updated] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Attachment: YARN-4844.11.patch > Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource >

[jira] [Updated] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

2016-05-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1942: - Attachment: YARN-1942.8.patch > Many of ConverterUtils methods need to have public interfaces >

[jira] [Updated] (YARN-5093) created time shows 0 in most REST output

2016-05-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5093: --- Attachment: YARN-5093-YARN-2928.01.patch > created time shows 0 in most REST output >

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

2016-05-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292058#comment-15292058 ] Hudson commented on YARN-4002: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9825 (See

[jira] [Commented] (YARN-5055) max per user can be larger than max per queue

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292053#comment-15292053 ] Hadoop QA commented on YARN-5055: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5096) timelinereader has a lot of logging that's not useful

2016-05-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292049#comment-15292049 ] Varun Saxena commented on YARN-5096: [~sjlee0], ColumnHelper has another null prefix log at line 262.

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292021#comment-15292021 ] Hadoop QA commented on YARN-4464: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15292009#comment-15292009 ] Ray Chiang commented on YARN-4464: -- +1 (nonbinding), pending Jenkins. Passed TestYarnConfigurationFields

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: YARN-4464.003.patch Oy vey. I clearly need sleep. Here's the correct correct

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291983#comment-15291983 ] Varun Saxena commented on YARN-5109: Writing down what we discussed in the meeting with regards to

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291981#comment-15291981 ] Ray Chiang commented on YARN-4464: -- This patch looks like it modifies the property

[jira] [Updated] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-05-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4876: -- Attachment: YARN-4876.002.patch > [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop >

[jira] [Updated] (YARN-5055) max per user can be larger than max per queue

2016-05-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5055: -- Attachment: YARN-5055.002.patch Fixing checkstyle. > max per user can be larger than max per queue >

[jira] [Commented] (YARN-5055) max per user can be larger than max per queue

2016-05-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291962#comment-15291962 ] Hadoop QA commented on YARN-5055: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-05-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291963#comment-15291963 ] Arun Suresh commented on YARN-4876: --- Attaching rebased patch.. > [Phase 1] Decoupled Init / Destroy of

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-05-19 Thread Marco Rabozzi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291954#comment-15291954 ] Marco Rabozzi commented on YARN-4876: - Thanks [~vvasudev] for looking at the patch! Regarding the

[jira] [Updated] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-19 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5109: --- Attachment: YARN-5109-YARN-2928.01.patch > timestamps are stored unencoded causing parse errors >

[jira] [Commented] (YARN-5115) Security risk by using CONTENT-DISPOSITION header

2016-05-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291905#comment-15291905 ] Xuan Gong commented on YARN-5115: - Trivial patch to simply remove CONTENT-DISPOSITION header in

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: YARN-4464.002.patch > default value of

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-05-19 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: (was: YARN-4664.002.patch) > default value of

[jira] [Commented] (YARN-5115) Security risk by using CONTENT-DISPOSITION header

2016-05-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291907#comment-15291907 ] Xuan Gong commented on YARN-5115: - Did manual testing without setting CONTENT-DISPOSITION header, we could

[jira] [Updated] (YARN-5115) Security risk by using CONTENT-DISPOSITION header

2016-05-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5115: Attachment: YARN-5115.1.patch > Security risk by using CONTENT-DISPOSITION header >

[jira] [Created] (YARN-5115) Security risk by using CONTENT-DISPOSITION header

2016-05-19 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-5115: --- Summary: Security risk by using CONTENT-DISPOSITION header Key: YARN-5115 URL: https://issues.apache.org/jira/browse/YARN-5115 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-5115) Security risk by using CONTENT-DISPOSITION header

2016-05-19 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-5115: --- Assignee: Xuan Gong > Security risk by using CONTENT-DISPOSITION header >

  1   2   >