[jira] [Commented] (YARN-6317) Get rid of Resources#multiplyAndRoundDown since it duplicates Resources#multiply

2017-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907325#comment-15907325 ] Gergely Novák commented on YARN-6317: - Uploaded a trivial patch for this. > Get rid of

[jira] [Assigned] (YARN-6317) Get rid of Resources#multiplyAndRoundDown since it duplicates Resources#multiply

2017-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-6317: --- Assignee: Gergely Novák > Get rid of Resources#multiplyAndRoundDown since it duplicates >

[jira] [Updated] (YARN-6317) Get rid of Resources#multiplyAndRoundDown since it duplicates Resources#multiply

2017-03-13 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6317: Attachment: YARN-6317.001.patch > Get rid of Resources#multiplyAndRoundDown since it duplicates >

[jira] [Updated] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread esmaeil mirzaee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] esmaeil mirzaee updated YARN-6309: -- Hi everyone, Recently, I have finished my MS'c in computer science and I am going to do my PhD. So,

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907172#comment-15907172 ] Hadoop QA commented on YARN-6195: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-6330: - Attachment: YARN-6330-001.patch patch 001. Doesn't fix it completely; stops the two patched

[jira] [Updated] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2017-03-13 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-4051: --- Attachment: YARN-4051.07.patch > ContainerKillEvent is lost when container is In New State and is recovering

[jira] [Updated] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-13 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-6315: -- Attachment: YARN-6315.002.patch Fixing checkstyle warnings. > Improve

[jira] [Commented] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907706#comment-15907706 ] Hadoop QA commented on YARN-6330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-03-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907541#comment-15907541 ] Jason Lowe commented on YARN-6195: -- Thanks for updating the patch! I discovered the queue metrics are

[jira] [Created] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-6330: Summary: DefaultContainerExecutor container launch fails if script dest dir has a space in the path Key: YARN-6330 URL: https://issues.apache.org/jira/browse/YARN-6330

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907698#comment-15907698 ] Hadoop QA commented on YARN-6315: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907618#comment-15907618 ] Hadoop QA commented on YARN-4051: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2017-03-13 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907544#comment-15907544 ] sandflee commented on YARN-4051: Thanks [~jlowe], bq. I'm also wondering about the scenario where the

[jira] [Assigned] (YARN-2960) Add documentation for the YARN shared cache

2017-03-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-2960: -- Assignee: Chris Trezzo > Add documentation for the YARN shared cache >

[jira] [Commented] (YARN-3884) App History status not updated when RMContainer transitions from RESERVED to KILLED

2017-03-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907825#comment-15907825 ] Joep Rottinghuis commented on YARN-3884: While the load on the RM daemon to write to atsv2 is a

[jira] [Updated] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6288: Attachment: YARN-6288.03.patch 03 patch * Removed unnecessary initialization for mock * Refactored

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15906964#comment-15906964 ] Hadoop QA commented on YARN-6208: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-03-13 Thread Benson Qiu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benson Qiu updated YARN-6195: - Attachment: YARN-6195.002.patch > Export UsedCapacity and AbsoluteUsedCapacity to JMX >

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907007#comment-15907007 ] Hadoop QA commented on YARN-6288: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6288: Attachment: YARN-6288.02.patch Reflected Haibo's comment. Thanks! > Refactor

[jira] [Updated] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6208: Attachment: YARN-6208.02.patch Thanks [~templedf]! Your comment makes sense to me. Updated the

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907033#comment-15907033 ] Akira Ajisaka commented on YARN-6288: - Probably the test failure is not related to the patch. I ran the

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923082#comment-15923082 ] Vinod Kumar Vavilapalli commented on YARN-6314: --- bq. btw, use "redirected" may be better. Can

[jira] [Assigned] (YARN-6139) There are no docs for file localization

2017-03-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-6139: Assignee: Haibo Chen > There are no docs for file localization >

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923137#comment-15923137 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923140#comment-15923140 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923132#comment-15923132 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923139#comment-15923139 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923141#comment-15923141 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923136#comment-15923136 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923133#comment-15923133 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923135#comment-15923135 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923134#comment-15923134 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923138#comment-15923138 ] ASF GitHub Bot commented on YARN-5829: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923151#comment-15923151 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Updated] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6314: Attachment: YARN-6314.2.patch > Potential infinite redirection on YARN log redirection web service >

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-13 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923208#comment-15923208 ] yunjiong zhao commented on YARN-6285: - Sorry for late response. 2.25 seconds in getApplications doesn't

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923171#comment-15923171 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923153#comment-15923153 ] Hadoop QA commented on YARN-6313: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5829) FS preemption should reserve a node before considering containers on it for preemption

2017-03-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923164#comment-15923164 ] ASF GitHub Bot commented on YARN-5829: -- Github user szegedim commented on a diff in the pull request:

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-13 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923241#comment-15923241 ] yunjiong zhao commented on YARN-6285: - I used below code for testing replace and substring, replace

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-13 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907917#comment-15907917 ] Kuhu Shukla commented on YARN-6315: --- [~jlowe], [~eepayne], Request for comments/review. Thanks a lot! >

[jira] [Commented] (YARN-6195) Export UsedCapacity and AbsoluteUsedCapacity to JMX

2017-03-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922687#comment-15922687 ] Jason Lowe commented on YARN-6195: -- Pinging [~leftnoteasy] and [~sunilg] to see if there's an opinion on

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15908405#comment-15908405 ] Haibo Chen commented on YARN-6288: -- Thanks [~ajisakaa] for updating the patch! One comment. Can you

[jira] [Updated] (YARN-6313) yarn logs cli should provide logs for a completed container (with nm address provided) even when application is running

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6313: - Summary: yarn logs cli should provide logs for a completed container (with nm address provided) even when

[jira] [Updated] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is running

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6313: - Summary: yarn logs cli should provide logs for a completed container even when application is running

[jira] [Commented] (YARN-4504) Retrospect on defaults for created time while querying

2017-03-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922710#comment-15922710 ] Haibo Chen commented on YARN-4504: -- [~varun_saxena] Can you please provide more context? > Retrospect on

[jira] [Commented] (YARN-6313) yarn logs cli does not provide logs for a completed container even when the nm address is provided

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15914204#comment-15914204 ] Junping Du commented on YARN-6313: -- This feature/improvement is very useful when we debugging a running

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container (with nm address provided) even when application is running

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15915429#comment-15915429 ] Junping Du commented on YARN-6313: -- Update the title of this jira to reflect the improvement here. > yarn

[jira] [Updated] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6313: - Summary: yarn logs cli should provide logs for a completed container even when application is still

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923289#comment-15923289 ] Wangda Tan commented on YARN-6285: -- Thanks [~zhaoyunjiong] for providing these information. bq. Should I

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923316#comment-15923316 ] Wangda Tan commented on YARN-6050: -- [~rkanter], bq. If you think it would be better to use not change

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1592#comment-1592 ] Junping Du commented on YARN-6314: -- bq. So if NM address is provided by user in the beginning, it sounds

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923346#comment-15923346 ] Hadoop QA commented on YARN-6313: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6326: --- Attachment: (was: YARN-6326.002.patch) > Shouldn't use AppAttemptIds to fetch applications while AM

[jira] [Updated] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6208: Attachment: YARN-6208.03.patch Thanks Daniel. Updated the patch to address your comment. > Improve

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923413#comment-15923413 ] Hadoop QA commented on YARN-6208: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923244#comment-15923244 ] Xuan Gong commented on YARN-6313: - The compilation issue should not be related. Re-kick the Jenkins > yarn

[jira] [Updated] (YARN-6319) race condition between deleting app dir and deleting container dir

2017-03-13 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-6319: -- Description: Last container (on one node) of one app complete |--> triggers async deletion of

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-13 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923364#comment-15923364 ] yunjiong zhao commented on YARN-6285: - {quote} convertFromProtoFormat is called once for every app

[jira] [Updated] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6288: Attachment: YARN-6288.04.patch Thanks. Updated the patch to use try-with-resources in the tests. >

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-13 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923395#comment-15923395 ] Xuan Gong commented on YARN-6313: - I can successfully compile the trunk code with the patch locally. >

[jira] [Commented] (YARN-6320) FairScheduler:Identifying apps to assign in updateThread

2017-03-13 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923469#comment-15923469 ] Tao Jie commented on YARN-6320: --- [~kasha] thank you for sharing your comment. I try to do like that, we

[jira] [Updated] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6326: --- Attachment: YARN-6326.002.patch > Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923375#comment-15923375 ] Hadoop QA commented on YARN-6314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923384#comment-15923384 ] Junping Du commented on YARN-6314: -- +1. Committing it in. > Potential infinite redirection on YARN log

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923475#comment-15923475 ] Hadoop QA commented on YARN-6288: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6326: --- Attachment: YARN-6326.002.patch > Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks

[jira] [Commented] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923495#comment-15923495 ] Yufei Gu commented on YARN-6326: Thanks [~rkanter] for the review. Uploaded a new patch for your comments.

[jira] [Updated] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6326: --- Description: This causes a NPE issue. Beside the NPE, the metrics won't reflect the different attempts. We

[jira] [Commented] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923604#comment-15923604 ] Hadoop QA commented on YARN-6326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6328) Update a spelling mistake

2017-03-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-6328: - Assignee: Jin Yibo (was: Sunil G) > Update a spelling mistake > - > >

[jira] [Commented] (YARN-6328) Update a spelling mistake

2017-03-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15923613#comment-15923613 ] Sunil G commented on YARN-6328: --- [~NJUJYB]. Added you as a contributor. So you can assign issue to yourself.

[jira] [Assigned] (YARN-6328) Update a spelling mistake

2017-03-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-6328: - Assignee: Sunil G > Update a spelling mistake > - > > Key:

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-13 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922729#comment-15922729 ] Jonathan Hung commented on YARN-5952: - Uploaded 003 patch with full implementation. > Create REST API

[jira] [Commented] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922733#comment-15922733 ] Daniel Templeton commented on YARN-6309: The patch you posted to the mailing list looks good to me.

[jira] [Commented] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922832#comment-15922832 ] Naganarasimha G R commented on YARN-6327: - Thanks for working on this [~jhung], but java's foreach

[jira] [Commented] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922719#comment-15922719 ] Junping Du commented on YARN-6314: -- Thanks [~xgong] for reporting the issue and deliver a fix. Several

[jira] [Updated] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-13 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5952: Attachment: YARN-5952-YARN-5734.003.patch > Create REST API for changing YARN scheduler

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-03-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922786#comment-15922786 ] Daniel Templeton commented on YARN-6208: Sweet. Thanks, [~ajisakaa]. If you don't mind, let's

[jira] [Commented] (YARN-6325) ParentQueue and LeafQueue with same name can cause queue name based operations to fail

2017-03-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922925#comment-15922925 ] Wangda Tan commented on YARN-6325: -- [~jhung], bq. Disallow ParentQueues and LeafQueues to have the same

[jira] [Assigned] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6309: -- Assignee: esmaeil mirzaee > Fair scheduler docs should have the queue and

[jira] [Assigned] (YARN-5355) YARN Timeline Service v.2: alpha 2

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-5355: - Assignee: Vrushali C (was: Sangjin Lee) > YARN Timeline Service v.2: alpha 2 >

[jira] [Assigned] (YARN-451) Add more metrics to RM page

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-451: Assignee: Joep Rottinghuis (was: Sangjin Lee) > Add more metrics to RM page >

[jira] [Commented] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922934#comment-15922934 ] Daniel Templeton commented on YARN-6309: Try now. > Fair scheduler docs should have the queue and

[jira] [Assigned] (YARN-3353) provide RPC metrics via JMX for timeline collectors and readers

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-3353: - Assignee: Vrushali C (was: Sangjin Lee) > provide RPC metrics via JMX for timeline collectors

[jira] [Assigned] (YARN-3378) a load test client that can replay a volume of history files

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-3378: - Assignee: Vrushali C (was: Sangjin Lee) > a load test client that can replay a volume of history

[jira] [Assigned] (YARN-3512) add more fine-grained metrics that measure write performance

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-3512: - Assignee: Vrushali C (was: Sangjin Lee) > add more fine-grained metrics that measure write

[jira] [Assigned] (YARN-3907) create the flow-version table

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-3907: - Assignee: Vrushali C (was: Sangjin Lee) > create the flow-version table >

[jira] [Assigned] (YARN-3741) consider nulling member maps/sets of TimelineEntity

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-3741: - Assignee: Vrushali C (was: Sangjin Lee) > consider nulling member maps/sets of TimelineEntity >

[jira] [Commented] (YARN-3741) consider nulling member maps/sets of TimelineEntity

2017-03-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922940#comment-15922940 ] Haibo Chen commented on YARN-3741: -- [~sjlee0] Can I take this one up? > consider nulling member maps/sets

[jira] [Assigned] (YARN-4116) refactor ColumnHelper read* methods

2017-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-4116: - Assignee: Vrushali C (was: Sangjin Lee) > refactor ColumnHelper read* methods >

[jira] [Comment Edited] (YARN-3741) consider nulling member maps/sets of TimelineEntity

2017-03-13 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922940#comment-15922940 ] Haibo Chen edited comment on YARN-3741 at 3/13/17 9:06 PM: --- [~vrushalic] Can I

[jira] [Updated] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread esmaeil mirzaee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] esmaeil mirzaee updated YARN-6309: -- Attachment: YARN_6309.001.patch Making bold all of elements under {{Allocation file format :

[jira] [Commented] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922952#comment-15922952 ] Daniel Templeton commented on YARN-6309: LGTM. I still need to build the doc and make sure it's

[jira] [Commented] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922959#comment-15922959 ] Hadoop QA commented on YARN-6309: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4051: - Summary: ContainerKillEvent lost when container is still recovering and application finishes (was:

[jira] [Updated] (YARN-6330) DefaultContainerExecutor container launch fails if script dest dir has a space in the path

2017-03-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-6330: - Environment: osx; no setsid command > DefaultContainerExecutor container launch fails if script

[jira] [Comment Edited] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-13 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15922852#comment-15922852 ] Jonathan Hung edited comment on YARN-6327 at 3/13/17 8:19 PM: -- Hi

  1   2   >