[jira] [Comment Edited] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644790#comment-15644790 ] Varun Saxena edited comment on YARN-5845 at 11/7/16 5:26 PM: - W

[jira] [Comment Edited] (YARN-5368) memory leak at timeline server

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644781#comment-15644781 ] Naganarasimha G R edited comment on YARN-5368 at 11/7/16 5:24 PM: ---

[jira] [Commented] (YARN-5368) memory leak at timeline server

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644781#comment-15644781 ] Naganarasimha G R commented on YARN-5368: - We cross verified whether similar leak e

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644757#comment-15644757 ] Naganarasimha G R commented on YARN-574: Also would like to get the feedback from [~

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644754#comment-15644754 ] Bibin A Chundatt commented on YARN-5845: {quote} Why not wrap both app created and

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644745#comment-15644745 ] Naganarasimha G R commented on YARN-574: Thanks [~ajithshetty], for the patch. As d

[jira] [Commented] (YARN-5846) Improve the fairscheduler attemptScheduler

2016-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644739#comment-15644739 ] Daniel Templeton commented on YARN-5846: Thanks for the ideas, [~zhengchenyu]. Som

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644648#comment-15644648 ] Varun Saxena commented on YARN-5845: Do we need to publish twice ? Why not wrap both ap

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644642#comment-15644642 ] Varun Saxena commented on YARN-574: --- [~ajithshetty], thanks for the patch. Parallel downlo

[jira] [Comment Edited] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644530#comment-15644530 ] Bibin A Chundatt edited comment on YARN-5845 at 11/7/16 3:55 PM:

[jira] [Updated] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5845: --- Attachment: YARN-5845.0001.patch Attaching patch based on solution 1 MInor comment from last t

[jira] [Commented] (YARN-5836) NMToken passwd not checked in ContainerManagerImpl, malicious AM can fake the Token and kill containers of other apps at will

2016-11-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644391#comment-15644391 ] Jason Lowe commented on YARN-5836: -- As I understand it, the NM token should be getting ver

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644329#comment-15644329 ] Naganarasimha G R commented on YARN-5545: - Thanks for sharing thoughts and discussi

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644321#comment-15644321 ] Varun Saxena commented on YARN-5845: bq. but just ensure that ATS v1 & v2 backward comp

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644304#comment-15644304 ] Naganarasimha G R commented on YARN-5845: - Would prefer solution 1 bq. So that add

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644265#comment-15644265 ] Varun Saxena commented on YARN-5845: I think Solution 1 i.e. using application start ti

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644231#comment-15644231 ] Sunil G commented on YARN-5545: --- Thanks [~bibinchundatt] Option2 will introduce a new api, a

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644201#comment-15644201 ] Bibin A Chundatt commented on YARN-5845: {quote} We republish the app created event

[jira] [Created] (YARN-5846) Improve the fairscheduler attemptScheduler

2016-11-07 Thread zhengchenyu (JIRA)
zhengchenyu created YARN-5846: - Summary: Improve the fairscheduler attemptScheduler Key: YARN-5846 URL: https://issues.apache.org/jira/browse/YARN-5846 Project: Hadoop YARN Issue Type: Improveme

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644178#comment-15644178 ] Bibin A Chundatt commented on YARN-5545: {quote} Is there any potential problem or

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644147#comment-15644147 ] Sunil G commented on YARN-5545: --- [~bibinchundatt] Is there any potential problem or feasibili

[jira] [Comment Edited] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644111#comment-15644111 ] Bibin A Chundatt edited comment on YARN-5545 at 11/7/16 1:04 PM:

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644111#comment-15644111 ] Bibin A Chundatt commented on YARN-5545: [~sunilg] Will update patch with solution

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644090#comment-15644090 ] Varun Saxena commented on YARN-5845: Thanks [~bibinchundatt]. Makes sense in not publis

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644029#comment-15644029 ] Bibin A Chundatt commented on YARN-5845: cc/ [~rohithsharma]/[~sjlee0]/[~varun_saxe

[jira] [Created] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-5845: -- Summary: Skip aclUpdated event publish to timelineserver or recovery Key: YARN-5845 URL: https://issues.apache.org/jira/browse/YARN-5845 Project: Hadoop YARN

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644002#comment-15644002 ] Hadoop QA commented on YARN-574: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Sub

[jira] [Commented] (YARN-4884) Fix missing documentation about rmadmin command regarding node labels

2016-11-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643979#comment-15643979 ] Varun Vasudev commented on YARN-4884: - No objection from my end. > Fix missing documen

[jira] [Commented] (YARN-5811) ConfigurationProvider must implement Closeable interface

2016-11-07 Thread Denis Bolshakov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643881#comment-15643881 ] Denis Bolshakov commented on YARN-5811: --- [~templedf] I've just cancelled patch, and n

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643868#comment-15643868 ] Ajith S commented on YARN-574: -- I have rebased and added testcase for the patch. Please review

[jira] [Assigned] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reassigned YARN-574: Assignee: Ajith S (was: Omkar Vinit Joshi) > PrivateLocalizer does not support parallel resource download vi

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643867#comment-15643867 ] Ajith S commented on YARN-574: -- I will take it over, if you are working on it, please reassign

[jira] [Updated] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2016-11-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-574: - Attachment: YARN-574.03.patch > PrivateLocalizer does not support parallel resource download via > ContainerLocaliz

[jira] [Commented] (YARN-5301) NM mount cpu cgroups failed on some system

2016-11-07 Thread Bing Jiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643828#comment-15643828 ] Bing Jiang commented on YARN-5301: -- Find the same issues on RHEL 7.1, kernel 3.10.0. Afte

[jira] [Commented] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-11-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643697#comment-15643697 ] Steve Loughran commented on YARN-5184: -- The main reason that a lot of hadoop code swit

[jira] [Comment Edited] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643248#comment-15643248 ] Bibin A Chundatt edited comment on YARN-5545 at 11/7/16 9:45 AM:

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643627#comment-15643627 ] Hadoop QA commented on YARN-5375: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643617#comment-15643617 ] Hadoop QA commented on YARN-5547: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643577#comment-15643577 ] Varun Saxena commented on YARN-3884: Yeah, diagnostics are reported when container fini

[jira] [Commented] (YARN-5453) FairScheduler#update may skip update demand resource of child queue/app if current demand reached maxResource

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643569#comment-15643569 ] Hadoop QA commented on YARN-5453: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643557#comment-15643557 ] Varun Saxena commented on YARN-5547: [~ajithshetty], I think we can raise another JIRA

[jira] [Commented] (YARN-4330) MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643554#comment-15643554 ] Naganarasimha G R commented on YARN-4330: - Thanks [~varun_saxena] for the explanati

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-11-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643548#comment-15643548 ] Ajith S commented on YARN-5547: --- Thanks [~Naganarasimha] for your comments. I have attached t

[jira] [Updated] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-11-07 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-5547: -- Attachment: YARN-5547.03.patch > NMLeveldbStateStore should be more tolerant of unknown keys > --

[jira] [Comment Edited] (YARN-5820) yarn node CLI help should be clearer

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643475#comment-15643475 ] Sunil G edited comment on YARN-5820 at 11/7/16 8:24 AM: Yes Naga. T

[jira] [Commented] (YARN-5820) yarn node CLI help should be clearer

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15643475#comment-15643475 ] Sunil G commented on YARN-5820: --- Yes Naga. That make sense for me > yarn node CLI help shoul

[jira] [Created] (YARN-5844) fair ordering policy with DRF

2016-11-07 Thread kyungwan nam (JIRA)
kyungwan nam created YARN-5844: -- Summary: fair ordering policy with DRF Key: YARN-5844 URL: https://issues.apache.org/jira/browse/YARN-5844 Project: Hadoop YARN Issue Type: Improvement

<    1   2