[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-07-09 Thread Jaideep Dhok (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621841#comment-14621841 ] Jaideep Dhok commented on YARN-2005: [~adhoot] Is it possible to add a metric for total

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-07-09 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621839#comment-14621839 ] zhihai xu commented on YARN-3798: - bq. It works as expected... yes, you are right. {{retry}

[jira] [Updated] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3453: -- Attachment: YARN-3453.5.patch [~peng.zhang], thanks for the review.. bq. Why not changing all usage of c

[jira] [Commented] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-09 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621824#comment-14621824 ] mujunchao commented on YARN-3857: - thanks for your reviewing, have updated the test case, t

[jira] [Commented] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-09 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621825#comment-14621825 ] mujunchao commented on YARN-3857: - thanks for your reviewing, have updated the test case, t

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621823#comment-14621823 ] Ajith S commented on YARN-3885: --- Whitespace warning is for test case, suggest keep it as its

[jira] [Updated] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-09 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mujunchao updated YARN-3857: Attachment: YARN-3857-2.patch update test case, thanks for xuzhihai's reviewing. > Memory leak in ResourceMa

[jira] [Commented] (YARN-3409) Add constraint node labels

2015-07-09 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621811#comment-14621811 ] Devaraj K commented on YARN-3409: - [~leftnoteasy], Thanks for the details. Are you going to

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621786#comment-14621786 ] Varun Saxena commented on YARN-3878: Thanks [~kasha] for the commit and review. Thanks

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621739#comment-14621739 ] Varun Saxena commented on YARN-3893: Maybe set the HA service state in RM context as ST

[jira] [Commented] (YARN-3381) A typographical error in "InvalidStateTransitonException"

2015-07-09 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621734#comment-14621734 ] Akira AJISAKA commented on YARN-3381: - bq. Findbugs (version 3.0.0) appears to be broke

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621720#comment-14621720 ] Sunil G commented on YARN-3893: --- Hi [~xgong] Thank you for the update. I have a doubt here.

[jira] [Commented] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621713#comment-14621713 ] Hudson commented on YARN-3888: -- FAILURE: Integrated in Hadoop-trunk-Commit #8145 (See [https:

[jira] [Commented] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621710#comment-14621710 ] Xuan Gong commented on YARN-3888: - Committed into trunk/branch-2. Thanks, Bibin A Chundatt

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-07-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621709#comment-14621709 ] Tsuyoshi Ozawa commented on YARN-3798: -- [~zxu] thank you for the review. {quote} 1. I

[jira] [Commented] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621707#comment-14621707 ] Xuan Gong commented on YARN-3888: - +1 LGTM. Will commit > ApplicationMaster link is broken

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621703#comment-14621703 ] Xuan Gong commented on YARN-3893: - How about add rm.transitionToStandby(true) before we thr

[jira] [Commented] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-09 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621686#comment-14621686 ] zhihai xu commented on YARN-3857: - thanks for the updated patch [~mujunchao]! The patch loo

[jira] [Commented] (YARN-3381) A typographical error in "InvalidStateTransitonException"

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621679#comment-14621679 ] Hadoop QA commented on YARN-3381: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621634#comment-14621634 ] Jian He commented on YARN-1449: --- looks good to me overall, could you mark unstable for the ne

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-09 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621631#comment-14621631 ] Peng Zhang commented on YARN-3453: -- Thanks [~asuresh] for working on this comments: # Why

[jira] [Commented] (YARN-3798) ZKRMStateStore shouldn't create new session without occurrance of SESSIONEXPIED

2015-07-09 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621630#comment-14621630 ] zhihai xu commented on YARN-3798: - Thanks for the new patch [~ozawa]! # It looks like {{ret

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621621#comment-14621621 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3381) A typographical error in "InvalidStateTransitonException"

2015-07-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621611#comment-14621611 ] Brahma Reddy Battula commented on YARN-3381: [~ajisakaa] can kickoff jenkin on

[jira] [Updated] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-07-09 Thread mujunchao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mujunchao updated YARN-3857: Attachment: YARN-3857-1.patch add test case. > Memory leak in ResourceManager with SIMPLE mode > ---

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621592#comment-14621592 ] Zhijie Shen commented on YARN-3908: --- 1. TimelineEvent has a timestamp associated with it.

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621585#comment-14621585 ] Hadoop QA commented on YARN-3116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621581#comment-14621581 ] Zhijie Shen commented on YARN-3116: --- [~kkaranasos], I didn't touch the detail on YARN-288

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621573#comment-14621573 ] Subru Krishnan commented on YARN-3116: -- [~kkaranasos], thanks for taking at look at th

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621571#comment-14621571 ] Vrushali C commented on YARN-3908: -- Hi [~zjshen] I see that event#info is not being store

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621559#comment-14621559 ] Sangjin Lee commented on YARN-3836: --- Great. I'll commit the patch this evening unless the

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621545#comment-14621545 ] Zhijie Shen commented on YARN-3836: --- +1 LGTM > add equals and hashCode to TimelineEntity

[jira] [Commented] (YARN-3800) Reduce storage footprint for ReservationAllocation

2015-07-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621534#comment-14621534 ] Hudson commented on YARN-3800: -- FAILURE: Integrated in Hadoop-trunk-Commit #8143 (See [https:

[jira] [Commented] (YARN-3800) Reduce storage footprint for ReservationAllocation

2015-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621527#comment-14621527 ] Subru Krishnan commented on YARN-3800: -- Thanks [~adhoot] for the patch and [~curino] f

[jira] [Comment Edited] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621480#comment-14621480 ] Zhijie Shen edited comment on YARN-3908 at 7/10/15 12:23 AM: - I

[jira] [Commented] (YARN-3800) Reduce storage footprint for ReservationAllocation

2015-07-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621509#comment-14621509 ] Anubhav Dhoot commented on YARN-3800: - Thanks [~curino] and [~subru]! > Reduce storage

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

2015-07-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-15.patch Fixed issue with constants. We need to agree that these names are OK and t

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621501#comment-14621501 ] Sangjin Lee commented on YARN-3836: --- The latest patch (v.4) looks good to me. Any other c

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2015-07-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621494#comment-14621494 ] Jian He commented on YARN-3866: --- I think thats ok. > AM-RM protocol changes to support cont

[jira] [Commented] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621483#comment-14621483 ] Sidharta Seethana commented on YARN-3853: - The test failures are unrelated to this

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621480#comment-14621480 ] Zhijie Shen commented on YARN-3908: --- Assign it to [~vrushalic] by default. Please feel fr

[jira] [Updated] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3908: -- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 > Bugs in HBaseTimelineWriterImpl > --

[jira] [Created] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-09 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3908: - Summary: Bugs in HBaseTimelineWriterImpl Key: YARN-3908 URL: https://issues.apache.org/jira/browse/YARN-3908 Project: Hadoop YARN Issue Type: Bug Compone

[jira] [Updated] (YARN-3800) Reduce storage footprint for ReservationAllocation

2015-07-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3800: --- Summary: Reduce storage footprint for ReservationAllocation (was: Simplify inmemory state for Reservat

[jira] [Commented] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621463#comment-14621463 ] Hadoop QA commented on YARN-3853: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-3116: --- Attachment: YARN-3116.v9.patch > [Collector wireup] We need an assured way to d

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2015-07-09 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621422#comment-14621422 ] MENG DING commented on YARN-3866: - bq. DecreasedContainer.java/IncreasedContainer.java - ho

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621416#comment-14621416 ] Konstantinos Karanasos commented on YARN-3116: -- Thanks for the feedback, [~gio

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621398#comment-14621398 ] Hadoop QA commented on YARN-3836: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621370#comment-14621370 ] Sidharta Seethana commented on YARN-3853: - [~vvasudev] , could you please review th

[jira] [Commented] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621353#comment-14621353 ] Sidharta Seethana commented on YARN-3853: - Updated the description to provide an ov

[jira] [Updated] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3853: Description: Create a new DockerContainerRuntime that implements support for docker containe

[jira] [Updated] (YARN-3853) Add docker container runtime support to LinuxContainterExecutor

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3853: Attachment: YARN-3853.001.patch Attaching a patch - I apologize for the size of the patch - g

[jira] [Updated] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3836: Attachment: YARN-3836-YARN-2928.004.patch Fixed. Thanks for the catch [~sjlee0]! > add equals and hashCode to Timel

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621338#comment-14621338 ] Hadoop QA commented on YARN-3836: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-07-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621302#comment-14621302 ] Anubhav Dhoot commented on YARN-2005: - Thanks for your comments Sunil. 1. Yes we can m

[jira] [Created] (YARN-3907) create the flow-version table

2015-07-09 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3907: - Summary: create the flow-version table Key: YARN-3907 URL: https://issues.apache.org/jira/browse/YARN-3907 Project: Hadoop YARN Issue Type: Sub-task Comp

[jira] [Created] (YARN-3906) split the application table from the entity table

2015-07-09 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3906: - Summary: split the application table from the entity table Key: YARN-3906 URL: https://issues.apache.org/jira/browse/YARN-3906 Project: Hadoop YARN Issue Type: Sub

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621291#comment-14621291 ] Vinod Kumar Vavilapalli commented on YARN-2194: --- [~vvasudev] / [~sidharta-s]

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621288#comment-14621288 ] Sangjin Lee commented on YARN-3836: --- Understood. Somehow I got the impression that the in

[jira] [Commented] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621281#comment-14621281 ] Eric Payne commented on YARN-3905: -- {{org.apache.hadoop.yarn.server.webapp.AppBlock.genera

[jira] [Created] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-09 Thread Eric Payne (JIRA)
Eric Payne created YARN-3905: Summary: Application History Server UI NPEs when accessing apps run after RM restart Key: YARN-3905 URL: https://issues.apache.org/jira/browse/YARN-3905 Project: Hadoop YARN

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621241#comment-14621241 ] Karthik Kambatla commented on YARN-2194: No problem at all. I really wish JIRA allo

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621209#comment-14621209 ] Zhijie Shen commented on YARN-3836: --- bq. l.550: It sounds like now the type takes precede

[jira] [Updated] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3836: Attachment: YARN-3836-YARN-2928.003.patch Thanks [~sjlee0] for the review! I addressed your comments in the v3 patch,

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621190#comment-14621190 ] Sidharta Seethana commented on YARN-2194: - [~kasha] , thanks - will keep that in mi

[jira] [Updated] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-2194: Assignee: Wei Yan (was: Sidharta Seethana) > Cgroups cease to work in RHEL7 > --

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621102#comment-14621102 ] Karthik Kambatla commented on YARN-2194: Thanks for finding and fixing the issue, [

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2915: - Attachment: Federation-BoF.pdf Attaching the slide deck from YARN Federation BoF session > Enable

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621089#comment-14621089 ] Giovanni Matteo Fumarola commented on YARN-3116: [~kkaranasos], thanks for

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-07-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621057#comment-14621057 ] Sunil G commented on YARN-2005: --- Hi [~adhoot] Thank you for sharing patch for same. I have co

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621051#comment-14621051 ] Zhijie Shen commented on YARN-3901: --- Yeah, I have dependency on this table for reader. If

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621034#comment-14621034 ] Zhijie Shen commented on YARN-3116: --- [~kkaranasos], thanks for notifying us of YARN-2882.

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621033#comment-14621033 ] Sangjin Lee commented on YARN-3836: --- I take back my comment about the null check for {{ge

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621023#comment-14621023 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (YARN-3904) Adopt PhoenixTimelineWriter into time-based aggregation storage

2015-07-09 Thread Li Lu (JIRA)
Li Lu created YARN-3904: --- Summary: Adopt PhoenixTimelineWriter into time-based aggregation storage Key: YARN-3904 URL: https://issues.apache.org/jira/browse/YARN-3904 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14621010#comment-14621010 ] Sangjin Lee commented on YARN-3836: --- Thanks for updating the patch [~gtCarrera9]. I went

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

2015-07-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620965#comment-14620965 ] Anubhav Dhoot commented on YARN-2005: - [~jlowe] appreciate your review of the updated p

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

2015-07-09 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-14.patch Updated to trunk (using ResourceUtilization already there). > Collect mem

[jira] [Commented] (YARN-3069) Document missing properties in yarn-default.xml

2015-07-09 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620947#comment-14620947 ] Ray Chiang commented on YARN-3069: -- Thanks Akira! I'll be happy to see one of these XML v

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2015-07-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620946#comment-14620946 ] Jian He commented on YARN-3866: --- bq. increaseRequests/decreaseRequests - We may just pass one

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620925#comment-14620925 ] Hadoop QA commented on YARN-2003: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-07-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-3754. --- Resolution: Not A Problem I am closing this issue as it is not happening in trunk. [~bibinchundatt] please reo

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620868#comment-14620868 ] Sangjin Lee commented on YARN-3836: --- I tend to think that using type + id is probably a s

[jira] [Assigned] (YARN-3903) Disable preemption at Queue level for Fair Scheduler

2015-07-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-3903: -- Assignee: Karthik Kambatla > Disable preemption at Queue level for Fair Scheduler >

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620861#comment-14620861 ] Li Lu commented on YARN-3836: - bq. Regarding metric, can't id uniquely identify a metric ? Do w

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-09 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620855#comment-14620855 ] Ming Ma commented on YARN-3445: --- +1 on the latest patch. Thanks Junping. I will wait until to

[jira] [Updated] (YARN-3902) Fair scheduler preempts ApplicationMaster

2015-07-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3902: --- Assignee: Arun Suresh > Fair scheduler preempts ApplicationMaster > ---

[jira] [Commented] (YARN-3896) RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620839#comment-14620839 ] Hadoop QA commented on YARN-3896: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-1012) Report NM aggregated container resource utilization in heartbeat

2015-07-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620837#comment-14620837 ] Hudson commented on YARN-1012: -- FAILURE: Integrated in Hadoop-trunk-Commit #8140 (See [https:

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620836#comment-14620836 ] Hudson commented on YARN-3878: -- FAILURE: Integrated in Hadoop-trunk-Commit #8140 (See [https:

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620814#comment-14620814 ] Hadoop QA commented on YARN-3445: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-07-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620799#comment-14620799 ] Sangjin Lee commented on YARN-3901: --- Hi [~zjshen], I was going to file JIRAs that covers

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-09 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620779#comment-14620779 ] Konstantinos Karanasos commented on YARN-3116: -- [~giovanni.fumarola], [~xgong]

[jira] [Updated] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0019-YARN-2003.patch Fixed few test failures. > Support for Application priority : Changes in RM and

[jira] [Updated] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: (was: 0019-YARN-2003.patch) > Support for Application priority : Changes in RM and Capacity Sched

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620730#comment-14620730 ] Hadoop QA commented on YARN-2003: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2015-07-09 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620718#comment-14620718 ] MENG DING commented on YARN-3866: - Thanks [~jianhe] for the review! bq. Mark all getters/s

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620703#comment-14620703 ] Hudson commented on YARN-2194: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2197 (See [htt

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620680#comment-14620680 ] Hudson commented on YARN-2194: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #249 (See

  1   2   >