[jira] [Commented] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616243#comment-14616243 ] Karthik Kambatla commented on YARN-3891: In these cases, MR should preempt reducers

[jira] [Updated] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3891: --- Component/s: fairscheduler Apps are starved for resource due to default FairSharePolicy in

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616249#comment-14616249 ] Hadoop QA commented on YARN-3837: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3837: Hadoop Flags: Reviewed +1 for the latest patch, will commit it shortly. javadocs of

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616906#comment-14616906 ] Hadoop QA commented on YARN-3445: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.2.patch Attach new patch which fixed coding style issues, and use 4 indents for

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.3.patch Fixed coding style issues, and added test case to {{TestYarnServerApiClasses}}

[jira] [Updated] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3047: --- Attachment: YARN-3047-YARN-2928.12.patch [Data Serving] Set up ATS reader with basic request serving

[jira] [Commented] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616948#comment-14616948 ] Karthik Kambatla commented on YARN-3891: Yep. YARN-3485 fixes the issue that leads

[jira] [Updated] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3047: --- Attachment: (was: YARN-3047-YARN-2928.12.patch) [Data Serving] Set up ATS reader with basic

[jira] [Commented] (YARN-3869) Add app name to RM audit log

2015-07-07 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616323#comment-14616323 ] Shay Rojansky commented on YARN-3869: - Wasn't aware of this case... How is this

[jira] [Commented] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616308#comment-14616308 ] Hadoop QA commented on YARN-3888: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3869) Add app name to RM audit log

2015-07-07 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616363#comment-14616363 ] nijel commented on YARN-3869: - In Web it is shown as truncate. But if the names are similar,

[jira] [Commented] (YARN-3869) Add app name to RM audit log

2015-07-07 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616282#comment-14616282 ] nijel commented on YARN-3869: - hi i started working on this. One observation is in some cases

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616303#comment-14616303 ] Jian He commented on YARN-2003: --- thanks for the updating ! some more comments: bq. Yes. We

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616274#comment-14616274 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-trunk-Commit #8121 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616315#comment-14616315 ] Tsuyoshi Ozawa commented on YARN-3878: -- FYI, I found a news which has impacts against

[jira] [Commented] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-07 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616287#comment-14616287 ] Siqi Li commented on YARN-3891: --- Yes, I think this is related to MAPREDUCE-6302. So if

[jira] [Resolved] (YARN-3891) Apps are starved for resource due to default FairSharePolicy in Fair Scheduler

2015-07-07 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-3891. --- Resolution: Duplicate Assignee: Siqi Li Apps are starved for resource due to default FairSharePolicy in

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617097#comment-14617097 ] Varun Saxena commented on YARN-3878: [~jianhe] / [~devaraj.k] / [~kasha], Checking for

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Attachment: YARN-1645.2.patch Fixed coding style issues. ContainerManager implementation to support

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617289#comment-14617289 ] Sangjin Lee commented on YARN-3047: --- The v.12 patch looks good to me. Is there any more

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617093#comment-14617093 ] Varun Saxena commented on YARN-3878: Thanks a lot for sharing the info [~ozawa].

[jira] [Updated] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3867: Attachment: YARN-3867.2.patch Fixed coding style. ContainerImpl changes to support container resizing

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617199#comment-14617199 ] Varun Saxena commented on YARN-3878: [~jianhe], we have a {{DrainDispatcher}} class

[jira] [Commented] (YARN-3829) The History Tracking UI is broken for Tez application on ResourceManager WebUI

2015-07-07 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617224#comment-14617224 ] Irina Easterling commented on YARN-3829: This no longer appears to be an issue

[jira] [Resolved] (YARN-3829) The History Tracking UI is broken for Tez application on ResourceManager WebUI

2015-07-07 Thread Irina Easterling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Irina Easterling resolved YARN-3829. Resolution: Fixed Fix Version/s: 0.23.11 This issue was fixed. The History Tracking

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-3116: --- Attachment: YARN-3116.v5.patch [Collector wireup] We need an assured way to

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868.2.patch Fixed coding style issues. ContainerManager recovery for container resizing

[jira] [Updated] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0018-YARN-2003.patch Thank you [~jianhe] for sharing the comments. I am uploading a patch addressing

[jira] [Commented] (YARN-3892) NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617172#comment-14617172 ] Hadoop QA commented on YARN-3892: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617200#comment-14617200 ] Varun Saxena commented on YARN-3878: Or have a protected function returning reference

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617263#comment-14617263 ] Giovanni Matteo Fumarola commented on YARN-3116: Thanks [~zjshen] for your

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-07-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617108#comment-14617108 ] Kuhu Shukla commented on YARN-2410: --- [~airbots] Are you working on this JIRA? If not, I

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617139#comment-14617139 ] Hadoop QA commented on YARN-3047: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617174#comment-14617174 ] Jian He commented on YARN-3878: --- You may try creating a new test sub class which extends

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-07-07 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-2410: -- Assignee: Kuhu Shukla (was: Chen He) Nodemanager ShuffleHandler can possible exhaust file descriptors

[jira] [Commented] (YARN-3893) Both RM in active when CapacityScheduler#reinitialize failure

2015-07-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616977#comment-14616977 ] Xuan Gong commented on YARN-3893: - Thanks for reporting this. Could you share the YARN

[jira] [Updated] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3047: --- Attachment: YARN-3047-YARN-2928.12.patch [Data Serving] Set up ATS reader with basic request serving

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617307#comment-14617307 ] Zhijie Shen commented on YARN-3047: --- Would you please hold a while? I plan to take a look

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617310#comment-14617310 ] Sangjin Lee commented on YARN-3047: --- Sure. Not a problem. [Data Serving] Set up ATS

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868.2.patch ContainerManager recovery for container resizing

[jira] [Commented] (YARN-3612) Resource calculation in child tasks is CPU-heavy

2015-07-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617391#comment-14617391 ] Chris Douglas commented on YARN-3612: - bq. Moreover, I have not added the config as I

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617439#comment-14617439 ] Hadoop QA commented on YARN-2003: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: (was: YARN-3868.2.patch) ContainerManager recovery for container resizing

[jira] [Commented] (YARN-3892) NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617478#comment-14617478 ] Hudson commented on YARN-3892: -- FAILURE: Integrated in Hadoop-trunk-Commit #8128 (See

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1197: Attachment: YARN-1197_Design.2015.07.07.pdf The design doc has been updated to include a *Design Choices*

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617681#comment-14617681 ] Jian He commented on YARN-3878: --- bq. Or have a protected function returning reference to

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617628#comment-14617628 ] Carlo Curino commented on YARN-2915: I created a branch: YARN-2915 which we will use

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2915: --- Attachment: FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf Enable YARN RM scale out via federation using

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617570#comment-14617570 ] Carlo Curino commented on YARN-2915: [~grey] that is a good questions. We are not

[jira] [Commented] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2015-07-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617537#comment-14617537 ] Li Lu commented on YARN-3817: - I did some rough estimation on the resource consumption for the

[jira] [Commented] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2015-07-07 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617548#comment-14617548 ] Vrushali C commented on YARN-3817: -- bq. This said, we may want to try to implement the

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-07-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617553#comment-14617553 ] Zhijie Shen commented on YARN-3047: --- It looks good to me overall, exception the config.

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617683#comment-14617683 ] Jian He commented on YARN-3878: --- Given dispatcher is a sensitive piece of code, waiting 2-3

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617707#comment-14617707 ] Carlo Curino commented on YARN-2915: {color:red} *ENFORCING GLOBAL INVARIANT* {color}

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617709#comment-14617709 ] Subru Krishnan commented on YARN-2915: -- [~grey] Thanks for taking a look at our design

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617660#comment-14617660 ] Hadoop QA commented on YARN-3116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616559#comment-14616559 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #249 (See

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616568#comment-14616568 ] Hudson commented on YARN-2194: -- FAILURE: Integrated in Hadoop-trunk-Commit #8123 (See

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2015-07-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616522#comment-14616522 ] Weiwei Yang commented on YARN-1042: --- Hello [~cchen317] Thanks for your thoughts.

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616553#comment-14616553 ] Varun Vasudev commented on YARN-2194: - Committed to trunk and branch-2. Thanks Wei!

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616507#comment-14616507 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-Yarn-trunk #979 (See

[jira] [Commented] (YARN-3869) Add app name to RM audit log

2015-07-07 Thread Shay Rojansky (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616521#comment-14616521 ] Shay Rojansky commented on YARN-3869: - That's a good point, I'm not sure. Not that

[jira] [Commented] (YARN-3460) Test TestSecureRMRegistryOperations failed with IBM_JAVA JVM

2015-07-07 Thread pascal oliva (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616520#comment-14616520 ] pascal oliva commented on YARN-3460: What about the integration of this issue in Hadoop

[jira] [Commented] (YARN-3892) NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails

2015-07-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617893#comment-14617893 ] Bibin A Chundatt commented on YARN-3892: [~jianhe] Thnks a lot for review and

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617794#comment-14617794 ] Hadoop QA commented on YARN-3445: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3888) ApplicationMaster link is broken in RM WebUI when appstate is NEW

2015-07-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617899#comment-14617899 ] Bibin A Chundatt commented on YARN-3888: Testcases are not added since with Link

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3116: -- Attachment: YARN-3116.v6.patch Fixed the test failure in the new patch. Otherwise, the previous patch

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2915: - Attachment: federation-prototype.patch Uploading a patch file that demonstrates the core YARN

[jira] [Created] (YARN-3892) NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails

2015-07-07 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3892: -- Summary: NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails Key: YARN-3892 URL: https://issues.apache.org/jira/browse/YARN-3892 Project:

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616759#comment-14616759 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2176 (See

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616763#comment-14616763 ] Junping Du commented on YARN-3045: -- bq. IMO, the latter one sounds like a better choice

[jira] [Created] (YARN-3893) Both RM in active when CapacityScheduler#reinitialize failure

2015-07-07 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3893: -- Summary: Both RM in active when CapacityScheduler#reinitialize failure Key: YARN-3893 URL: https://issues.apache.org/jira/browse/YARN-3893 Project: Hadoop YARN

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616773#comment-14616773 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #237 (See

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616690#comment-14616690 ] Hudson commented on YARN-2194: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #247 (See

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616718#comment-14616718 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2195 (See

[jira] [Updated] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-07-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3445: - Attachment: YARN-3445-v5.patch bq. It looks like RMNodeImpl's handle function already takes write lock for

[jira] [Updated] (YARN-3892) NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails

2015-07-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3892: --- Attachment: 0001-YARN-3892.patch Please review the patch attached NPE on

[jira] [Commented] (YARN-3837) javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options

2015-07-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616691#comment-14616691 ] Hudson commented on YARN-3837: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #247 (See

[jira] [Commented] (YARN-3838) Rest API failing when ip configured in RM address in secure https mode

2015-07-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617927#comment-14617927 ] Bibin A Chundatt commented on YARN-3838: Hi [~vinodkv] and [~kasha] could you

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

2015-07-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617976#comment-14617976 ] Hadoop QA commented on YARN-3116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3893) Both RM in active when CapacityScheduler#reinitialize failure

2015-07-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3893: --- Attachment: yarn-site.xml [~xgong] Sorry for late reponse. -Also make sure that in capacity

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-07 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617944#comment-14617944 ] Devaraj K commented on YARN-3878: - bq. Given dispatcher is a sensitive piece of code,

[jira] [Commented] (YARN-3892) NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails

2015-07-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617431#comment-14617431 ] Jian He commented on YARN-3892: --- lgtm, committing NPE on RMStateStore#serviceStop when

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616787#comment-14616787 ] Lei Guo commented on YARN-2915: --- Does this design also consider multiple data center case?