[jira] [Updated] (YARN-5276) print more info when event queue is blocked

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-5276: --- Attachment: YARN-5276.03.patch > print more info when event queue is blocked >

[jira] [Commented] (YARN-5312) Parameter 'size' in the webservices "/containerlogs/$containerid/$filename" and in AHSWebServices is semantically confusing

2016-07-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364107#comment-15364107 ] Varun Vasudev commented on YARN-5312: - Agree with the description - it probably does make sense to come

[jira] [Commented] (YARN-5276) print more info when event queue is blocked

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364118#comment-15364118 ] Hadoop QA commented on YARN-5276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364260#comment-15364260 ] Hadoop QA commented on YARN-4939: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364244#comment-15364244 ] Junping Du commented on YARN-4939: -- v4 patch LGTM. Jenkins test seems to have problem. Kick off again

[jira] [Updated] (YARN-5309) SSLFactory truststore reloader thread leak in TimelineClientImpl

2016-07-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-5309: -- Attachment: YARN-5309.002.patch Attach v2 patch, added unit test. See

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364583#comment-15364583 ] Hadoop QA commented on YARN-4280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364675#comment-15364675 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364758#comment-15364758 ] Li Lu commented on YARN-5233: - Oh and, our ApplicationClassLoader will delegate the loadClass process to its

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-06 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364957#comment-15364957 ] Sidharta Seethana commented on YARN-3854: - [~tangzhankun], thanks for uploading the doc and the

[jira] [Assigned] (YARN-5314) ConcurrentModificationException in ATS

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-5314: --- Assignee: Li Lu > ConcurrentModificationException in ATS > -- > >

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364765#comment-15364765 ] Karthik Kambatla commented on YARN-5215: Spoke to Inigo offline at the summit. My primary concern

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364893#comment-15364893 ] Hitesh Sharma commented on YARN-5216: - [~asuresh], [~kkaranasos]], thank you for the feedback and

[jira] [Updated] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5314: Attachment: YARN-5314-trunk.001.patch Thanks [~karams] for reporting this issue! The two exceptions are for

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364935#comment-15364935 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364843#comment-15364843 ] Sangjin Lee commented on YARN-5316: --- Let me know what you think. I'd like to make this an exception and

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364865#comment-15364865 ] Andrew Wang commented on YARN-5270: --- I think this is the last JIRA we're waiting on for 3.0.0-alpha1. If

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364748#comment-15364748 ] Hudson commented on YARN-5294: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10054 (See

[jira] [Updated] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5294: -- Attachment: YARN-5294-branch-2.patch upload branch-2 patch > Pass remote ip address down to

[jira] [Updated] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4939: - Attachment: YARN-4939.05.patch Put a patch with this minor fix and adjust some import. Will commit if Mr.

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364799#comment-15364799 ] Konstantinos Karanasos commented on YARN-5216: -- Thinking more about it... Another option would

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364887#comment-15364887 ] Vrushali C commented on YARN-5316: -- +1 Thanks for the patch Sangjin! I can commit it in at EOD today. >

[jira] [Comment Edited] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II

2016-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364953#comment-15364953 ] Varun Saxena edited comment on YARN-5302 at 7/6/16 7:39 PM: I think changes

[jira] [Commented] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II

2016-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364953#comment-15364953 ] Varun Saxena commented on YARN-5302: I think changes here will be required irrespective of YARN-5175.

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364961#comment-15364961 ] Hadoop QA commented on YARN-5294: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364888#comment-15364888 ] Vinod Kumar Vavilapalli commented on YARN-5315: --- shutdownNow() still does not wait for

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364886#comment-15364886 ] Hadoop QA commented on YARN-4939: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364994#comment-15364994 ] Hadoop QA commented on YARN-5314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5227) yarn logs command: no need to specify -applicationId when specifying containerId

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365036#comment-15365036 ] Hudson commented on YARN-5227: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10055 (See

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365091#comment-15365091 ] Vinod Kumar Vavilapalli commented on YARN-5224: --- Thanks for the update. The TestYarnClient

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365163#comment-15365163 ] Hudson commented on YARN-5224: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10056 (See

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365007#comment-15365007 ] Li Lu commented on YARN-5229: - Refactor LGTM. [~vrushalic] could you please address the two issues raised by

[jira] [Updated] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5283: - Attachment: YARN-5283.001.patch Initial refactor attempt > Refactor container assignment into

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365209#comment-15365209 ] Li Lu commented on YARN-5229: - Thanks [~vrushalic]. +1 pending Jenkins. > Refactor #isApplicationEntity and

[jira] [Commented] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365043#comment-15365043 ] Hadoop QA commented on YARN-5314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365061#comment-15365061 ] Hadoop QA commented on YARN-5233: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365158#comment-15365158 ] Hadoop QA commented on YARN-5283: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365197#comment-15365197 ] Vrushali C edited comment on YARN-5229 at 7/6/16 10:03 PM: --- Thanks for the review

[jira] [Updated] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5229: - Attachment: YARN-5229-YARN-2928.04.patch Thanks for the review [~gtCarrera], uploading v4 that addresses

[jira] [Comment Edited] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365197#comment-15365197 ] Vrushali C edited comment on YARN-5229 at 7/6/16 10:04 PM: --- Thanks for the review

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365218#comment-15365218 ] Andrew Wang commented on YARN-5270: --- Thanks for the reply Wangda. To clarify, I'm going to cut a

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365237#comment-15365237 ] Li Lu commented on YARN-5229: - Let me kick jenkins again on this patch... > Refactor #isApplicationEntity and

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365239#comment-15365239 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364989#comment-15364989 ] Li Lu commented on YARN-5316: - +1. Fix LGTM. Thanks for the work Sangjin! > fix hadoop-aws pom not to do the

[jira] [Comment Edited] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-07-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363095#comment-15363095 ] Robert Kanter edited comment on YARN-4676 at 7/6/16 8:57 PM: - Yes, it tracks in

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365070#comment-15365070 ] Jason Lowe commented on YARN-5215: -- Maybe I'm missing something, but any of the proposed approaches has

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365202#comment-15365202 ] Jian He commented on YARN-5233: --- lgtm > Support for specifying a path for ATS plugin jars >

[jira] [Updated] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5314: Attachment: YARN-5314-trunk.002.patch New patch to address checkstyle comments. > ConcurrentModificationException

[jira] [Updated] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5270: - Attachment: YARN-5270.003.patch Attached patch for trunk as well. [~andrew.wang], I think it's not

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365085#comment-15365085 ] Hitesh Sharma commented on YARN-5216: - [~kkaranasos], I'm not sure if subclassing would work. We need

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365101#comment-15365101 ] Konstantinos Karanasos commented on YARN-5216: -- Thanks for the reply, [~hrsharma]. Some

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365231#comment-15365231 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-07-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364442#comment-15364442 ] Rohith Sharma K S commented on YARN-5315: - Good catch!! +lgtm.. > Standby RM keep sending start

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364493#comment-15364493 ] Hadoop QA commented on YARN-5315: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-07-06 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.007.patch Thank you so much [~leftnoteasy] for the detailed review and offline

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364719#comment-15364719 ] Junping Du commented on YARN-4939: -- The build failure is due to rm.NMwaitForState() is actually not define

[jira] [Updated] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5314: Summary: ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore (was:

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364676#comment-15364676 ] Jian He commented on YARN-5233: --- minor comment: this logic could be simplified to throw exception directly.

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364684#comment-15364684 ] Hadoop QA commented on YARN-5316: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5316: -- Attachment: YARN-5316-YARN-2928.01.patch Posted patch v.1. This was pointed out on the merge vote

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364711#comment-15364711 ] Wangda Tan commented on YARN-5294: -- Committed to trunk, but it causes compilation failures on branch-2,

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-07-06 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364647#comment-15364647 ] Kuhu Shukla commented on YARN-4280: --- {{TestRMRestart.testQueueMetricsOnRMRestart}} is tracked through

[jira] [Issue Comment Deleted] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5294: -- Comment: was deleted (was: minor comment: this logic could be simplified to throw exception directly. {code}

[jira] [Updated] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5233: Attachment: YARN-5233-trunk.003.patch Thanks [~jianhe] for the review! I've fixed the exception handling logic. For

[jira] [Created] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5316: - Summary: fix hadoop-aws pom not to do the exclusion Key: YARN-5316 URL: https://issues.apache.org/jira/browse/YARN-5316 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5229: - Attachment: YARN-5229-YARN-2928.03.patch Not sure what the docker message is. Uploading v3 which is

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365260#comment-15365260 ] Sangjin Lee commented on YARN-5229: --- Just to be clear, are we considering committing this *before* the

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365259#comment-15365259 ] Inigo Goiri commented on YARN-5215: --- In our internal deployment, we always reserve a buffer for the

[jira] [Comment Edited] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365317#comment-15365317 ] sandflee edited comment on YARN-4939 at 7/6/16 11:16 PM: - Thanks [~djp], the test

[jira] [Created] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5328: Summary: InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5328 URL: https://issues.apache.org/jira/browse/YARN-5328

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365276#comment-15365276 ] Ray Chiang commented on YARN-5283: -- RE: Javadoc errors I see these in trunk even without my changes,

[jira] [Created] (YARN-5318) testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail

2016-07-06 Thread sandflee (JIRA)
sandflee created YARN-5318: -- Summary: testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail Key: YARN-5318 URL: https://issues.apache.org/jira/browse/YARN-5318 Project: Hadoop YARN

[jira] [Created] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-07-06 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5323: -- Summary: Policies APIs (for Router and AMRMProxy policies) Key: YARN-5323 URL: https://issues.apache.org/jira/browse/YARN-5323 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5325: --- Description: This JIRA tracks policies in the AMRMProxy that decide how to forward ResourceRequests,

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365373#comment-15365373 ] Hudson commented on YARN-5233: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10057 (See

[jira] [Created] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5329: Summary: ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5329 URL:

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365264#comment-15365264 ] Vrushali C commented on YARN-5229: -- This is a post merge check in candidate. I don't think it needs to

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365317#comment-15365317 ] sandflee commented on YARN-4939: Thanks [~djp], the test seems not related, could run pass locally, file

[jira] [Assigned] (YARN-5037) TestRMRestart#testQueueMetricsOnRMRestart random faiure

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee reassigned YARN-5037: -- Assignee: sandflee > TestRMRestart#testQueueMetricsOnRMRestart random faiure >

[jira] [Created] (YARN-5322) [YARN-3368] Add a node heat chart map

2016-07-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5322: Summary: [YARN-3368] Add a node heat chart map Key: YARN-5322 URL: https://issues.apache.org/jira/browse/YARN-5322 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5322) [YARN-3368] Add a node heat chart map

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5322: - Attachment: sample-1.png > [YARN-3368] Add a node heat chart map > - >

[jira] [Updated] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-07-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5323: --- Description: This JIRA tracks APIs for the policies that will guide the Router and AMRMProxy decisions

[jira] [Updated] (YARN-5324) Stateless router policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5324: --- Description: These are policies at the Router that do not require maintaing state across choices

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365262#comment-15365262 ] Hitesh Sharma commented on YARN-5216: - Thank you for the insights, [~kkaranasos]! Sorry, rebalancing

[jira] [Resolved] (YARN-5319) testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee resolved YARN-5319. Resolution: Duplicate > testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail >

[jira] [Created] (YARN-5320) Add resource usage by applications and queues to cluster overview page.

2016-07-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5320: Summary: Add resource usage by applications and queues to cluster overview page. Key: YARN-5320 URL: https://issues.apache.org/jira/browse/YARN-5320 Project: Hadoop YARN

[jira] [Created] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5327: Summary: API changes required to support recurring reservations in the YARN ReservationSystem Key: YARN-5327 URL: https://issues.apache.org/jira/browse/YARN-5327

[jira] [Updated] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5327: - Description: YARN-5326 proposes adding native support for recurring reservations in the YARN

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365269#comment-15365269 ] Li Lu commented on YARN-5229: - Yes. Let's put this into the "on-hold" list and commit it after merge. >

[jira] [Created] (YARN-5317) testAMRestartNotLostContainerCompleteMsg may fail

2016-07-06 Thread sandflee (JIRA)
sandflee created YARN-5317: -- Summary: testAMRestartNotLostContainerCompleteMsg may fail Key: YARN-5317 URL: https://issues.apache.org/jira/browse/YARN-5317 Project: Hadoop YARN Issue Type: Test

[jira] [Commented] (YARN-5321) Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365337#comment-15365337 ] Wangda Tan commented on YARN-5321: -- Attached sample screenshot. > Add resource usage for application by

[jira] [Created] (YARN-5321) Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5321: Summary: Add resource usage for application by node managers Key: YARN-5321 URL: https://issues.apache.org/jira/browse/YARN-5321 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5321) Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5321: - Attachment: sample-1.png > Add resource usage for application by node managers >

[jira] [Created] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5325: -- Summary: Stateless ARMRMProxy policies implementation Key: YARN-5325 URL: https://issues.apache.org/jira/browse/YARN-5325 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5324) Stateless router policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5324: -- Summary: Stateless router policies implementation Key: YARN-5324 URL: https://issues.apache.org/jira/browse/YARN-5324 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365343#comment-15365343 ] Wangda Tan commented on YARN-5294: -- Failed tests are tracked by: YARN-5318/YARN-5037/YARN-5317.

[jira] [Updated] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5233: -- Affects Version/s: (was: 2.8.0) 2.9.0 Target Version/s: 2.9.0 Committed to trunk

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365349#comment-15365349 ] Vinod Kumar Vavilapalli commented on YARN-5224: --- Note that for the "yarn logs" CLI to work

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365408#comment-15365408 ] Hadoop QA commented on YARN-5270: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II

2016-07-06 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365461#comment-15365461 ] Xianyin Xin commented on YARN-5302: --- Thanks [~varun_saxena]. Will upload a new patch as soon as possible.

  1   2   >