[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-07-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365654#comment-15365654 ] Rohith Sharma K S commented on YARN-5315: - bq. awaitTerminatioin will block until all tasks

[jira] [Reopened] (YARN-4948) Support node labels store in zookeeper

2016-07-06 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng reopened YARN-4948: --- need make the trunk take this change > Support node labels store in zookeeper >

[jira] [Comment Edited] (YARN-4948) Support node labels store in zookeeper

2016-07-06 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365648#comment-15365648 ] jialei weng edited comment on YARN-4948 at 7/7/16 5:48 AM: --- Hi, [~leftnoteasy]

[jira] [Comment Edited] (YARN-4948) Support node labels store in zookeeper

2016-07-06 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365648#comment-15365648 ] jialei weng edited comment on YARN-4948 at 7/7/16 5:48 AM: --- Hi, [~leftnoteasy]

[jira] [Commented] (YARN-4948) Support node labels store in zookeeper

2016-07-06 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365648#comment-15365648 ] jialei weng commented on YARN-4948: --- Hi, [~leftnoteasy], what is the progress to bring this patch to

[jira] [Commented] (YARN-5320) [YARN-3368] Add resource usage by applications and queues to cluster overview page.

2016-07-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365638#comment-15365638 ] Weiwei Yang commented on YARN-5320: --- Hello [~leftnoteasy] Do you think it would be good if we can have a

[jira] [Commented] (YARN-5200) Improve yarn logs to get Container List

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365553#comment-15365553 ] Hadoop QA commented on YARN-5200: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5200) Improve yarn logs to get Container List

2016-07-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5200: Attachment: YARN-5200.8.patch rebase the patch based on the latest trunk > Improve yarn logs to get

[jira] [Commented] (YARN-5309) SSLFactory truststore reloader thread leak in TimelineClientImpl

2016-07-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365526#comment-15365526 ] Weiwei Yang commented on YARN-5309: --- Hello Thomas I think you need MAPREDUCE-6618 as well to fix this

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365512#comment-15365512 ] Inigo Goiri commented on YARN-5215: --- [~kasha], for the node utilization, in Windows it's pretty fast and

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365506#comment-15365506 ] Karthik Kambatla commented on YARN-5215: YARN-1011 and I assume YARN-5202 primarily target using

[jira] [Updated] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5327: - Description: YARN-5326 proposes adding native support for recurring reservations in the YARN

[jira] [Created] (YARN-5331) Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5331: Summary: Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem Key: YARN-5331 URL:

[jira] [Created] (YARN-5330) SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5330: Summary: SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5330 URL: https://issues.apache.org/jira/browse/YARN-5330

[jira] [Created] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5329: Summary: ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5329 URL:

[jira] [Created] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5328: Summary: InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5328 URL: https://issues.apache.org/jira/browse/YARN-5328

[jira] [Created] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5327: Summary: API changes required to support recurring reservations in the YARN ReservationSystem Key: YARN-5327 URL: https://issues.apache.org/jira/browse/YARN-5327

[jira] [Updated] (YARN-5326) Add support for recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5326: - Description: YARN-1051 introduced a ReservationSytem that enables the YARN RM to handle time

[jira] [Updated] (YARN-5326) Add support for recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5326: - Attachment: SupportRecurringReservationsInRayon.pdf Attaching a design doc with our proposal to

[jira] [Created] (YARN-5326) Add support for recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5326: Summary: Add support for recurring reservations in the YARN ReservationSystem Key: YARN-5326 URL: https://issues.apache.org/jira/browse/YARN-5326 Project: Hadoop

[jira] [Commented] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II

2016-07-06 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365461#comment-15365461 ] Xianyin Xin commented on YARN-5302: --- Thanks [~varun_saxena]. Will upload a new patch as soon as possible.

[jira] [Commented] (YARN-5309) SSLFactory truststore reloader thread leak in TimelineClientImpl

2016-07-06 Thread Thomas Friedrich (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365451#comment-15365451 ] Thomas Friedrich commented on YARN-5309: Hi [~cheersyang], Hive still depends on an older version

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365408#comment-15365408 ] Hadoop QA commented on YARN-5270: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365373#comment-15365373 ] Hudson commented on YARN-5233: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10057 (See

[jira] [Updated] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5233: -- Affects Version/s: (was: 2.8.0) 2.9.0 Target Version/s: 2.9.0 Committed to trunk

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365349#comment-15365349 ] Vinod Kumar Vavilapalli commented on YARN-5224: --- Note that for the "yarn logs" CLI to work

[jira] [Updated] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5325: --- Description: This JIRA tracks policies in the AMRMProxy that decide how to forward ResourceRequests,

[jira] [Updated] (YARN-5324) Stateless router policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5324: --- Description: These are policies at the Router that do not require maintaing state across choices

[jira] [Updated] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-07-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5323: --- Description: This JIRA tracks APIs for the policies that will guide the Router and AMRMProxy decisions

[jira] [Created] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5325: -- Summary: Stateless ARMRMProxy policies implementation Key: YARN-5325 URL: https://issues.apache.org/jira/browse/YARN-5325 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365343#comment-15365343 ] Wangda Tan commented on YARN-5294: -- Failed tests are tracked by: YARN-5318/YARN-5037/YARN-5317.

[jira] [Created] (YARN-5324) Stateless router policies implementation

2016-07-06 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5324: -- Summary: Stateless router policies implementation Key: YARN-5324 URL: https://issues.apache.org/jira/browse/YARN-5324 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-07-06 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5323: -- Summary: Policies APIs (for Router and AMRMProxy policies) Key: YARN-5323 URL: https://issues.apache.org/jira/browse/YARN-5323 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5322) [YARN-3368] Add a node heat chart map

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5322: - Attachment: sample-1.png > [YARN-3368] Add a node heat chart map > - >

[jira] [Created] (YARN-5322) [YARN-3368] Add a node heat chart map

2016-07-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5322: Summary: [YARN-3368] Add a node heat chart map Key: YARN-5322 URL: https://issues.apache.org/jira/browse/YARN-5322 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5320) [YARN-3368] Add resource usage by applications and queues to cluster overview page.

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5320: - Summary: [YARN-3368] Add resource usage by applications and queues to cluster overview page. (was: Add

[jira] [Updated] (YARN-5321) [YARN-3368] Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5321: - Summary: [YARN-3368] Add resource usage for application by node managers (was: Add resource usage for

[jira] [Commented] (YARN-5321) Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365337#comment-15365337 ] Wangda Tan commented on YARN-5321: -- Attached sample screenshot. > Add resource usage for application by

[jira] [Created] (YARN-5321) Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5321: Summary: Add resource usage for application by node managers Key: YARN-5321 URL: https://issues.apache.org/jira/browse/YARN-5321 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5321) Add resource usage for application by node managers

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5321: - Attachment: sample-1.png > Add resource usage for application by node managers >

[jira] [Created] (YARN-5320) Add resource usage by applications and queues to cluster overview page.

2016-07-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5320: Summary: Add resource usage by applications and queues to cluster overview page. Key: YARN-5320 URL: https://issues.apache.org/jira/browse/YARN-5320 Project: Hadoop YARN

[jira] [Assigned] (YARN-5037) TestRMRestart#testQueueMetricsOnRMRestart random faiure

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee reassigned YARN-5037: -- Assignee: sandflee > TestRMRestart#testQueueMetricsOnRMRestart random faiure >

[jira] [Comment Edited] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365317#comment-15365317 ] sandflee edited comment on YARN-4939 at 7/6/16 11:16 PM: - Thanks [~djp], the test

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365317#comment-15365317 ] sandflee commented on YARN-4939: Thanks [~djp], the test seems not related, could run pass locally, file

[jira] [Resolved] (YARN-5319) testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee resolved YARN-5319. Resolution: Duplicate > testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail >

[jira] [Created] (YARN-5319) testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail

2016-07-06 Thread sandflee (JIRA)
sandflee created YARN-5319: -- Summary: testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail Key: YARN-5319 URL: https://issues.apache.org/jira/browse/YARN-5319 Project: Hadoop YARN

[jira] [Created] (YARN-5318) testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail

2016-07-06 Thread sandflee (JIRA)
sandflee created YARN-5318: -- Summary: testRefreshNodesResourceWithFileSystemBasedConfigurationProvider may fail Key: YARN-5318 URL: https://issues.apache.org/jira/browse/YARN-5318 Project: Hadoop YARN

[jira] [Created] (YARN-5317) testAMRestartNotLostContainerCompleteMsg may fail

2016-07-06 Thread sandflee (JIRA)
sandflee created YARN-5317: -- Summary: testAMRestartNotLostContainerCompleteMsg may fail Key: YARN-5317 URL: https://issues.apache.org/jira/browse/YARN-5317 Project: Hadoop YARN Issue Type: Test

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365290#comment-15365290 ] Sangjin Lee commented on YARN-5229: --- Oh OK. Thanks for the clarification! > Refactor

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365276#comment-15365276 ] Ray Chiang commented on YARN-5283: -- RE: Javadoc errors I see these in trunk even without my changes,

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365269#comment-15365269 ] Li Lu commented on YARN-5229: - Yes. Let's put this into the "on-hold" list and commit it after merge. >

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365264#comment-15365264 ] Vrushali C commented on YARN-5229: -- This is a post merge check in candidate. I don't think it needs to

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365262#comment-15365262 ] Hitesh Sharma commented on YARN-5216: - Thank you for the insights, [~kkaranasos]! Sorry, rebalancing

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365260#comment-15365260 ] Sangjin Lee commented on YARN-5229: --- Just to be clear, are we considering committing this *before* the

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365259#comment-15365259 ] Inigo Goiri commented on YARN-5215: --- In our internal deployment, we always reserve a buffer for the

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-07-06 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365256#comment-15365256 ] sandflee commented on YARN-5315: bq. shutdownNow() still does not wait for actively executing tasks to

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365237#comment-15365237 ] Li Lu commented on YARN-5229: - Let me kick jenkins again on this patch... > Refactor #isApplicationEntity and

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365239#comment-15365239 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365231#comment-15365231 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365218#comment-15365218 ] Andrew Wang commented on YARN-5270: --- Thanks for the reply Wangda. To clarify, I'm going to cut a

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365209#comment-15365209 ] Li Lu commented on YARN-5229: - Thanks [~vrushalic]. +1 pending Jenkins. > Refactor #isApplicationEntity and

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365202#comment-15365202 ] Jian He commented on YARN-5233: --- lgtm > Support for specifying a path for ATS plugin jars >

[jira] [Comment Edited] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365197#comment-15365197 ] Vrushali C edited comment on YARN-5229 at 7/6/16 10:03 PM: --- Thanks for the review

[jira] [Comment Edited] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365197#comment-15365197 ] Vrushali C edited comment on YARN-5229 at 7/6/16 10:04 PM: --- Thanks for the review

[jira] [Updated] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5229: - Attachment: YARN-5229-YARN-2928.04.patch Thanks for the review [~gtCarrera], uploading v4 that addresses

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365163#comment-15365163 ] Hudson commented on YARN-5224: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10056 (See

[jira] [Commented] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365158#comment-15365158 ] Hadoop QA commented on YARN-5283: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365101#comment-15365101 ] Konstantinos Karanasos commented on YARN-5216: -- Thanks for the reply, [~hrsharma]. Some

[jira] [Commented] (YARN-5224) Logs for a completed container are not available in the yarn logs output for a live application

2016-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365091#comment-15365091 ] Vinod Kumar Vavilapalli commented on YARN-5224: --- Thanks for the update. The TestYarnClient

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365085#comment-15365085 ] Hitesh Sharma commented on YARN-5216: - [~kkaranasos], I'm not sure if subclassing would work. We need

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365070#comment-15365070 ] Jason Lowe commented on YARN-5215: -- Maybe I'm missing something, but any of the proposed approaches has

[jira] [Comment Edited] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-07-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363095#comment-15363095 ] Robert Kanter edited comment on YARN-4676 at 7/6/16 8:57 PM: - Yes, it tracks in

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365061#comment-15365061 ] Hadoop QA commented on YARN-5233: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365043#comment-15365043 ] Hadoop QA commented on YARN-5314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5270: - Attachment: YARN-5270.003.patch Attached patch for trunk as well. [~andrew.wang], I think it's not

[jira] [Commented] (YARN-5227) yarn logs command: no need to specify -applicationId when specifying containerId

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365036#comment-15365036 ] Hudson commented on YARN-5227: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10055 (See

[jira] [Updated] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5314: Attachment: YARN-5314-trunk.002.patch New patch to address checkstyle comments. > ConcurrentModificationException

[jira] [Updated] (YARN-5283) Refactor container assignment into AbstractYarnScheduler#assignContainers

2016-07-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5283: - Attachment: YARN-5283.001.patch Initial refactor attempt > Refactor container assignment into

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365007#comment-15365007 ] Li Lu commented on YARN-5229: - Refactor LGTM. [~vrushalic] could you please address the two issues raised by

[jira] [Commented] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364994#comment-15364994 ] Hadoop QA commented on YARN-5314: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364989#comment-15364989 ] Li Lu commented on YARN-5316: - +1. Fix LGTM. Thanks for the work Sangjin! > fix hadoop-aws pom not to do the

[jira] [Updated] (YARN-5314) ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5314: Attachment: YARN-5314-trunk.001.patch Thanks [~karams] for reporting this issue! The two exceptions are for

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364961#comment-15364961 ] Hadoop QA commented on YARN-5294: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-07-06 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364957#comment-15364957 ] Sidharta Seethana commented on YARN-3854: - [~tangzhankun], thanks for uploading the doc and the

[jira] [Commented] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II

2016-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364953#comment-15364953 ] Varun Saxena commented on YARN-5302: I think changes here will be required irrespective of YARN-5175.

[jira] [Comment Edited] (YARN-5302) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token II

2016-07-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364953#comment-15364953 ] Varun Saxena edited comment on YARN-5302 at 7/6/16 7:39 PM: I think changes

[jira] [Commented] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364935#comment-15364935 ] Hadoop QA commented on YARN-5229: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364893#comment-15364893 ] Hitesh Sharma commented on YARN-5216: - [~asuresh], [~kkaranasos]], thank you for the feedback and

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364887#comment-15364887 ] Vrushali C commented on YARN-5316: -- +1 Thanks for the patch Sangjin! I can commit it in at EOD today. >

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-07-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364888#comment-15364888 ] Vinod Kumar Vavilapalli commented on YARN-5315: --- shutdownNow() still does not wait for

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364886#comment-15364886 ] Hadoop QA commented on YARN-4939: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-07-06 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364865#comment-15364865 ] Andrew Wang commented on YARN-5270: --- I think this is the last JIRA we're waiting on for 3.0.0-alpha1. If

[jira] [Commented] (YARN-5316) fix hadoop-aws pom not to do the exclusion

2016-07-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364843#comment-15364843 ] Sangjin Lee commented on YARN-5316: --- Let me know what you think. I'd like to make this an exception and

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-07-06 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364799#comment-15364799 ] Konstantinos Karanasos commented on YARN-5216: -- Thinking more about it... Another option would

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-07-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364765#comment-15364765 ] Karthik Kambatla commented on YARN-5215: Spoke to Inigo offline at the summit. My primary concern

[jira] [Updated] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5294: -- Attachment: YARN-5294-branch-2.patch upload branch-2 patch > Pass remote ip address down to

[jira] [Updated] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4939: - Attachment: YARN-4939.05.patch Put a patch with this minor fix and adjust some import. Will commit if Mr.

[jira] [Commented] (YARN-5233) Support for specifying a path for ATS plugin jars

2016-07-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364758#comment-15364758 ] Li Lu commented on YARN-5233: - Oh and, our ApplicationClassLoader will delegate the loadClass process to its

[jira] [Commented] (YARN-5294) Pass remote ip address down to YarnAuthorizationProvider

2016-07-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364748#comment-15364748 ] Hudson commented on YARN-5294: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10054 (See

[jira] [Commented] (YARN-4939) the decommissioning Node should keep alive if NM restart

2016-07-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15364719#comment-15364719 ] Junping Du commented on YARN-4939: -- The build failure is due to rm.NMwaitForState() is actually not define

  1   2   >