[jira] [Commented] (YARN-5121) fix some container-executor portability issues

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345822#comment-15345822 ] Hadoop QA commented on YARN-5121: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5278) Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration

2016-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345789#comment-15345789 ] Hudson commented on YARN-5278: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10006 (See

[jira] [Updated] (YARN-5278) Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-5278: Summary: Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration

[jira] [Commented] (YARN-5278) Remove unused variable in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345746#comment-15345746 ] Hadoop QA commented on YARN-5278: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5266) Wrong exit code while trying to get app logs using regex via CLI

2016-06-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5266: - Hadoop Flags: Reviewed > Wrong exit code while trying to get app logs using regex via CLI >

[jira] [Commented] (YARN-5266) Wrong exit code while trying to get app logs using regex via CLI

2016-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345737#comment-15345737 ] Hudson commented on YARN-5266: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10004 (See

[jira] [Commented] (YARN-5266) Wrong exit code while trying to get app logs using regex via CLI

2016-06-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345729#comment-15345729 ] Xuan Gong commented on YARN-5266: - Committed into trunk/branch-2. Thanks, junping for the review > Wrong

[jira] [Commented] (YARN-5290) ResourceManager can place more containers on a node than the node size allows

2016-06-22 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345677#comment-15345677 ] Joep Rottinghuis commented on YARN-5290: It seems to be another one in a series of bugs rooted in

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345660#comment-15345660 ] Hadoop QA commented on YARN-5221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4862) Handle duplicate completed containers in RMNodeImpl

2016-06-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345632#comment-15345632 ] Sunil G commented on YARN-4862: --- bq.It will slow down how fast the RM will re-schedule the resource

[jira] [Updated] (YARN-5121) fix some container-executor portability issues

2016-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5121: --- Target Version/s: 3.0.0-alpha1 > fix some container-executor portability issues >

[jira] [Updated] (YARN-5121) fix some container-executor portability issues

2016-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5121: --- Attachment: YARN-5121.03.patch -03: * rebase again > fix some container-executor portability

[jira] [Updated] (YARN-5278) Remove unused variable in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration

2016-06-22 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-5278: -- Attachment: YARN-5278-001.patch > Remove unused variable in >

[jira] [Assigned] (YARN-5278) Remove unused variable in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration

2016-06-22 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie reassigned YARN-5278: - Assignee: Tao Jie > Remove unused variable in >

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-06-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345623#comment-15345623 ] Sunil G commented on YARN-4280: --- bq.So yes, we need the other queues to stop allocating until the

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345589#comment-15345589 ] Hudson commented on YARN-5171: -- SUCCESS: Integrated in Hadoop-trunk-Commit #10002 (See

[jira] [Commented] (YARN-5174) several updates/corrections to timeline service documentation

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345562#comment-15345562 ] Hadoop QA commented on YARN-5174: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5174) several updates/corrections to timeline service documentation

2016-06-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5174: Attachment: (was: YARN-5174-YARN-2928.05.patch) > several updates/corrections to

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345543#comment-15345543 ] Arun Suresh commented on YARN-5171: --- +1, I'll remove the unused import when I commit.. > Extend

[jira] [Updated] (YARN-5174) several updates/corrections to timeline service documentation

2016-06-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5174: Attachment: YARN-5174-YARN-2928.06.patch [~varun_saxena], Have modified the doc but also one

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345539#comment-15345539 ] Inigo Goiri commented on YARN-5171: --- [~asuresh], other than the unused import, everything else (including

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-06-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345501#comment-15345501 ] Arun Suresh commented on YARN-5221: --- Also, I have left the containerVersion as *int* for the time being.

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-06-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Attachment: YARN-5221.005.patch Uploading patch addressing [~leftnoteasy]'s review comments. Please

[jira] [Commented] (YARN-5214) Pending on synchronized method DirectoryCollection#checkDirs can hang NM's NodeStatusUpdater

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345475#comment-15345475 ] Hadoop QA commented on YARN-5214: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345464#comment-15345464 ] Hadoop QA commented on YARN-4359: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345463#comment-15345463 ] Hadoop QA commented on YARN-5171: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345454#comment-15345454 ] Hadoop QA commented on YARN-5216: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5214) Pending on synchronized method DirectoryCollection#checkDirs can hang NM's NodeStatusUpdater

2016-06-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5214: - Attachment: YARN-5214-v3.patch Sounds like test failure is related. Fix in v3 patch with keep using

[jira] [Updated] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-06-22 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishai Menache updated YARN-4359: Attachment: YARN-4359.8.patch > Update LowCost agents logic to take advantage of YARN-4358 >

[jira] [Commented] (YARN-5274) Use smartctl to determine health of disks

2016-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345328#comment-15345328 ] Allen Wittenauer commented on YARN-5274: bq. The node health script is meant for the health of the

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5171: -- Attachment: YARN-5171.013.patch The javadoc error was caused due to the link to the LocalScheduler in

[jira] [Commented] (YARN-5274) Use smartctl to determine health of disks

2016-06-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345298#comment-15345298 ] Varun Vasudev commented on YARN-5274: - The node health script is meant for the health of the node. It

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-06-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345266#comment-15345266 ] Jason Lowe commented on YARN-4280: -- bq. IIRC the headroom is a combination of the user limits and the

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345243#comment-15345243 ] Hadoop QA commented on YARN-5171: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2016-06-22 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345220#comment-15345220 ] Sidharta Seethana commented on YARN-5168: - YARN today does not dynamically allocate/manage ports

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-06-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345203#comment-15345203 ] Jason Lowe commented on YARN-4280: -- Thanks for updating the patch, Kuhu! I'm confused by the

[jira] [Commented] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345191#comment-15345191 ] Hadoop QA commented on YARN-4359: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5266) Wrong exit code while trying to get app logs using regex via CLI

2016-06-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345167#comment-15345167 ] Junping Du commented on YARN-5266: -- v2 patch LGTM. The checkstyle issue is not related. +1. Will commit it

[jira] [Updated] (YARN-5289) Use checksum in localization requests

2016-06-22 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-5289: - Summary: Use checksum in localization requests (was: Use checksum in localisation requests) > Use

[jira] [Commented] (YARN-5291) Store node information for finished containers in timeline v2

2016-06-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345142#comment-15345142 ] Li Lu commented on YARN-5291: - Ah, sorry, I overlooked this part. Sorry, this is invalid > Store node

[jira] [Resolved] (YARN-5291) Store node information for finished containers in timeline v2

2016-06-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-5291. - Resolution: Invalid I overlooked the info field in container entities. The required information is already

[jira] [Commented] (YARN-5291) Store node information for finished containers in timeline v2

2016-06-22 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345118#comment-15345118 ] Vrushali C commented on YARN-5291: -- Is something missing for finished containers. Like did you mean

[jira] [Created] (YARN-5291) Store node information for finished containers in timeline v2

2016-06-22 Thread Li Lu (JIRA)
Li Lu created YARN-5291: --- Summary: Store node information for finished containers in timeline v2 Key: YARN-5291 URL: https://issues.apache.org/jira/browse/YARN-5291 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-06-22 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishai Menache updated YARN-4359: Attachment: YARN-4359.7.patch > Update LowCost agents logic to take advantage of YARN-4358 >

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.012.patch Added more comments and improved resiliency of unit test. > Extend

[jira] [Commented] (YARN-4862) Handle duplicate completed containers in RMNodeImpl

2016-06-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345069#comment-15345069 ] Jason Lowe commented on YARN-4862: -- bq. I also do not see this as a performance bottleneck, as we are

[jira] [Commented] (YARN-5290) ResourceManager can place more containers on a node than the node size allows

2016-06-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345064#comment-15345064 ] Jason Lowe commented on YARN-5290: -- We could have the RM wait until it receives hard confirmation from the

[jira] [Created] (YARN-5290) ResourceManager can place more containers on a node than the node size allows

2016-06-22 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-5290: Summary: ResourceManager can place more containers on a node than the node size allows Key: YARN-5290 URL: https://issues.apache.org/jira/browse/YARN-5290 Project: Hadoop

[jira] [Commented] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345019#comment-15345019 ] Yufei Gu commented on YARN-5288: [~zxu], thanks a lot for comments. Seems like YARN-3727 can solve the

[jira] [Commented] (YARN-5270) Solve miscellaneous issues caused by YARN-4844

2016-06-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345015#comment-15345015 ] Wangda Tan commented on YARN-5270: -- Javac warnings are caused by known JDK 7 issue which cannot be fixed:

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344973#comment-15344973 ] Hadoop QA commented on YARN-5171: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4862) Handle duplicate completed containers in RMNodeImpl

2016-06-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344921#comment-15344921 ] Sunil G commented on YARN-4862: --- Agreeing to the discussion here. Basically its better that we do a sanity

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344912#comment-15344912 ] Konstantinos Karanasos commented on YARN-5171: -- Naming in the latest patch (v011) looks

[jira] [Commented] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344910#comment-15344910 ] zhihai xu commented on YARN-5288: - Thanks for reporting this issue [~yufeigu]! Can YARN-3727 fix your

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-06-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344888#comment-15344888 ] Sunil G commented on YARN-4280: --- Thanks [~kshukla] for the patch and its an interesting problem. I have one

[jira] [Updated] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5288: --- Component/s: nodemanager > Resource Localization fails due to leftover files >

[jira] [Updated] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5288: --- Affects Version/s: 2.9.0 > Resource Localization fails due to leftover files >

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.011.patch Fixing checktyles and naming. > Extend DistributedSchedulerProtocol to

[jira] [Created] (YARN-5289) Use checksum in localisation requests

2016-06-22 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-5289: Summary: Use checksum in localisation requests Key: YARN-5289 URL: https://issues.apache.org/jira/browse/YARN-5289 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5288: --- Description: NM restart didn't clean up all user cache. The leftover files can cause resource localization

[jira] [Assigned] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5288: -- Assignee: Yufei Gu > Resource Localization fails due to leftover files >

[jira] [Created] (YARN-5288) Resource Localization fails due to leftover files

2016-06-22 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5288: -- Summary: Resource Localization fails due to leftover files Key: YARN-5288 URL: https://issues.apache.org/jira/browse/YARN-5288 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-06-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344670#comment-15344670 ] Junping Du commented on YARN-4676: -- Robert, I think it should be fine to defer RM restart issue to a

[jira] [Commented] (YARN-5281) Explore supporting a simpler back-end implementation for ATS v2

2016-06-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344639#comment-15344639 ] Sangjin Lee commented on YARN-5281: --- If we're open to the limitation of a single node setup, there could

[jira] [Commented] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344626#comment-15344626 ] Hadoop QA commented on YARN-4280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5274) Use smartctl to determine health of disks

2016-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344527#comment-15344527 ] Allen Wittenauer edited comment on YARN-5274 at 6/22/16 3:35 PM: - This is

[jira] [Comment Edited] (YARN-5274) Use smartctl to determine health of disks

2016-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344527#comment-15344527 ] Allen Wittenauer edited comment on YARN-5274 at 6/22/16 3:34 PM: - This is

[jira] [Commented] (YARN-5274) Use smartctl to determine health of disks

2016-06-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344527#comment-15344527 ] Allen Wittenauer commented on YARN-5274: This is pretty much one of many things a health check

[jira] [Updated] (YARN-4280) CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster

2016-06-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4280: -- Attachment: YARN-4280.004.patch Updated ParentQueue to use summed up blockedLimits across its child

[jira] [Commented] (YARN-5286) Add RPC port info in RM web service's response when getting app status

2016-06-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344418#comment-15344418 ] Hadoop QA commented on YARN-5286: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5286) Add RPC port info in RM web service's response when getting app status

2016-06-22 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-5286: --- Attachment: YARN-5286.01.patch Attach a patch to fix it. > Add RPC port info in RM web service's response

[jira] [Commented] (YARN-5282) Fix typos in CapacityScheduler documentation

2016-06-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343951#comment-15343951 ] Akira AJISAKA commented on YARN-5282: - LGTM, +1. Thanks [~rchiang]. > Fix typos in CapacityScheduler

[jira] [Updated] (YARN-3854) Add localization support for docker images

2016-06-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-3854: --- Attachment: YARN-3854_Localization_support_for_Docker_image_v2.pdf There is an existing environment

[jira] [Comment Edited] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-06-22 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343815#comment-15343815 ] Ying Zhang edited comment on YARN-5287 at 6/22/16 7:08 AM: --- The fix would be

[jira] [Updated] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-06-22 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-5287: - Description: LinuxContainerExecutor fails to set the proper permissions on the local directories(i.e.,

[jira] [Updated] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-06-22 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-5287: - Description: LinuxContainerExecutor fails to set the proper permissions on the local directories(i.e.,

[jira] [Updated] (YARN-5287) LinuxContainerExecutor fails to set proper permission

2016-06-22 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-5287: - Summary: LinuxContainerExecutor fails to set proper permission (was: LinuxContainerExecutor fail to set

[jira] [Commented] (YARN-5287) LinuxContainerExecutor fail to set proper permissions

2016-06-22 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343815#comment-15343815 ] Ying Zhang commented on YARN-5287: -- The fix would be explicitly set the permission after creating the

[jira] [Created] (YARN-5287) LinuxContainerExecutor fail to set proper permissions

2016-06-22 Thread Ying Zhang (JIRA)
Ying Zhang created YARN-5287: Summary: LinuxContainerExecutor fail to set proper permissions Key: YARN-5287 URL: https://issues.apache.org/jira/browse/YARN-5287 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2016-06-22 Thread oujianrong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15343777#comment-15343777 ] oujianrong commented on YARN-2497: -- Does fair scheduler suppport node label in yarn 2.6? Thanks. >