[jira] [Commented] (YARN-5104) TestNMProxy.testNMProxyRPCRetry failed

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514589#comment-15514589 ] Yufei Gu commented on YARN-5104: This has been fixed by HADOOP-11212. With HADOOP-11212, SocketException

[jira] [Commented] (YARN-4973) YarnWebParams next.fresh.interval should be next.refresh.interval

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514824#comment-15514824 ] Robert Kanter commented on YARN-4973: - +1 > YarnWebParams next.fresh.interval should be

[jira] [Updated] (YARN-5324) Stateless Federation router policies implementation

2016-09-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5324: - Summary: Stateless Federation router policies implementation (was: Stateless router policies

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515000#comment-15515000 ] Naganarasimha G R commented on YARN-3692: - [~rohithsharma], Seems like patch doesnt seem to apply

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514649#comment-15514649 ] Hadoop QA commented on YARN-3142: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515024#comment-15515024 ] Weiwei Yang commented on YARN-5145: --- Hello [~leftnoteasy] If all configuration are set in yarn-site.xml,

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514558#comment-15514558 ] Hadoop QA commented on YARN-5659: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-5104) TestNMProxy.testNMProxyRPCRetry failed

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-5104. Resolution: Duplicate > TestNMProxy.testNMProxyRPCRetry failed > -- > >

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514757#comment-15514757 ] Hadoop QA commented on YARN-5400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

2016-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515059#comment-15515059 ] Hudson commented on YARN-3692: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10476 (See

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514660#comment-15514660 ] Sergey Shelukhin commented on YARN-5659: Apparently editing patches directly is not a good idea...

[jira] [Commented] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514704#comment-15514704 ] Carlo Curino commented on YARN-5324: [~subru] thanks for reviewing. I addressed the nits. > Stateless

[jira] [Updated] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5324: --- Attachment: YARN-5324-YARN-2915.16.patch > Stateless router policies implementation >

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4907: --- Attachment: YARN-4907.001.patch > Make all MockRM#waitForState consistent. >

[jira] [Commented] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514760#comment-15514760 ] Hadoop QA commented on YARN-5324: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4973) YarnWebParams next.fresh.interval should be next.refresh.interval

2016-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514885#comment-15514885 ] Hudson commented on YARN-4973: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10475 (See

[jira] [Commented] (YARN-4493) move queue can make app don't belong to any queue

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514602#comment-15514602 ] Yufei Gu commented on YARN-4493: I will close this as invalid. Feel free to reopen it if you have any

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514632#comment-15514632 ] Robert Kanter commented on YARN-5400: - +1 pending Jenkins > Light cleanup in ZKRMStateStore >

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514795#comment-15514795 ] Hadoop QA commented on YARN-5659: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Xabriel J Collazo Mojica (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514903#comment-15514903 ] Xabriel J Collazo Mojica commented on YARN-3877: Folks, I see that the

[jira] [Updated] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated YARN-5659: --- Attachment: YARN-5659.04.patch The patch without a spurious change.. > getPathFromYarnURL

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514765#comment-15514765 ] Robert Kanter commented on YARN-5400: - Test failure appears to be YARN-5057. [~templedf], can you look

[jira] [Commented] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515008#comment-15515008 ] Yufei Gu commented on YARN-4907: Some {{waitForState}} return a boolean since the caller need to assert on

[jira] [Comment Edited] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515008#comment-15515008 ] Yufei Gu edited comment on YARN-4907 at 9/23/16 1:14 AM: - Some {{waitForState}}

[jira] [Commented] (YARN-5324) Stateless router policies implementation

2016-09-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514674#comment-15514674 ] Subru Krishnan commented on YARN-5324: -- +1 on the latest patch, thanks [~curino] for addressing all my

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515206#comment-15515206 ] stefanlee commented on YARN-4743: - Thanks ,my hadoop version is 2.4.0 and i just found that

[jira] [Commented] (YARN-4767) Network issues can cause persistent RM UI outage

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515210#comment-15515210 ] Daniel Templeton commented on YARN-4767: The javadoc complaints are all about the fact that {{_}}

[jira] [Updated] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5400: --- Attachment: YARN-5400.002.patch Here's a patch to resolve the javadoc issues and a couple

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515334#comment-15515334 ] Naganarasimha G R commented on YARN-4464: - Thanks [~templedf], +1, Latest patch LGTM. > default

[jira] [Updated] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-09-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated YARN-5551: --- Attachment: YARN-5551.branch-2.002.patch Attaching .2 version which takes into account

[jira] [Comment Edited] (YARN-5551) Ignore deleted file mapping from memory computation when smaps is enabled

2016-09-22 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515481#comment-15515481 ] Rajesh Balamohan edited comment on YARN-5551 at 9/23/16 5:43 AM: - Attaching

[jira] [Commented] (YARN-5388) MAPREDUCE-6719 requires changes to DockerContainerExecutor

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515328#comment-15515328 ] Daniel Templeton commented on YARN-5388: [~sidharta-s], [~vvasudev], any chance you could give me a

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Attachment: YARN-5662.2.patch > Provide an option to enable ContainerMonitor >

[jira] [Commented] (YARN-4907) Make all MockRM#waitForState consistent.

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515276#comment-15515276 ] Hadoop QA commented on YARN-4907: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5400) Light cleanup in ZKRMStateStore

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15515405#comment-15515405 ] Hadoop QA commented on YARN-5400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514480#comment-15514480 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], Thanks. I missed that. > Priority support for

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512388#comment-15512388 ] Sunil G commented on YARN-4205: --- Hi [~gsaha] Generally this comment makes sense for me. If we are passing

[jira] [Issue Comment Deleted] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3139: -- Comment: was deleted (was: May be it's related to some consistency issues with respect to queue stats?) >

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513402#comment-15513402 ] Jian He commented on YARN-3139: --- There are also similar comments like this... I just couldn't remember why

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513480#comment-15513480 ] Jian He commented on YARN-5609: --- looks good to me overall, I think wherever {{setIsReInitializing(false)}}

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512393#comment-15512393 ] Sunil G commented on YARN-3142: --- Ok. That's fine for me. We may get a much clearer picture there. > Improve

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512376#comment-15512376 ] Sunil G commented on YARN-5611: --- Thanks [~rohithsharma], few high level comments. 1. {code}

[jira] [Created] (YARN-5661) transitionToActive blocks when enable work-preserving-recovery

2016-09-22 Thread fengyongshe (JIRA)
fengyongshe created YARN-5661: - Summary: transitionToActive blocks when enable work-preserving-recovery Key: YARN-5661 URL: https://issues.apache.org/jira/browse/YARN-5661 Project: Hadoop YARN

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Attachment: YARN-5662.1.patch > Provide an option to enable ContainerMonitor >

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512696#comment-15512696 ] Naganarasimha G R commented on YARN-3877: - Thanks for the comments [~Ying Zhang], We need to fix

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512698#comment-15512698 ] Varun Saxena commented on YARN-3877: Yes. Somebody needs to commit it. Will look at killApplication too

[jira] [Commented] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512728#comment-15512728 ] Hadoop QA commented on YARN-5662: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-5661) transitionToActive blocks when enable work-preserving-recovery

2016-09-22 Thread fengyongshe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] fengyongshe resolved YARN-5661. --- Resolution: Duplicate > transitionToActive blocks when enable work-preserving-recovery >

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512673#comment-15512673 ] Varun Saxena commented on YARN-5585: Just to clarify, what I meant by having another index table was

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Description: Currently, if vmem/pmem check is not enabled, ContainerMonitor would not run. In certain cases,

[jira] [Updated] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5662: -- Release Note: (was: Currently, if vmem/pmem check is not enabled, ContainerMonitor would not run. In certain

[jira] [Created] (YARN-5662) Provide an option to enable ContainerMonitor

2016-09-22 Thread Jian He (JIRA)
Jian He created YARN-5662: - Summary: Provide an option to enable ContainerMonitor Key: YARN-5662 URL: https://issues.apache.org/jira/browse/YARN-5662 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2255) YARN Audit logging not added to log4j.properties

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512721#comment-15512721 ] Varun Saxena commented on YARN-2255: Ok...Please go ahead. > YARN Audit logging not added to

[jira] [Updated] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3877: --- Attachment: YARN-3877.04.patch > YarnClientImpl.submitApplication swallows exceptions >

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513926#comment-15513926 ] Daniel Templeton edited comment on YARN-4266 at 9/22/16 5:40 PM: - After

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514003#comment-15514003 ] Wangda Tan commented on YARN-5145: -- Thanks [~kaisasak] and [~sunilg] looking into the issue. I'm not sure

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513914#comment-15513914 ] Daniel Templeton commented on YARN-5605: I think I'm happy with the last patch. +1 > Preempt

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513926#comment-15513926 ] Daniel Templeton commented on YARN-4266: After some discussion and thought, I think that 3.2 is OK

[jira] [Comment Edited] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513806#comment-15513806 ] Yufei Gu edited comment on YARN-4743 at 9/22/16 5:46 PM: - Hi [~imstefanlee],

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512989#comment-15512989 ] Steve Loughran commented on YARN-3877: -- was this ever committed? I guess not >

[jira] [Updated] (YARN-5539) TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out"

2016-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5539: - Attachment: YARN-5539.patch Attach a quick patch to fix for corner case here. The fix It is very

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512997#comment-15512997 ] Hadoop QA commented on YARN-3877: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5539) TimelineClient failed to retry on "java.net.SocketTimeoutException: Read timed out"

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513130#comment-15513130 ] Hadoop QA commented on YARN-5539: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513222#comment-15513222 ] stefanlee commented on YARN-4743: - Thanks [~yufeigu] ,i also met this problem,my scenario is that i

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2016-09-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513003#comment-15513003 ] Naganarasimha G R commented on YARN-3877: - Thanks for the patch [~varun_saxena], will get this

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513703#comment-15513703 ] Tsuyoshi Ozawa commented on YARN-3139: -- [~leftnoteasy] [~jianhe] thanks for taking this issue.

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513717#comment-15513717 ] Daniel Templeton commented on YARN-3139: Yep. I added it to my todo list, but I won't get there

[jira] [Comment Edited] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513480#comment-15513480 ] Jian He edited comment on YARN-5609 at 9/22/16 2:44 PM: looks good to me overall,

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513545#comment-15513545 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for the comments. Mostly makes sense, I will update a new

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513725#comment-15513725 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], I have some concerns about this algorithm from above:

[jira] [Updated] (YARN-5663) Possible resource leak

2016-09-22 Thread Oleksii Dymytrov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksii Dymytrov updated YARN-5663: --- Attachment: YARN_5663_v1_001_patch.patch > Possible resource leak > -- > >

[jira] [Created] (YARN-5663) Possible resource leak

2016-09-22 Thread Oleksii Dymytrov (JIRA)
Oleksii Dymytrov created YARN-5663: -- Summary: Possible resource leak Key: YARN-5663 URL: https://issues.apache.org/jira/browse/YARN-5663 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: YARN-4464.006.patch The docs are already correct. I foolishly believed them that

[jira] [Comment Edited] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514243#comment-15514243 ] Varun Saxena edited comment on YARN-5585 at 9/22/16 7:25 PM: - Summarizing the

[jira] [Commented] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514302#comment-15514302 ] Daniel Templeton commented on YARN-5659: The checkstyle and whitespace issue (both are the same)

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514243#comment-15514243 ] Varun Saxena commented on YARN-5585: Summarizing the solution we decided upon in the call. * We will

[jira] [Updated] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4329: --- Attachment: YARN-4329.001.patch > Allow fetching exact reason as to why a submitted app is in ACCEPTED state

[jira] [Commented] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514370#comment-15514370 ] Hadoop QA commented on YARN-4329: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5659) getPathFromYarnURL should use standard methods

2016-09-22 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated YARN-5659: --- Attachment: YARN-5659.04.patch whitespace fixes... > getPathFromYarnURL should use standard

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514396#comment-15514396 ] Varun Saxena commented on YARN-3142: Thanks [~leftnoteasy], [~sunilg] for reviews. bq. Lock is not

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514393#comment-15514393 ] Eric Payne commented on YARN-2009: -- bq. So we could take a max(guaranteed, used). Will this be fine? I

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514405#comment-15514405 ] Wangda Tan commented on YARN-2009: -- Hi [~eepayne], bq. If Queue1 has 100 resources, and if user1 starts

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514415#comment-15514415 ] Wangda Tan commented on YARN-3142: -- [~varun_saxena], bq. But we wont be using this till we set current

[jira] [Comment Edited] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514396#comment-15514396 ] Varun Saxena edited comment on YARN-3142 at 9/22/16 8:30 PM: - Thanks

[jira] [Updated] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3142: --- Attachment: YARN-3142.02.patch > Improve locks in AppSchedulingInfo >

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513407#comment-15513407 ] Jian He commented on YARN-3139: --- [~templedf], would you like to check the FairScheduler changes? > Improve

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513416#comment-15513416 ] Jian He commented on YARN-3139: --- May be it's related to some consistency issues with respect to queue stats?

[jira] [Comment Edited] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513402#comment-15513402 ] Jian He edited comment on YARN-3139 at 9/22/16 2:20 PM: There are also similar

[jira] [Commented] (YARN-5663) Possible resource leak

2016-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513754#comment-15513754 ] Daniel Templeton commented on YARN-5663: I don't think that's actually a leak, but I don't mind the

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513781#comment-15513781 ] Sangjin Lee commented on YARN-5585: --- Thanks for your comments [~varun_saxena]. Yes, we should discuss

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513806#comment-15513806 ] Yufei Gu commented on YARN-4743: Hi [~imstefanlee], continous scheduling uses the same code to do the

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513815#comment-15513815 ] Wangda Tan commented on YARN-3139: -- Actually we need to hold application's lock when this is called. Will

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513822#comment-15513822 ] Wangda Tan commented on YARN-3139: -- [~ozawa], Yeah we plan to add multi-threading scheduling

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513827#comment-15513827 ] Wangda Tan commented on YARN-3139: -- Thanks [~templedf], but I really want to get this done sooner as it

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513840#comment-15513840 ] Sunil G commented on YARN-2009: --- Hi [~eepayne] Couple of doubts on the comments. bq.Shouldn't the following

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513883#comment-15513883 ] Karthik Kambatla commented on YARN-3139: Sorry [~leftnoteasy]. I will be traveling and won't have a