[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820339#comment-15820339 ] Varun Saxena commented on YARN-6064: Maybe javadoc can be {code} Defines the flow run id. If specified,

[jira] [Commented] (YARN-6016) Bugs in AMRMProxy handling (local)AMRMToken

2017-01-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819946#comment-15819946 ] Subru Krishnan commented on YARN-6016: -- Thanks [~botong] for the patch. Overall it looks good, I just

[jira] [Comment Edited] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820173#comment-15820173 ] Naganarasimha G R edited comment on YARN-6072 at 1/12/17 4:50 AM: -- Thanks

[jira] [Commented] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820042#comment-15820042 ] Sunil G commented on YARN-5825: --- I do not see this as an incompatible change. [~jianhe], could you please

[jira] [Updated] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5864: - Attachment: YARN-5864.006.patch Uploaded ver.6 patch, now made move reserved container to be a

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820316#comment-15820316 ] Rohith Sharma K S commented on YARN-6064: - Given no more concern on the Java Doc, I will attach

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819959#comment-15819959 ] Ying Zhang commented on YARN-6031: -- Failed test case () is known and tracked by YARN-5548. > Application

[jira] [Comment Edited] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819959#comment-15819959 ] Ying Zhang edited comment on YARN-6031 at 1/12/17 2:41 AM: --- Failed test case

[jira] [Commented] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820014#comment-15820014 ] Hadoop QA commented on YARN-6071: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4212) FairScheduler: Parent queues is not allowed to be 'Fair' policy if its children have the "drf" policy

2017-01-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820419#comment-15820419 ] Yufei Gu commented on YARN-4212: Thanks [~rchiang] and [~kasha]'s review. I uploaded patch 006 for all your

[jira] [Commented] (YARN-5899) Debug log in AbstractCSQueue#canAssignToThisQueue needs improvement

2017-01-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819998#comment-15819998 ] Ying Zhang commented on YARN-5899: -- Thanks [~sunilg] for the review and commit. > Debug log in

[jira] [Commented] (YARN-6008) Fetch container list for failed application attempt

2017-01-11 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820160#comment-15820160 ] Ajith S commented on YARN-6008: --- I agree to this, will upload initial patch for the same shortly > Fetch

[jira] [Commented] (YARN-5304) Ship single node HBase config option with single startup command

2017-01-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819904#comment-15819904 ] Sangjin Lee commented on YARN-5304: --- Thanks for the summary [~vrushalic]. It is a good summary of the

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820030#comment-15820030 ] Sunil G commented on YARN-6081: --- Thanks [~leftnoteasy] for the updated patch, and thanks [~eepayne] for the

[jira] [Commented] (YARN-6058) Support for listing all applications i.e /apps

2017-01-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15820029#comment-15820029 ] Rohith Sharma K S commented on YARN-6058: - +1 for flow type which is very much necessary. There

[jira] [Updated] (YARN-4212) FairScheduler: Parent queues is not allowed to be 'Fair' policy if its children have the "drf" policy

2017-01-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4212: --- Attachment: YARN-4212.006.patch > FairScheduler: Parent queues is not allowed to be 'Fair' policy if its >

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818493#comment-15818493 ] Naganarasimha G R commented on YARN-6072: - [~jianh] any more comments or shall i go ahead ? > RM

[jira] [Commented] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

2017-01-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818577#comment-15818577 ] Eric Badger commented on YARN-5416: --- [~djp], patch looks good to me. Should probably clean up the

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2017-01-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818961#comment-15818961 ] Bibin A Chundatt commented on YARN-5849: Latest patch looks good to me too. > Automatically create

[jira] [Commented] (YARN-6058) Support for listing all applications i.e /apps

2017-01-11 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818964#comment-15818964 ] Joep Rottinghuis commented on YARN-6058: Agreed we should hit the flow-activity table. Other tables

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-01-11 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819132#comment-15819132 ] Devaraj K commented on YARN-5764: - bq. Do you have any benchmarks results that would illustrate the kind of

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819211#comment-15819211 ] Hadoop QA commented on YARN-5556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5864: - Attachment: YARN-5864.004.patch [~sunilg], thanks for reviewing, for your comments: For 1), yes,

[jira] [Commented] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2017-01-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819248#comment-15819248 ] Jason Lowe commented on YARN-574: - Thanks for picking this up [~ajithshetty]. I took a quick look at the

[jira] [Commented] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

2017-01-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818824#comment-15818824 ] Jason Lowe commented on YARN-5416: -- +1 lgtm. I'll fix the unused import checkstyle nits during the

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818835#comment-15818835 ] Sunil G commented on YARN-5864: --- Thanks [~leftnoteasy] for detailed proposal and the patch. I think this

[jira] [Commented] (YARN-5378) Accomodate app-id->cluster mapping

2017-01-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818889#comment-15818889 ] Rohith Sharma K S commented on YARN-5378: - [~sjlee0] this is one of the requirement I am getting

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817617#comment-15817617 ] Hadoop QA commented on YARN-6072: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817714#comment-15817714 ] Hadoop QA commented on YARN-6031: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817725#comment-15817725 ] Varun Saxena commented on YARN-6027: [~rohithsharma], so IIUC what you basically want is for a single

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-11 Thread gehaijiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817846#comment-15817846 ] gehaijiang commented on YARN-6062: -- thanks! JDK 7U80 and JDK8 Is using beta > nodemanager memory

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817878#comment-15817878 ] Hadoop QA commented on YARN-6031: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817589#comment-15817589 ] Sunil G edited comment on YARN-6031 at 1/11/17 8:03 AM: Quick correction: Could u

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817589#comment-15817589 ] Sunil G commented on YARN-6031: --- Quick correction: Could u also pls added {{LOG.isDebugEnabled()}} before

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-01-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817623#comment-15817623 ] Ravi Prakash commented on YARN-5764: Hi Devaraj! Thanks for all your work. Do you have any benchmarks

[jira] [Comment Edited] (YARN-5764) NUMA awareness support for launching containers

2017-01-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817623#comment-15817623 ] Ravi Prakash edited comment on YARN-5764 at 1/11/17 8:21 AM: - Hi Devaraj!

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817651#comment-15817651 ] Naganarasimha G R commented on YARN-6072: - Test case failures seems to be unrelated to the patch

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817747#comment-15817747 ] Ying Zhang commented on YARN-6031: -- Thanks [~sunilg]. Done. I was thinking that LOG.debug can do this

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817764#comment-15817764 ] Rohith Sharma K S commented on YARN-6027: - Yes, it is doable. We have done POC for the same at one

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817675#comment-15817675 ] Rohith Sharma K S commented on YARN-6027: - bq. Is that making things slow? Yes, it is slow bq.

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817767#comment-15817767 ] Sunil G commented on YARN-6031: --- Patch generally looks fie for me. Will wait for jenkins to kick off. Also

[jira] [Updated] (YARN-6031) Application recovery failed after disabling node label

2017-01-11 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-6031: - Attachment: YARN-6031.006.patch > Application recovery failed after disabling node label >

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818286#comment-15818286 ] Bibin A Chundatt commented on YARN-6062: JDK 7U45 as per the github report the issue is not

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818018#comment-15818018 ] Sunil G commented on YARN-6081: --- Thanks [~leftnoteasy]. Good catch! We decrement pending resources only if

[jira] [Updated] (YARN-5556) Support for deleting queues without requiring a RM restart

2017-01-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5556: Attachment: YARN-5556.v2.006.patch attaching a patch for addressing [~wangda]'s comments >

[jira] [Commented] (YARN-6058) Support for listing all applications i.e /apps

2017-01-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819113#comment-15819113 ] Varun Saxena commented on YARN-6058: Well, whatever you are asking for here would lead to a full table

[jira] [Issue Comment Deleted] (YARN-6058) Support for listing all applications i.e /apps

2017-01-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6058: --- Comment: was deleted (was: Whatever ) > Support for listing all applications i.e /apps >

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819338#comment-15819338 ] Eric Payne commented on YARN-6081: -- Thanks [~leftnoteasy] for fixing this. I am reviewing today. I will

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2017-01-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819395#comment-15819395 ] Daniel Templeton commented on YARN-5849: Excellent. Thanks, [~bibinchundatt]! +1 Committing

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-11 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-3637: --- Attachment: YARN-3637-trunk.001.patch Attached is a v01 patch for handling symlink names and fragments

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819442#comment-15819442 ] Hudson commented on YARN-5554: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11108 (See

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819482#comment-15819482 ] Eric Payne commented on YARN-5889: -- [~sunilg], - Shoule {{resetUserAddedOrRemoved}} just be

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819541#comment-15819541 ] Hadoop QA commented on YARN-3637: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-6083) Add doc for reservation in Fair Scheduler

2017-01-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-6083. -- Resolution: Duplicate [~yufeigu], IIUC this is a duplicate of YARN-4827. I already have a draft

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819452#comment-15819452 ] Eric Payne commented on YARN-6081: -- +1 LGTM. The failed test ({{TestRMRestart}}) is not related to this

[jira] [Updated] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6076: --- Attachment: yarn-6076-branch-2.1.patch > Backport YARN-4752 (FS preemption changes) to

[jira] [Commented] (YARN-6083) Add doc for reservation in Fair Scheduler

2017-01-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819564#comment-15819564 ] Yufei Gu commented on YARN-6083: Thanks for pointing out, [~subru]. > Add doc for reservation in Fair

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819374#comment-15819374 ] Hadoop QA commented on YARN-6081: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819469#comment-15819469 ] Karthik Kambatla commented on YARN-6076: I am able to build this locally with both java8 and java7.

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-01-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818887#comment-15818887 ] Sunil G commented on YARN-5764: --- Thanks [~devaraj.k] for the proposal. Looks very interesting.. As mentioned

[jira] [Assigned] (YARN-5378) Accomodate app-id->cluster mapping

2017-01-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee reassigned YARN-5378: - Assignee: Sangjin Lee (was: Joep Rottinghuis) > Accomodate app-id->cluster mapping >

[jira] [Commented] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818918#comment-15818918 ] Hudson commented on YARN-5416: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11107 (See

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-01-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Attachment: YARN-5966.002.patch Updating patch. Fixing failed testcase > AMRMClient changes to support

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819685#comment-15819685 ] Hudson commented on YARN-5849: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1 (See

[jira] [Commented] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819695#comment-15819695 ] Andrew Wang commented on YARN-5825: --- Doing a release notes sweep for 3.0.0-alpha2, noticed this JIRA. If

[jira] [Commented] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819729#comment-15819729 ] Daniel Templeton commented on YARN-6071: [~leftnoteasy], what's the story on this one? Are you

[jira] [Commented] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819734#comment-15819734 ] Wangda Tan commented on YARN-6071: -- [~templedf], yeah I was keep forgetting upload patch for this one.

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819731#comment-15819731 ] Naganarasimha G R commented on YARN-6072: - Thanks [~djp],[~jianhe] and [~kasha] for confirming.

[jira] [Updated] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5864: - Attachment: YARN-5864.005.patch Uploaded ver.5 patch, which include code to print performance information.

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819587#comment-15819587 ] Jian He commented on YARN-6072: --- looks good to me, +1 > RM unable to start in secure mode >

[jira] [Updated] (YARN-5991) Yarn Distributed Shell does not print throwable t to App Master When failed to start container

2017-01-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated YARN-5991: -- Hadoop Flags: Reviewed (was: Incompatible change,Reviewed) I'm unsetting the "incompatible" flag since

[jira] [Commented] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-01-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819778#comment-15819778 ] Hadoop QA commented on YARN-5966: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819036#comment-15819036 ] Junping Du commented on YARN-6072: -- I believe latest patch already incorporate Jian's comments above.

[jira] [Commented] (YARN-6058) Support for listing all applications i.e /apps

2017-01-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819074#comment-15819074 ] Varun Saxena commented on YARN-6058: Whatever > Support for listing all applications i.e /apps >

[jira] [Created] (YARN-6083) Add doc for reservation in Fair Scheduler

2017-01-11 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6083: -- Summary: Add doc for reservation in Fair Scheduler Key: YARN-6083 URL: https://issues.apache.org/jira/browse/YARN-6083 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6081: - Attachment: YARN-6081.002.patch Thanks [~sunilg] for reviewing the patch. For 2), it uses

[jira] [Updated] (YARN-6071) Fix incompatible API change on AM-RM protocol due to YARN-3866 (trunk only)

2017-01-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6071: - Attachment: YARN-6071.001.patch Attached ver.1 patch for review. > Fix incompatible API change on AM-RM

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2017-01-11 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819827#comment-15819827 ] Miklos Szegedi commented on YARN-5849: -- Thank you [~bibinchundatt] for the review and [~templedf] for

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819869#comment-15819869 ] Hudson commented on YARN-6072: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #2 (See