[jira] [Assigned] (YARN-6075) Yarn top for FairScheduler

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6075: -- Assignee: Yufei Gu > Yarn top for FairScheduler > -- > > Key: YA

[jira] [Commented] (YARN-6073) Misuse of format specifier in Preconditions.checkArgument

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814173#comment-15814173 ] Hudson commented on YARN-6073: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1109

[jira] [Comment Edited] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814163#comment-15814163 ] zhangyubiao edited comment on YARN-5995 at 1/10/17 7:17 AM: Tha

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814163#comment-15814163 ] zhangyubiao commented on YARN-5995: --- Thanks [~sunilg] . IMO, Histogram belong com.codaha

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814127#comment-15814127 ] Hadoop QA commented on YARN-6072: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814049#comment-15814049 ] Sunil G commented on YARN-5995: --- Yes. Thanks for clarifying [~jianhe] So Ideally we can supp

[jira] [Commented] (YARN-6073) Misuse of format specifier in Preconditions.checkArgument

2017-01-09 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814032#comment-15814032 ] Yuanbo Liu commented on YARN-6073: -- [~templedf] Thanks for your review. > Misuse of forma

[jira] [Updated] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-6072: -- Attachment: YARN-6072.01.branch-2.patch > RM unable to start in secure mode > - >

[jira] [Updated] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6022: --- Attachment: (was: YARN-6022.branch-2.006.patch) > Revert changes of AbstractResourceRequest

[jira] [Updated] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6022: --- Attachment: YARN-6022.branch-2.006.patch > Revert changes of AbstractResourceRequest >

[jira] [Commented] (YARN-6073) Misuse of format specifier in Preconditions.checkArgument

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814006#comment-15814006 ] Daniel Templeton commented on YARN-6073: Patch looks good to me. +1 > Misuse of f

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813955#comment-15813955 ] Varun Saxena commented on YARN-6062: Is NM recovery enabled ? > nodemanager memory lea

[jira] [Commented] (YARN-6008) Fetch container list for failed application attempt

2017-01-09 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813936#comment-15813936 ] David Yan commented on YARN-6008: - Thanks, I'm just a YARN user, not exactly a dev, at leas

[jira] [Commented] (YARN-3774) ZKRMStateStore should use Curator 3.0 and avail CuratorOp

2017-01-09 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813915#comment-15813915 ] Tsuyoshi Ozawa commented on YARN-3774: -- Thanks Jordan for the notification! I think we

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813903#comment-15813903 ] Jian He commented on YARN-5995: --- sorry, I meant the external tool such as (Ambari Metrics Ser

[jira] [Updated] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-6072: -- Attachment: YARN-6072.01.patch attaching patch for trunk. will update for branch 2 and 2.8 shortly > RM unable t

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813788#comment-15813788 ] Bibin A Chundatt commented on YARN-6062: [~gehaijiang] Could you please have a look

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813739#comment-15813739 ] Sunil G commented on YARN-5995: --- Thank [~jianhe] for chipping in. I also agree about the rea

[jira] [Commented] (YARN-3955) Support for application priority ACLs in queues of CapacityScheduler

2017-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813710#comment-15813710 ] Sunil G commented on YARN-3955: --- Thank you [~leftnoteasy] for the review and commit. Thanks [

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813705#comment-15813705 ] Sunil G commented on YARN-5889: --- Thank You Eric. Yes. I missed this. Will update in next patc

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813673#comment-15813673 ] Vrushali C commented on YARN-5980: -- Thanks Sangjin! Will make these changes. Table specif

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813658#comment-15813658 ] Hudson commented on YARN-4148: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1109

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813644#comment-15813644 ] Junping Du commented on YARN-4148: -- I just commit the 003 patch to trunk and branch-2. For

[jira] [Updated] (YARN-6075) Yarn top for FairScheduler

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6075: --- Component/s: (was: resourcemanager) > Yarn top for FairScheduler >

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread gehaijiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813562#comment-15813562 ] gehaijiang commented on YARN-6062: -- pid 6653 process restart. Cluster nodemanager hav

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread gehaijiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813556#comment-15813556 ] gehaijiang commented on YARN-6062: -- java version "1.7.0_65" Java(TM) SE Runtime Environmen

[jira] [Commented] (YARN-6011) Add a new web service to list the files on a container in AHSWebService

2017-01-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813533#comment-15813533 ] Junping Du commented on YARN-6011: -- Thanks [~xgong] for delivering the patch. A couple of

[jira] [Commented] (YARN-5937) stop-yarn.sh is not able to gracefully stop node managers

2017-01-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813490#comment-15813490 ] Weiwei Yang commented on YARN-5937: --- Perfect, thank you [~Naganarasimha] :) > stop-yarn.

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813393#comment-15813393 ] Sangjin Lee commented on YARN-5980: --- Thanks [~vrushalic] for your patch! Most of the comm

[jira] [Commented] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813388#comment-15813388 ] Hadoop QA commented on YARN-6076: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813380#comment-15813380 ] Hadoop QA commented on YARN-5980: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-01-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813375#comment-15813375 ] Wangda Tan commented on YARN-5764: -- Thanks [~devaraj.k] for updating design doc and patch,

[jira] [Updated] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5980: - Attachment: YARN-5980.003.patch Uploading 003 that fixes the whitespace at the end of line as reported by

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813313#comment-15813313 ] Hadoop QA commented on YARN-5980: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813302#comment-15813302 ] Junping Du commented on YARN-6072: -- [~jianhe]'s comments are pretty persuasive. I will wai

[jira] [Updated] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6022: --- Attachment: YARN-6022.branch-2.006.patch Oops. Screwed up patch5. Hopefully this works better

[jira] [Updated] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5980: - Attachment: YARN-5980.002.patch Uploading patch 002. This updates the hbase version as well as makes the st

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813265#comment-15813265 ] Hadoop QA commented on YARN-6061: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813260#comment-15813260 ] Daniel Templeton commented on YARN-5554: Sorry. Looks like I started repeating mys

[jira] [Updated] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6076: --- Attachment: yarn-6076-branch-2.1.patch > Backport YARN-4752 (FS preemption changes) to branch-2

[jira] [Updated] (YARN-3427) Remove deprecated methods from ResourceCalculatorProcessTree

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3427: --- Target Version/s: 3.0.0-beta1 (was: ) Priority: Blocker (was: Major) Hadoo

[jira] [Updated] (YARN-453) Optimize FS internal data structures

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-453: -- Assignee: (was: Karthik Kambatla) > Optimize FS internal data structures > ---

[jira] [Updated] (YARN-809) Enable better parallelism in the Fair Scheduler

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-809: -- Assignee: (was: Karthik Kambatla) > Enable better parallelism in the Fair Scheduler >

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813168#comment-15813168 ] Junping Du commented on YARN-4148: -- Yes, I agree that the two test failures are not relate

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813135#comment-15813135 ] Yufei Gu commented on YARN-6061: Had an offline discussion with [~kasha]. We agreed to enla

[jira] [Updated] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Attachment: YARN-6061.001.patch > Add a customized uncaughtexceptionhandler for critical threads >

[jira] [Updated] (YARN-6061) Add a customized uncaughtexceptionhandler for critical thread

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Summary: Add a customized uncaughtexceptionhandler for critical thread (was: Add a customized uncaughtexceptio

[jira] [Updated] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Summary: Add a customized uncaughtexceptionhandler for critical threads (was: Add a customized uncaughtexcepti

[jira] [Updated] (YARN-6061) Add a customized uncaughtexceptionhandler for fair scheduler

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Component/s: (was: fairscheduler) > Add a customized uncaughtexceptionhandler for fair scheduler >

[jira] [Updated] (YARN-6061) Add a customized uncaughtexceptionhandler for fair scheduler

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6061: --- Labels: (was: fairscheduler) > Add a customized uncaughtexceptionhandler for fair scheduler > ---

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-09 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813092#comment-15813092 ] Jason Lowe commented on YARN-4148: -- The unit test failures appear to be unrelated. They p

[jira] [Comment Edited] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813047#comment-15813047 ] Karthik Kambatla edited comment on YARN-6072 at 1/9/17 10:32 PM:

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813047#comment-15813047 ] Karthik Kambatla commented on YARN-6072: My vote would be to safe and fix it in 2.8

[jira] [Updated] (YARN-5976) Update hbase version to 1.2 (removes phoenix dependencies)

2017-01-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5976: - Summary: Update hbase version to 1.2 (removes phoenix dependencies) (was: Update hbase version to 1.2) >

[jira] [Comment Edited] (YARN-6000) Make AllocationFileLoaderService.Listener public

2017-01-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812994#comment-15812994 ] Sergey Shelukhin edited comment on YARN-6000 at 1/9/17 10:06 PM:

[jira] [Commented] (YARN-6000) Make AllocationFileLoaderService.Listener public

2017-01-09 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812994#comment-15812994 ] Sergey Shelukhin commented on YARN-6000: Thanks! As for Hive requirements, see the

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2017-01-09 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812907#comment-15812907 ] Yufei Gu commented on YARN-4022: Hi [~forrestchen], are you still work on this? If not, can

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812903#comment-15812903 ] Jian He commented on YARN-6072: --- YARN-5709 actually affected the sequence of start. Before YA

[jira] [Commented] (YARN-6057) yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812832#comment-15812832 ] Hadoop QA commented on YARN-6057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-6057) yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds

2017-01-09 Thread Julia Sommer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julia Sommer updated YARN-6057: --- Attachment: YARN-6057.002.patch Corrected version attached. Thanks! > yarn.scheduler.minimum-allocatio

[jira] [Updated] (YARN-6077) /bin/bash path is hardcoded in node manager

2017-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6077: - Description: We need a configuration entry similar to MRJobConfig.MAPRED_ADMIN_USER_SHELL to suppo

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812737#comment-15812737 ] Eric Payne commented on YARN-5889: -- [~sunilg], bq. However, I do think {{reComputeUserLimi

[jira] [Commented] (YARN-6077) /bin/bash path is hardcoded in node manager

2017-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812693#comment-15812693 ] Miklos Szegedi commented on YARN-6077: -- This bug was opened based on the discussion wi

[jira] [Commented] (YARN-6060) Linux container executor fails to run container on directories mounted as noexec

2017-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812689#comment-15812689 ] Miklos Szegedi commented on YARN-6060: -- I opened HADOOP-13963 and YARN-6077. Since I a

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812676#comment-15812676 ] Jian He commented on YARN-5995: --- Actually, it can be most useful if this is a time series met

[jira] [Updated] (YARN-6057) yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6057: --- Summary: yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a r

[jira] [Created] (YARN-6077) /bin/bash path is hardcoded in node manager

2017-01-09 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6077: Summary: /bin/bash path is hardcoded in node manager Key: YARN-6077 URL: https://issues.apache.org/jira/browse/YARN-6077 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6057) yarn.scheduler.minimum-allocation-* and yarn.scheduler.maximum-allocation-* descriptions are incorrect about behavior when a request is out of bounds

2017-01-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812637#comment-15812637 ] Daniel Templeton commented on YARN-6057: That's my bad. I foolishly assumed that t

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812626#comment-15812626 ] Naganarasimha G R commented on YARN-6072: - +1 to unblock for 2.8.0 > RM unable to

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812620#comment-15812620 ] Jian He commented on YARN-5995: --- As said earlier, read won't be that useful as it only happen

[jira] [Commented] (YARN-5937) stop-yarn.sh is not able to gracefully stop node managers

2017-01-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812614#comment-15812614 ] Naganarasimha G R commented on YARN-5937: - Thanks [~cheersyang], Sorry for the dela

[jira] [Created] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-09 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-6076: -- Summary: Backport YARN-4752 (FS preemption changes) to branch-2 Key: YARN-6076 URL: https://issues.apache.org/jira/browse/YARN-6076 Project: Hadoop YARN

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812579#comment-15812579 ] Hadoop QA commented on YARN-5556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812546#comment-15812546 ] Junping Du commented on YARN-6072: -- bq. YARN-5333 and YARN-5988 are not available in 2.8.0

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812539#comment-15812539 ] zhangyubiao commented on YARN-5995: --- Thanks. [~sunilg] > Add RMStateStore metrics to mon

[jira] [Comment Edited] (YARN-5188) FairScheduler performance bug

2017-01-09 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812533#comment-15812533 ] zhangyubiao edited comment on YARN-5188 at 1/9/17 6:56 PM: --- [~che

[jira] [Commented] (YARN-5188) FairScheduler performance bug

2017-01-09 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812533#comment-15812533 ] zhangyubiao commented on YARN-5188: --- @ChenFolin it is ok for me to take over this JIRA?

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812517#comment-15812517 ] Vrushali C commented on YARN-5980: -- Thanks [~varun_saxena] and [~sjlee0], yes I will updat

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812498#comment-15812498 ] Hadoop QA commented on YARN-6054: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-6060) Linux container executor fails to run container on directories mounted as noexec

2017-01-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812488#comment-15812488 ] Allen Wittenauer commented on YARN-6060: bq. should we create a JIRA to make /bin/b

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812459#comment-15812459 ] Naganarasimha G R commented on YARN-6054: - Thanks for the patch [~raviprakashu], b

[jira] [Resolved] (YARN-6060) Linux container executor fails to run container on directories mounted as noexec

2017-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi resolved YARN-6060. -- Resolution: Won't Fix Assignee: (was: Miklos Szegedi) > Linux container executor fails

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812451#comment-15812451 ] Wangda Tan commented on YARN-5889: -- bq. Let's please do these as separate JIRAs. We are ex

[jira] [Updated] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-6054: --- Attachment: YARN-6054.03.patch Here's a patch with the improvements suggested by Naganarasimha. > Time

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-09 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812432#comment-15812432 ] Ravi Prakash commented on YARN-6054: Thanks Naganarasimha for your careful review! As I

[jira] [Commented] (YARN-6060) Linux container executor fails to run container on directories mounted as noexec

2017-01-09 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812382#comment-15812382 ] Miklos Szegedi commented on YARN-6060: -- Thank you, [~vvasudev], [~aw] and [~templedf]

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812379#comment-15812379 ] Sangjin Lee commented on YARN-6064: --- Thanks [~rohithsharma] for the patch! (ApplicationR

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812321#comment-15812321 ] Bibin A Chundatt commented on YARN-6072: +1 from my side too. Tried the same on my

[jira] [Commented] (YARN-6074) FlowRunEntity does not deserialize long values correctly

2017-01-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812308#comment-15812308 ] Sangjin Lee commented on YARN-6074: --- Thanks for catching this [~rohithsharma]. > FlowRun

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812251#comment-15812251 ] Eric Payne commented on YARN-5889: -- Thanks [~leftnoteasy] for your review and comments. b

[jira] [Commented] (YARN-3955) Support for application priority ACLs in queues of CapacityScheduler

2017-01-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812228#comment-15812228 ] Hudson commented on YARN-3955: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1109

[jira] [Commented] (YARN-6062) nodemanager memory leak

2017-01-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812206#comment-15812206 ] Bibin A Chundatt commented on YARN-6062: [~gehaijiang] Could you provide java versi

[jira] [Updated] (YARN-3955) Support for application priority ACLs in queues of CapacityScheduler

2017-01-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3955: - Summary: Support for application priority ACLs in queues of CapacityScheduler (was: Support for priority A

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812187#comment-15812187 ] Wangda Tan commented on YARN-5889: -- Thanks [~sunilg] for providing the patch and reviews f

[jira] [Comment Edited] (YARN-6017) node manager physical memory leak

2017-01-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812167#comment-15812167 ] Bibin A Chundatt edited comment on YARN-6017 at 1/9/17 4:36 PM: -

[jira] [Commented] (YARN-6017) node manager physical memory leak

2017-01-09 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812167#comment-15812167 ] Bibin A Chundatt commented on YARN-6017: [~chenrongwei] This could be because of J

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812128#comment-15812128 ] Eric Payne commented on YARN-5889: -- bq. Since number of active users are changed, we need

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811877#comment-15811877 ] Sunil G commented on YARN-5995: --- Few suggestions here ||Op Name||Metric|| |#total no: of writ

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811871#comment-15811871 ] Hadoop QA commented on YARN-6064: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2017-01-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811817#comment-15811817 ] Sunil G commented on YARN-5889: --- Thanks [~eepayne] for the detailed explanation. I was also

  1   2   >