[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-27 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065923#comment-16065923 ] Manikandan R commented on YARN-6467: Fixed findbugs error. Junit failures are not related to this

[jira] [Updated] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-27 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6467: --- Attachment: YARN-6467-branch-2.8.011.patch > CSQueueMetrics needs to update the current metrics for

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065906#comment-16065906 ] Hadoop QA commented on YARN-6689: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-06-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065864#comment-16065864 ] Naganarasimha G R commented on YARN-6428: - As discussed offline with [~sunilg], What

[jira] [Updated] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-06-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6223: - Attachment: YARN-6223.wip.2.patch Attached ver.2 WIP patch which discussed with [~chris.douglas] /

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-06-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065840#comment-16065840 ] Wangda Tan commented on YARN-6593: -- Thanks [~kkaranasos]/[~chris.douglas]/[~subru] for putting this

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065830#comment-16065830 ] Jonathan Hung commented on YARN-6689: - 004 fixes checkstyle again. > PlacementRule should be

[jira] [Updated] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6689: Attachment: YARN-6689.004.patch > PlacementRule should be configurable >

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-27 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065823#comment-16065823 ] Bibin A Chundatt commented on YARN-6708: Thank you [~jlowe] for review. {quote} Is there a reason

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065811#comment-16065811 ] Hadoop QA commented on YARN-6689: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-06-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065803#comment-16065803 ] Wangda Tan commented on YARN-4161: -- Thanks [~ywskycn] for the patch, [~sunilg] could you help review the

[jira] [Commented] (YARN-6600) Enhance default lifetime of application at LeafQueue level.

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065777#comment-16065777 ] Hadoop QA commented on YARN-6600: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-06-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065753#comment-16065753 ] Naganarasimha G R commented on YARN-6492: - Hi [~jhung], YARN-6467 is the base for this jira

[jira] [Comment Edited] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065748#comment-16065748 ] Naganarasimha G R edited comment on YARN-6467 at 6/28/17 12:57 AM: --- Hi

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065748#comment-16065748 ] Naganarasimha G R commented on YARN-6467: - Hi > CSQueueMetrics needs to update the current

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065696#comment-16065696 ] Jonathan Hung commented on YARN-6689: - 003 patch fixes TestYarnConfigurationFields test (others seem

[jira] [Updated] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6689: Attachment: YARN-6689.003.patch > PlacementRule should be configurable >

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-06-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065682#comment-16065682 ] Wangda Tan commented on YARN-5881: -- Created a branch (YARN-5881) for this feature. > Enable configuration

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065674#comment-16065674 ] Hadoop QA commented on YARN-6689: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6600) Enhance default lifetime of application at LeafQueue level.

2017-06-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065656#comment-16065656 ] Rohith Sharma K S commented on YARN-6600: - High level changes on the patch # introduced CS

[jira] [Updated] (YARN-6600) Enhance default lifetime of application at LeafQueue level.

2017-06-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6600: Attachment: YARN-6600.01.patch > Enhance default lifetime of application at LeafQueue level.

[jira] [Updated] (YARN-6600) Enhance default lifetime of application at LeafQueue level.

2017-06-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6600: Attachment: [YARN-6600] Extend lifetime to scheduler Leaf Queue.pdf > Enhance default

[jira] [Commented] (YARN-5311) Document graceful decommission CLI and usage

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065623#comment-16065623 ] Hadoop QA commented on YARN-5311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5311) Document graceful decommission CLI and usage

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065612#comment-16065612 ] Hadoop QA commented on YARN-5311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6738) LevelDBCacheTimelineStore should reuse ObjectMapper instances

2017-06-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065610#comment-16065610 ] Hudson commented on YARN-6738: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11934 (See

[jira] [Comment Edited] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065564#comment-16065564 ] Jonathan Hung edited comment on YARN-6689 at 6/27/17 10:15 PM: --- Hi

[jira] [Commented] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065564#comment-16065564 ] Jonathan Hung commented on YARN-6689: - Hi [~xgong], as discussed, attached 002 patch which: # changes

[jira] [Updated] (YARN-6689) PlacementRule should be configurable

2017-06-27 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6689: Attachment: YARN-6689.002.patch > PlacementRule should be configurable >

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065535#comment-16065535 ] Jason Lowe commented on YARN-6708: -- Thanks for updating the patch! This looks a lot cleaner. Is there a

[jira] [Commented] (YARN-5311) Document graceful decommission CLI and usage

2017-06-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065541#comment-16065541 ] Junping Du commented on YARN-5311: -- Sorry for coming late on this. Latest patch LGTM now, I think we can

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-06-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-4161: -- Attachment: YARN-4161.patch.1 Rebase for trunk, by moving the assignMultiple check to scheduler-level, instead

[jira] [Commented] (YARN-6738) LevelDBCacheTimelineStore should reuse ObjectMapper instances

2017-06-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065519#comment-16065519 ] Junping Du commented on YARN-6738: -- +1. Patch LGTM as well. > LevelDBCacheTimelineStore should reuse

[jira] [Assigned] (YARN-6744) Recover component information on YARN native services AM restart

2017-06-27 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-6744: Assignee: Billie Rinaldi > Recover component information on YARN native services AM restart

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-06-27 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065414#comment-16065414 ] Eric Badger commented on YARN-4266: --- bq. I'm not really a fan of hard coding bind mounts like we've done

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-06-27 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065260#comment-16065260 ] Shane Kumpf commented on YARN-4266: --- Thanks, [~ebadger]! It sounds like you are making good progress.

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2017-06-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065226#comment-16065226 ] Junping Du commented on YARN-2919: -- Thanks [~Naganarasimha] for contributing the patch. Latest patch looks

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065200#comment-16065200 ] Hadoop QA commented on YARN-6708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6507) Support FPGA abstraction framework on NM side

2017-06-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065193#comment-16065193 ] Wangda Tan commented on YARN-6507: -- Thanks [~tangzhankun] for the patch. I'm recently working on GPU

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-06-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065182#comment-16065182 ] Sunil G commented on YARN-6428: --- bq. LimitedPrivate only applicable for specified projects.. So i don't think

[jira] [Commented] (YARN-6720) Support updating FPGA related constraint node label after FPGA device re-configuration

2017-06-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065170#comment-16065170 ] Wangda Tan commented on YARN-6720: -- Thanks [~tangzhankun] and [~YuQiang Ye] for this proposal. In general

[jira] [Updated] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-27 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6708: --- Attachment: YARN-6708.004.patch [~jlowe] Thank you for looking into issue.Attaching patch with

[jira] [Commented] (YARN-5006) ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk

2017-06-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065090#comment-16065090 ] Naganarasimha G R commented on YARN-5006: - Yeah saw that, I am fine with it ! > ResourceManager

[jira] [Assigned] (YARN-6738) LevelDBCacheTimelineStore should reuse ObjectMapper instances

2017-06-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-6738: Assignee: Zoltan Haindrich > LevelDBCacheTimelineStore should reuse ObjectMapper instances >

[jira] [Created] (YARN-6744) Recover component information on YARN native services AM restart

2017-06-27 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-6744: Summary: Recover component information on YARN native services AM restart Key: YARN-6744 URL: https://issues.apache.org/jira/browse/YARN-6744 Project: Hadoop YARN

[jira] [Commented] (YARN-5006) ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk

2017-06-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064960#comment-16064960 ] Daniel Templeton commented on YARN-5006: It's such a minor thing that I didn't think it was worth

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064848#comment-16064848 ] Hadoop QA commented on YARN-5148: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2017-06-27 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-5148: - Attachment: YARN-5148.13.patch > [YARN-3368] Add page to new YARN UI to view server side >

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2017-06-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064829#comment-16064829 ] Hadoop QA commented on YARN-5148: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5927) BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate

2017-06-27 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064825#comment-16064825 ] Kai Sasaki commented on YARN-5927: -- [~ka...@cloudera.com] Sorry again. But could you take a look when you

[jira] [Updated] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2017-06-27 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-5148: - Attachment: YARN-5148.12.patch > [YARN-3368] Add page to new YARN UI to view server side >

[jira] [Commented] (YARN-6428) Queue AM limit is not honored in CS always

2017-06-27 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064392#comment-16064392 ] Bibin A Chundatt commented on YARN-6428: [~sunilg] {quote} I think there might be a compatibility

[jira] [Assigned] (YARN-6507) Support FPGA abstraction framework on NM side

2017-06-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-6507: -- Assignee: Zhankun Tang > Support FPGA abstraction framework on NM side >

[jira] [Commented] (YARN-6507) Support FPGA abstraction framework on NM side

2017-06-27 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16064373#comment-16064373 ] Zhankun Tang commented on YARN-6507: Some thoughts about next step: 1. For the vendor specific plugin,