[jira] [Updated] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3091: - Issue Type: Task (was: Improvement) [Umbrella] Improve and fix locks of RM scheduler

[jira] [Updated] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3091: - Summary: [Umbrella] Improve and fix locks of RM scheduler (was: [Umbrella] Improve locks of RM scheduler)

[jira] [Created] (YARN-3095) Enable DockerContainerExecutor to update Docker image

2015-01-23 Thread Chen He (JIRA)
Chen He created YARN-3095: - Summary: Enable DockerContainerExecutor to update Docker image Key: YARN-3095 URL: https://issues.apache.org/jira/browse/YARN-3095 Project: Hadoop YARN Issue Type: New

[jira] [Commented] (YARN-3087) the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-01-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289567#comment-14289567 ] Zhijie Shen commented on YARN-3087: --- It's known issue for long time. I found the ticket

[jira] [Commented] (YARN-1142) MiniYARNCluster web ui does not work properly

2015-01-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289569#comment-14289569 ] Zhijie Shen commented on YARN-1142: --- Hi [~tucu00], did you have a chance to find where

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289591#comment-14289591 ] Ray Chiang commented on YARN-2868: -- Okay, my bad. I'll put it back the way it was. Add

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289619#comment-14289619 ] Sunil G commented on YARN-1963: --- As per discussion happened in YARN-2896 with [~eepayne] and

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289546#comment-14289546 ] Robert Metzger commented on YARN-3086: -- It seems that even on trunk tests are failing

[jira] [Commented] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289552#comment-14289552 ] Wangda Tan commented on YARN-3091: -- Thanks for jumping in and provide your thoughts.

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289603#comment-14289603 ] Wangda Tan commented on YARN-2800: -- Thanks review from [~vinodkv] and commit by [~ozawa].

[jira] [Commented] (YARN-3087) the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-01-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289779#comment-14289779 ] Sangjin Lee commented on YARN-3087: --- Thanks for that Zhijie. the REST server (web

[jira] [Updated] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2868: - Summary: Add metric for initial container launch time to FairScheduler (was: Add metric for initial

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289835#comment-14289835 ] Ray Chiang commented on YARN-2868: -- [~rohithsharma], it looks like

[jira] [Commented] (YARN-3081) Potential indefinite wait in ContainerManagementProtocolProxy#addProxyToCache()

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289773#comment-14289773 ] Tsuyoshi OZAWA commented on YARN-3081: -- Thank you, Ted! Potential indefinite wait in

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289832#comment-14289832 ] Wangda Tan commented on YARN-1963: -- Thanks for summary from [~sunilg], I think priority

[jira] [Commented] (YARN-3028) Better syntax for replace label CLI

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289846#comment-14289846 ] Wangda Tan commented on YARN-3028: -- Patch LGTM, will commit this week. Thanks, Better

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289769#comment-14289769 ] Hadoop QA commented on YARN-3021: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3088) LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error

2015-01-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3088: - Attachment: YARN-3088.v1.txt [~jlowe], would you please take a look at this patch?

[jira] [Updated] (YARN-650) User guide for preemption

2015-01-23 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-650: -- Fix Version/s: (was: 2.7.0) User guide for preemption -

[jira] [Updated] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2868: - Attachment: YARN-2868.007.patch - Move metric to QueueMetrics parent class (to be compatible with

[jira] [Commented] (YARN-3030) set up ATS writer with basic request serving structure and lifecycle

2015-01-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289974#comment-14289974 ] Zhijie Shen commented on YARN-3030: --- I'm not sure if we will have quick solution for

[jira] [Commented] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290042#comment-14290042 ] Anubhav Dhoot commented on YARN-3079: - Should we add a couple of more combinations to

[jira] [Updated] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3092: - Attachment: YARN-3092.1.patch Updated ver.1 patch. Create common resource usage class to track labeled

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290163#comment-14290163 ] Jian He commented on YARN-3011: --- lgtm overall, IIUC, if {{yarn.dispatcher.exit-on-error}} is

[jira] [Commented] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290208#comment-14290208 ] Hadoop QA commented on YARN-3092: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289200#comment-14289200 ] Hadoop QA commented on YARN-3094: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3077) RM should create yarn.resourcemanager.zk-state-store.parent-path recursively

2015-01-23 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290363#comment-14290363 ] Chun Chen commented on YARN-3077: - Thanks for reviewing the patch, [~jianhe]. upload a new

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290384#comment-14290384 ] Hadoop QA commented on YARN-3086: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3077) RM should create yarn.resourcemanager.zk-state-store.parent-path recursively

2015-01-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290232#comment-14290232 ] Jian He commented on YARN-3077: --- [~chenchun], thanks for working on this. The newly added

[jira] [Updated] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3092: - Attachment: YARN-3092.2.patch Thanks review from [~jianhe], updated patch addressed all comments. Create

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-01-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290300#comment-14290300 ] Eric Payne commented on YARN-1963: -- +1 on using numbers and not labels. It seems that the

[jira] [Commented] (YARN-3077) RM should create yarn.resourcemanager.zk-state-store.parent-path recursively

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290406#comment-14290406 ] Hadoop QA commented on YARN-3077: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290420#comment-14290420 ] Anubhav Dhoot commented on YARN-2868: - Adding it to ClusterMetrics will only give you a

[jira] [Commented] (YARN-3077) RM should create yarn.resourcemanager.zk-state-store.parent-path recursively

2015-01-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290235#comment-14290235 ] Jian He commented on YARN-3077: --- doing above, the createRootDirRecursively visibility can be

[jira] [Commented] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290242#comment-14290242 ] Jian He commented on YARN-3092: --- looks good overall. - minor optimization, return the

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290272#comment-14290272 ] Wangda Tan commented on YARN-2868: -- Hmm, I think it may not good enough to put in

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290286#comment-14290286 ] Ray Chiang commented on YARN-2868: -- I had it previously in FSQueueMetrics, then moved it

[jira] [Updated] (YARN-3077) RM should create yarn.resourcemanager.zk-state-store.parent-path recursively

2015-01-23 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3077: Attachment: YARN-3077.2.patch RM should create yarn.resourcemanager.zk-state-store.parent-path recursively

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290250#comment-14290250 ] Hadoop QA commented on YARN-2868: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3088) LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290246#comment-14290246 ] Hadoop QA commented on YARN-3088: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290247#comment-14290247 ] Wangda Tan commented on YARN-3075: -- {code} I had put it inside node.labels != null

[jira] [Commented] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290289#comment-14290289 ] Hadoop QA commented on YARN-3092: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290291#comment-14290291 ] Wangda Tan commented on YARN-2868: -- Just checked code, is it good to put in

[jira] [Commented] (YARN-3022) Expose Container resource information from NodeManager for monitoring

2015-01-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290316#comment-14290316 ] Robert Kanter commented on YARN-3022: - LGTM, just one minor thing: - In

[jira] [Commented] (YARN-3093) Support load command from admin [Helps to load big set of labels]

2015-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290324#comment-14290324 ] Wangda Tan commented on YARN-3093: -- That will be helpful, +1 for the propose too!. I

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-01-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290377#comment-14290377 ] Jun Gong commented on YARN-3094: [~rohithsharma] Thanks for your review. I will add a test

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290411#comment-14290411 ] Rohith commented on YARN-2868: -- I had a thought that metric can be common to all schedulers.

[jira] [Commented] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290371#comment-14290371 ] Hadoop QA commented on YARN-3092: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-01-23 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290395#comment-14290395 ] Chun Chen commented on YARN-3094: - Since RM can't receive ping from AM util

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290415#comment-14290415 ] Varun Saxena commented on YARN-3075: [~leftnoteasy], regarding your comment below.

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288979#comment-14288979 ] Hadoop QA commented on YARN-2800: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289117#comment-14289117 ] Tsuyoshi OZAWA commented on YARN-2800: -- Committing this to trunk and branch-2. Thanks

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289120#comment-14289120 ] Hudson commented on YARN-2800: -- FAILURE: Integrated in Hadoop-trunk-Commit #6917 (See

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-01-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289141#comment-14289141 ] Rohith commented on YARN-3094: -- Thanks [~hex108] for reporting the issue and for your

[jira] [Commented] (YARN-3082) Non thread safe access to systemCredentials in NodeHeartbeatResponse processing

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289109#comment-14289109 ] Hudson commented on YARN-3082: -- FAILURE: Integrated in Hadoop-Yarn-trunk #816 (See

[jira] [Commented] (YARN-3085) Application summary should include the application type

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289119#comment-14289119 ] Hadoop QA commented on YARN-3085: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289123#comment-14289123 ] Varun Saxena commented on YARN-3075: bq. 4) In add(remove/replace)NodeToLabels, such

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289130#comment-14289130 ] Varun Saxena commented on YARN-3075: bq. 2) When op is on a node, as mentioned by

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3011: --- Attachment: YARN-3011.002.patch NM dies because of the failure of resource localization

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290434#comment-14290434 ] Varun Saxena commented on YARN-3011: bq. IIUC, if yarn.dispatcher.exit-on-error is set

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3011: --- Attachment: YARN-3011.002.patch NM dies because of the failure of resource localization

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3011: --- Attachment: (was: YARN-3011.002.patch) NM dies because of the failure of resource localization

[jira] [Commented] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290465#comment-14290465 ] Hadoop QA commented on YARN-3079: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290466#comment-14290466 ] Hadoop QA commented on YARN-3011: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3079: Attachment: YARN-3079.002.patch Scheduler should also update maximumAllocation when updateNodeResource.

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290431#comment-14290431 ] Rohith commented on YARN-2868: -- bq. All clustermetrics that are related to a queue should be

[jira] [Commented] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290444#comment-14290444 ] zhihai xu commented on YARN-3079: - thanks [~leftnoteasy] and [~adhoot]'s review, addressed

[jira] [Updated] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3079: Attachment: YARN-3079.002.patch Scheduler should also update maximumAllocation when updateNodeResource.

[jira] [Updated] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3079: Attachment: (was: YARN-3079.002.patch) Scheduler should also update maximumAllocation when

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290490#comment-14290490 ] Tsuyoshi OZAWA commented on YARN-3086: -- [~rmetzger] Please check whether your tests

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly

2015-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14290493#comment-14290493 ] Yongjun Zhang commented on YARN-3021: - I reran the failed tests locally, The

[jira] [Commented] (YARN-1456) IntelliJ IDEA gets dependencies wrong for hadoop-yarn-server-resourcemanager

2015-01-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289052#comment-14289052 ] Steve Loughran commented on YARN-1456: -- marking as a duplicate of YARN-888; I've not

[jira] [Commented] (YARN-3093) Support load command from admin [Helps to load big set of labels]

2015-01-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289053#comment-14289053 ] Rohith commented on YARN-3093: -- +1 for the propose. This is much useful for very large

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289062#comment-14289062 ] Varun Saxena commented on YARN-3075: [~leftnoteasy], thanks for the review. Kindly find

[jira] [Updated] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-01-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3094: --- Attachment: YARN-3094.patch reset timer for liveness monitors after RM recovery

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289097#comment-14289097 ] Tsuyoshi OZAWA commented on YARN-2800: -- I also confirmed that the test failure of

[jira] [Updated] (YARN-3085) Application summary should include the application type

2015-01-23 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3085: - Attachment: 0001-YARN-3085.patch Application summary should include the application type

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289093#comment-14289093 ] Tsuyoshi OZAWA commented on YARN-2800: -- Thanks for your updating. I rechecked the

[jira] [Commented] (YARN-3081) Potential indefinite wait in ContainerManagementProtocolProxy#addProxyToCache()

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289103#comment-14289103 ] Tsuyoshi OZAWA commented on YARN-3081: -- [~ted_yu], Thanks for the reporting. I checked

[jira] [Commented] (YARN-3082) Non thread safe access to systemCredentials in NodeHeartbeatResponse processing

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289073#comment-14289073 ] Hudson commented on YARN-3082: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #82 (See

[jira] [Created] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-01-23 Thread Jun Gong (JIRA)
Jun Gong created YARN-3094: -- Summary: reset timer for liveness monitors after RM recovery Key: YARN-3094 URL: https://issues.apache.org/jira/browse/YARN-3094 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-914) Support graceful decommission of nodemanager

2015-01-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289286#comment-14289286 ] Jason Lowe commented on YARN-914: - bq. The first step I was thinking to keep NM running in a

[jira] [Updated] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated YARN-3086: - Attachment: YARN-3086.patch Wow .. This is a special moment. The first patch I'm submitting to

[jira] [Commented] (YARN-3082) Non thread safe access to systemCredentials in NodeHeartbeatResponse processing

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289281#comment-14289281 ] Hudson commented on YARN-3082: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #79 (See

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289349#comment-14289349 ] Tsuyoshi OZAWA commented on YARN-3086: -- {code} I'm was not able to run any the tests

[jira] [Updated] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly

2015-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated YARN-3021: Attachment: YARN-3021.001.patch YARN's delegation-token handling disallows certain trust setups to

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289356#comment-14289356 ] Tsuyoshi OZAWA commented on YARN-3086: -- {quote}

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289355#comment-14289355 ] Tsuyoshi OZAWA commented on YARN-3086: -- {code}

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289360#comment-14289360 ] Robert Metzger commented on YARN-3086: -- Thank you for all the help! I've updated the

[jira] [Commented] (YARN-3086) Make NodeManager memory configurable in MiniYARNCluster

2015-01-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289338#comment-14289338 ] Tsuyoshi OZAWA commented on YARN-3086: -- [~rmetzger] Great! At first, I'd like to

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289363#comment-14289363 ] Varun Saxena commented on YARN-3011: Someone, kindly review this one NM dies because

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289381#comment-14289381 ] Hudson commented on YARN-2800: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2033 (See

[jira] [Commented] (YARN-3082) Non thread safe access to systemCredentials in NodeHeartbeatResponse processing

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289379#comment-14289379 ] Hudson commented on YARN-3082: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2033 (See

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289432#comment-14289432 ] Sunil G commented on YARN-3075: --- Hi Varun {code} + removeNodeFromLabels(nodeId,

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly

2015-01-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289439#comment-14289439 ] Yongjun Zhang commented on YARN-3021: - Hi [~qwertymaniac], [~vinodkv], [~adhoot],

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289435#comment-14289435 ] Varun Saxena commented on YARN-3075: bq. I think first call to removeNodeFromLabels can

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289465#comment-14289465 ] Sunil G commented on YARN-3075: --- Thank you [~varun_saxena] for clarifying. So as we

[jira] [Commented] (YARN-3082) Non thread safe access to systemCredentials in NodeHeartbeatResponse processing

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289344#comment-14289344 ] Hudson commented on YARN-3082: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #83 (See

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289346#comment-14289346 ] Hudson commented on YARN-2800: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #83 (See

[jira] [Commented] (YARN-3082) Non thread safe access to systemCredentials in NodeHeartbeatResponse processing

2015-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289187#comment-14289187 ] Hudson commented on YARN-3082: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2014 (See

  1   2   >