[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499002#comment-14499002 ] Li Lu commented on YARN-3431: - Hi [~zjshen], thanks for the work! I reviewed your v3 patch. A

[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed

2015-04-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499183#comment-14499183 ] Naganarasimha G R commented on YARN-3500: - I think by mistake submitter raised the

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499160#comment-14499160 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-trunk-Commit #7602 (See [https:

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498992#comment-14498992 ] Wangda Tan commented on YARN-2003: -- Some comments: 1) Don't need to change Leaf/ParentQueu

[jira] [Commented] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499058#comment-14499058 ] Hadoop QA commented on YARN-2605: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499101#comment-14499101 ] Xuan Gong commented on YARN-1402: - bq. Also, there is one important thing we need to think

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499171#comment-14499171 ] Hadoop QA commented on YARN-1402: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3493) RM fails to come up with error "Failed to load/recover state" when mem settings are changed

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499142#comment-14499142 ] Jian He commented on YARN-3493: --- bq. This causes throw InvalidResourceRequestException to AM

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498928#comment-14498928 ] Zhijie Shen commented on YARN-3051: --- Thanks for summarize the proposal, Sangjin! Just thi

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-16 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499137#comment-14499137 ] Inigo Goiri commented on YARN-3481: --- I could cover the first one (creating a ResourceUtil

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499099#comment-14499099 ] Hadoop QA commented on YARN-2740: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499028#comment-14499028 ] Wangda Tan commented on YARN-2004: -- Some comments: 1) I noticed default of default-priorit

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499009#comment-14499009 ] Wangda Tan commented on YARN-2003: -- Another comment is about authenticateApplicationPriori

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499037#comment-14499037 ] Carlo Curino commented on YARN-3481: Creating a new ResourceUtilization class, I think

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499039#comment-14499039 ] Li Lu commented on YARN-3390: - I skimmed through both patches. The two patches got significant

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499000#comment-14499000 ] Junping Du commented on YARN-1402: -- Thanks [~xgong] for updating the patch! bq. No need to

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-16 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498951#comment-14498951 ] Rohith commented on YARN-3476: -- Thanks [~sunilg] for sharing your thoughts. Going for retentio

[jira] [Commented] (YARN-3493) RM fails to come up with error "Failed to load/recover state" when mem settings are changed

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499200#comment-14499200 ] Hadoop QA commented on YARN-3493: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498986#comment-14498986 ] Wangda Tan commented on YARN-1963: -- Agree that we need to make basic functionality works,

[jira] [Created] (YARN-3500) Optimize ResourceManager Web loading speed

2015-04-16 Thread Peter Shi (JIRA)
Peter Shi created YARN-3500: --- Summary: Optimize ResourceManager Web loading speed Key: YARN-3500 URL: https://issues.apache.org/jira/browse/YARN-3500 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499033#comment-14499033 ] Wangda Tan commented on YARN-2740: -- Thanks for your quick update [~Naganarasimha]. bq. Ac

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498946#comment-14498946 ] Hadoop QA commented on YARN-1402: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.4.patch > Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Assigned] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-2605: --- Assignee: Xuan Gong (was: Anubhav Dhoot) > [RM HA] Rest api endpoints doing redirect incorrectly > --

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499197#comment-14499197 ] Xuan Gong commented on YARN-1402: - testcase failure is not related > Related Web UI, CLI c

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499087#comment-14499087 ] Robert Kanter commented on YARN-3046: - LGTM +1 But let's wait on any additional comment

[jira] [Updated] (YARN-3500) Optimize ResourceManager Web loading speed

2015-04-16 Thread Peter Shi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Shi updated YARN-3500: Description: after running 10k jobs, resoucemanager webui load speed become slow. As server side send 10k jo

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499045#comment-14499045 ] Wangda Tan commented on YARN-3410: -- Patch generally looks good, but I suggest to improve t

[jira] [Updated] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2696: - Attachment: YARN-2696.4.patch bq. could we add a validation for clusterResource/queueCapacity updates when

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2740: Attachment: YARN-2740.20150417-1.patch updated the patch [~wangda]'s review comments > Resou

[jira] [Updated] (YARN-3493) RM fails to come up with error "Failed to load/recover state" when mem settings are changed

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3493: -- Attachment: YARN-3493.3.patch > RM fails to come up with error "Failed to load/recover state" when mem > settin

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499069#comment-14499069 ] Hadoop QA commented on YARN-2696: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14499038#comment-14499038 ] Wangda Tan commented on YARN-3487: -- [~sunilg], Sorry I didn't get what you meant, could yo

[jira] [Updated] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2605: Attachment: YARN-2605.1.patch > [RM HA] Rest api endpoints doing redirect incorrectly > -

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498924#comment-14498924 ] Junping Du commented on YARN-3134: -- Thanks [~gtCarrera9] for delivering a patch here! Jus

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

2015-04-16 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498926#comment-14498926 ] Inigo Goiri commented on YARN-3482: --- After some testing, I figured that it might be bette

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498773#comment-14498773 ] Yongjun Zhang commented on YARN-3021: - Thanks a lot [~jianhe]! > YARN's delegation-to

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.3.2.patch > Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-16 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498760#comment-14498760 ] Inigo Goiri commented on YARN-3481: --- I started implementing this and I hit a philosophica

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.3.1.patch > Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Commented] (YARN-3493) RM fails to come up with error "Failed to load/recover state" when mem settings are changed

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498754#comment-14498754 ] Hadoop QA commented on YARN-3493: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498752#comment-14498752 ] Xuan Gong commented on YARN-1402: - bq. if only one container (other containers haven't repo

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.3.patch > Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498692#comment-14498692 ] Hadoop QA commented on YARN-3366: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498674#comment-14498674 ] Jian He commented on YARN-3021: --- [~yzhangal], I think the failure is not related. Patch look

[jira] [Updated] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3494: -- Issue Type: Improvement (was: Bug) > Expose AM resource limit and user limit in QueueMetrics >

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498662#comment-14498662 ] Jian He commented on YARN-3494: --- I think AM resource usage and limit can be in the QueueMetri

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498661#comment-14498661 ] Hadoop QA commented on YARN-3463: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498603#comment-14498603 ] Wangda Tan commented on YARN-3463: -- bq. No, applications still start as they did before, n

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-16 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498601#comment-14498601 ] Sidharta Seethana commented on YARN-3366: - All the -1s are not valid for this patch

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498565#comment-14498565 ] Yongjun Zhang commented on YARN-3021: - I don't see {code} java.lang.AssertionError: Ap

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498528#comment-14498528 ] Naganarasimha G R commented on YARN-2740: - Thanks for the review [~wangda], bq. Sho

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498524#comment-14498524 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.67.patch rm unneeded capached change > Integrate OrderingPolicy Framework with Cap

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498510#comment-14498510 ] Hadoop QA commented on YARN-3366: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498502#comment-14498502 ] Jian He commented on YARN-2696: --- could we add a validation for clusterResource/queueCapacity

[jira] [Commented] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2015-04-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498493#comment-14498493 ] Hitesh Shah commented on YARN-2976: --- Agreed. The newer one would take precedence. > Inva

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498492#comment-14498492 ] Craig Welch commented on YARN-3463: --- bq. should we make pendingApplications to use custom

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498488#comment-14498488 ] Yongjun Zhang commented on YARN-3021: - The test failure is likely YARN-2483. > YARN's

[jira] [Commented] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498486#comment-14498486 ] Hadoop QA commented on YARN-3497: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2015-04-16 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498487#comment-14498487 ] Vijay Bhat commented on YARN-2976: -- [~hitesh], yes that makes sense. I can call the new co

[jira] [Commented] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498480#comment-14498480 ] Hadoop QA commented on YARN-3448: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2015-04-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498470#comment-14498470 ] Hitesh Shah commented on YARN-2976: --- Typo: meant to say that it *does" clash with the cur

[jira] [Commented] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2015-04-16 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498466#comment-14498466 ] Hitesh Shah commented on YARN-2976: --- The latter definitely makes more sense but it does n

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498416#comment-14498416 ] Hadoop QA commented on YARN-3021: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

2015-04-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3497: - Attachment: YARN-3497.001.patch This causes the Tez AM to reconnect to the RM on every AM heartbeat. Patch

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Attachment: YARN-3448.10.patch > Add Rolling Time To Lives Level DB Plugin Capabilities > ---

[jira] [Commented] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2015-04-16 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498389#comment-14498389 ] Vijay Bhat commented on YARN-2976: -- [~hitesh], I can take this on. Would your preference b

[jira] [Created] (YARN-3498) Improve Timeline Server Memory Usage

2015-04-16 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created YARN-3498: - Summary: Improve Timeline Server Memory Usage Key: YARN-3498 URL: https://issues.apache.org/jira/browse/YARN-3498 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498387#comment-14498387 ] Sunil G commented on YARN-3476: --- HI [~jlowe] and [~rohithsharma] A retention logic to handle

[jira] [Assigned] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

2015-04-16 Thread Vijay Bhat (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Bhat reassigned YARN-2976: Assignee: Vijay Bhat > Invalid docs for specifying > yarn.nodemanager.docker-container-executor.exe

[jira] [Created] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

2015-04-16 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-3497: Summary: ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy Key: YARN-3497 URL: https://issues.apache.org/jira/browse/YARN-3497 Project: Hadoop

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498372#comment-14498372 ] Wangda Tan commented on YARN-2740: -- 1. CommonNodeLabelsManager: 1.1) {{@VisibleForTesting}

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-16 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498366#comment-14498366 ] Vrushali C commented on YARN-3411: -- Thanks [~djp] ! bq. Just quickly go through the poc p

[jira] [Updated] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-16 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3366: Attachment: YARN-3366.006.patch hi [~djp] , Uploading a new patch based on your feedback. T

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-04-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: 00011-YARN-3136.patch Thank you [~jianhe] I have added the check in exclude file. Will kick in jenkin

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

2015-04-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498324#comment-14498324 ] Sunil G commented on YARN-3487: --- Hi [~leftnoteasy] and [~jlowe] During reloading CS config, i

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498326#comment-14498326 ] Wangda Tan commented on YARN-3463: -- Some comments: LeafQueue: - activeApplications now be

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498321#comment-14498321 ] Zhijie Shen commented on YARN-3431: --- bq. There is always exception get thrown here. We sh

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-04-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498322#comment-14498322 ] Jian He commented on YARN-3136: --- Hi [~sunilg], for that I think we can add these two in the

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-04-16 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498312#comment-14498312 ] zhihai xu commented on YARN-3491: - Yes, I agree Storing asynchronously is going to be a bit

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498306#comment-14498306 ] Sunil G commented on YARN-3494: --- Could we define the metric in QueueMetrics, but the setter f

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498278#comment-14498278 ] Junping Du commented on YARN-3411: -- Just quickly go through the poc patch which is good bu

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-16 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498275#comment-14498275 ] Sidharta Seethana commented on YARN-3366: - hi [~djp] , Thanks for review. Response

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498253#comment-14498253 ] Yongjun Zhang commented on YARN-3021: - HI [~jianhe], Thanks for looking at it again an

[jira] [Updated] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated YARN-3021: Attachment: YARN-3021.007.patch > YARN's delegation-token handling disallows certain trust setups to

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498183#comment-14498183 ] Hudson commented on YARN-3326: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See [htt

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498178#comment-14498178 ] Hudson commented on YARN-3354: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See [htt

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498179#comment-14498179 ] Hudson commented on YARN-3404: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See [htt

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498180#comment-14498180 ] Hudson commented on YARN-3318: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See [htt

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498169#comment-14498169 ] Junping Du commented on YARN-3431: -- Thanks [~zjshen] for delivering a updated patch to fix

[jira] [Commented] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498146#comment-14498146 ] Hadoop QA commented on YARN-3448: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498125#comment-14498125 ] Hudson commented on YARN-3354: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498129#comment-14498129 ] Hudson commented on YARN-3326: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498126#comment-14498126 ] Hudson commented on YARN-3404: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498127#comment-14498127 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498100#comment-14498100 ] Junping Du commented on YARN-3366: -- Thanks [~sidharta-s] for delivering the patch! A few c

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-04-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498092#comment-14498092 ] Jason Lowe commented on YARN-3491: -- Storing asynchronously is going to be a bit dangerous

[jira] [Commented] (YARN-3496) Add a configuration to disable/enable storing localization state in NMLeveldbStateStore

2015-04-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498088#comment-14498088 ] Jason Lowe commented on YARN-3496: -- How are we going to support recovery of containers wit

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Attachment: YARN-3448.9.patch > Add Rolling Time To Lives Level DB Plugin Capabilities >

  1   2   >