[jira] [Updated] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-30 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2893: Attachment: YARN-2893.005.patch AMLaucher: sporadic job failures due to EOFException in

[jira] [Updated] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3561: - Fix Version/s: (was: 2.6.1) Non-AM Containers continue to run even after AM is stopped

[jira] [Commented] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521200#comment-14521200 ] Steve Loughran commented on YARN-3561: -- Vinod probably means the AM restart flag.

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-30 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520961#comment-14520961 ] zhihai xu commented on YARN-2893: - thanks [~jira.shegalov], that is a good catch. I

[jira] [Updated] (YARN-3552) RM Web UI shows -1 running containers for completed apps

2015-04-30 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3552: - Attachment: 0001-YARN-3552.patch RM Web UI shows -1 running containers for completed apps

[jira] [Commented] (YARN-3552) RM Web UI shows -1 running containers for completed apps

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521027#comment-14521027 ] Hadoop QA commented on YARN-3552: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520957#comment-14520957 ] Hadoop QA commented on YARN-3271: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3552) RM Web UI shows -1 running containers for completed apps

2015-04-30 Thread Ryu Kobayashi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520954#comment-14520954 ] Ryu Kobayashi commented on YARN-3552: - I think this problem exists even FairScheduler.

[jira] [Updated] (YARN-3557) Support Intel Trusted Execution Technology(TXT) in YARN scheduler

2015-04-30 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated YARN-3557: -- Attachment: Support TXT in YARN high level design doc.pdf A high level design doc attached. Support Intel

[jira] [Commented] (YARN-3552) RM Web UI shows -1 running containers for completed apps

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521161#comment-14521161 ] Hadoop QA commented on YARN-3552: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3552) RM Web UI shows -1 running containers for completed apps

2015-04-30 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521001#comment-14521001 ] Rohith commented on YARN-3552: -- My bad, missed it. Thanks for pointing out, will update patch

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521095#comment-14521095 ] Hadoop QA commented on YARN-2893: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521217#comment-14521217 ] Steve Loughran commented on YARN-3539: -- works for me Compatibility doc to state that

[jira] [Updated] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-30 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3476: - Attachment: 0001-YARN-3476.patch Apologies for looking back to issue delayed. bq. Would it be better to wrap the

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-30 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521261#comment-14521261 ] Varun Vasudev commented on YARN-3534: - Thanks for the path [~elgoiri]! Is it possible

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521406#comment-14521406 ] Hudson commented on YARN-3517: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #170 (See

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521403#comment-14521403 ] Hudson commented on YARN-3533: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #170 (See

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521449#comment-14521449 ] Hudson commented on YARN-3533: -- FAILURE: Integrated in Hadoop-Yarn-trunk #913 (See

[jira] [Commented] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521465#comment-14521465 ] Hadoop QA commented on YARN-3271: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521471#comment-14521471 ] Hadoop QA commented on YARN-3476: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521393#comment-14521393 ] Hudson commented on YARN-3533: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #179 (See

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521396#comment-14521396 ] Hudson commented on YARN-3517: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #179 (See

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521475#comment-14521475 ] Junping Du commented on YARN-1402: -- Forget to mention, after this patch,

[jira] [Commented] (YARN-3533) Test: Fix launchAM in MockRM to wait for attempt to be scheduled

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521383#comment-14521383 ] Hudson commented on YARN-3533: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2111 (See

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521386#comment-14521386 ] Hudson commented on YARN-3517: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2111 (See

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521452#comment-14521452 ] Hudson commented on YARN-3517: -- FAILURE: Integrated in Hadoop-Yarn-trunk #913 (See

[jira] [Updated] (YARN-3271) FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability

2015-04-30 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel updated YARN-3271: Attachment: YARN-3271.3.patch Updated patch for whitespace fix and test fix FairScheduler: Move tests related to

[jira] [Commented] (YARN-3559) Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public

2015-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521226#comment-14521226 ] Steve Loughran commented on YARN-3559: -- I've not touched it -it is one line. What it

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521578#comment-14521578 ] Junping Du commented on YARN-3445: -- Thanks for comments, [~vinodkv]! bq.

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521580#comment-14521580 ] Thomas Graves commented on YARN-3243: - [~leftnoteasy] Can we pull this back into the

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521924#comment-14521924 ] Karthik Kambatla commented on YARN-3534: bq. I'm not sure if we should use RPC to

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522021#comment-14522021 ] Thomas Graves commented on YARN-3243: - I was wanting to pull YARN-3434 back into 2.7.

[jira] [Commented] (YARN-3473) Fix RM Web UI configuration for some properties

2015-04-30 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521845#comment-14521845 ] Ray Chiang commented on YARN-3473: -- RE: No new unit tests Passed visual inspection on the

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522014#comment-14522014 ] Wangda Tan commented on YARN-3243: -- Thanks comment from [~vinodkv]. I would +1 for back

[jira] [Commented] (YARN-3564) Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521973#comment-14521973 ] Hudson commented on YARN-3564: -- FAILURE: Integrated in Hadoop-trunk-Commit #7706 (See

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2015-04-30 Thread Viplav Madasu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522001#comment-14522001 ] Viplav Madasu commented on YARN-2497: - I have same comment as [~john.jian.fang].

[jira] [Commented] (YARN-3557) Support Intel Trusted Execution Technology(TXT) in YARN scheduler

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521999#comment-14521999 ] Wangda Tan commented on YARN-3557: -- Hi [~dian.fu], Thanks for posting design doc, I just

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521802#comment-14521802 ] Hadoop QA commented on YARN-3544: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-30 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521881#comment-14521881 ] Sidharta Seethana commented on YARN-3366: - hi [~hex108] , The goal here is to

[jira] [Updated] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3539: - Attachment: YARN-3539-005.patch patch -005 h3. Valid entity types. Currently / and are

[jira] [Commented] (YARN-3565) NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521888#comment-14521888 ] Wangda Tan commented on YARN-3565: -- [~Naganarasimha], sure, please go ahead.

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521893#comment-14521893 ] Jian He commented on YARN-3445: --- One other thing, the LogAggregationReport#(get/set)getNodeId

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521896#comment-14521896 ] Hadoop QA commented on YARN-3539: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-04-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521926#comment-14521926 ] Karthik Kambatla commented on YARN-3332: [~vinodkv] - did you start implementing

[jira] [Updated] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-04-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3521: -- Attachment: 0002-YARN-3521.patch Thank you [~leftnoteasy] for sharing the comments. Pls find an updated patch

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521936#comment-14521936 ] Karthik Kambatla commented on YARN-3481: I have been working with [~rgrandl] on

[jira] [Updated] (YARN-3564) Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3564: - Summary: Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly (was:

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522008#comment-14522008 ] Vinod Kumar Vavilapalli commented on YARN-3243: --- bq. Wangda Tan Can we pull

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522058#comment-14522058 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- bq. I agree. This shouldn't

[jira] [Commented] (YARN-3505) Node's Log Aggregation Report with SUCCEED should not cached in RMApps

2015-04-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1451#comment-1451 ] Jian He commented on YARN-3505: --- One other thing, the LogAggregationReport#(get/set)getNodeId

[jira] [Updated] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Summary: Collect node resource utilization (was: Report node resource utilization) Collect node

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522044#comment-14522044 ] Wangda Tan commented on YARN-3243: -- [~tgraves], I think YARN-3434 needs YARN-3361, it

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-30 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522068#comment-14522068 ] Inigo Goiri commented on YARN-3534: --- It looks like there's a consensus on splitting on

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522150#comment-14522150 ] Zhijie Shen commented on YARN-3544: --- Verified 2.7 branch patch. It works fine too. Will

[jira] [Commented] (YARN-3544) AM logs link missing in the RM UI for a completed app

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522170#comment-14522170 ] Hudson commented on YARN-3544: -- FAILURE: Integrated in Hadoop-trunk-Commit #7707 (See

[jira] [Created] (YARN-3566) YARN Scheduler Web UI not properly sorting through Application ID or Progress bar

2015-04-30 Thread Anthony Rojas (JIRA)
Anthony Rojas created YARN-3566: --- Summary: YARN Scheduler Web UI not properly sorting through Application ID or Progress bar Key: YARN-3566 URL: https://issues.apache.org/jira/browse/YARN-3566 Project:

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522066#comment-14522066 ] Thomas Graves commented on YARN-3243: - It might to merge completely clean but it

[jira] [Comment Edited] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522066#comment-14522066 ] Thomas Graves edited comment on YARN-3243 at 4/30/15 7:02 PM: --

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522241#comment-14522241 ] Wangda Tan commented on YARN-3243: -- [~tgraves], I just merged this to branch-2.7.

[jira] [Updated] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3539: - Attachment: YARN-3539-006.patch Patch -006 also uprates all of the data structures and

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522083#comment-14522083 ] Hadoop QA commented on YARN-3539: - (!) The patch artifact directory on has been removed!

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-04-30 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522133#comment-14522133 ] Craig Welch commented on YARN-1680: --- Hi [~airbots], any luck on this? Do you mind if I

[jira] [Updated] (YARN-3566) YARN Scheduler Web UI not properly sorting through Application ID or Progress bar

2015-04-30 Thread Anthony Rojas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anthony Rojas updated YARN-3566: Attachment: Screen Shot 2015-04-30 at 1.23.56 PM.png YARN Scheduler Web UI not properly sorting

[jira] [Updated] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-4.patch Isolating the changes for the NodeResourceMonitorImpl. The aggregationg of

[jira] [Commented] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-04-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522180#comment-14522180 ] Wangda Tan commented on YARN-3521: -- [~sunilg], Thanks for updating, just tried it locally,

[jira] [Commented] (YARN-3546) AbstractYarnScheduler.getApplicationAttempt seems misleading, and there're some misuse of it

2015-04-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522271#comment-14522271 ] Jian He commented on YARN-3546: --- bq. Let's consider below situation, Hi [~sandflee], it's a

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522060#comment-14522060 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- bq. Jian He, can you file a

[jira] [Commented] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522141#comment-14522141 ] Hadoop QA commented on YARN-3521: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-04-30 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522144#comment-14522144 ] Chen He commented on YARN-1680: --- Sure, I just assigned back to you. I may not have free cycle

[jira] [Updated] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-04-30 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-1680: -- Assignee: Craig Welch (was: Chen He) availableResources sent to applicationMaster in heartbeat should exclude

[jira] [Updated] (YARN-2369) Environment variable handling assumes values should be appended

2015-04-30 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated YARN-2369: -- Attachment: YARN-2369-2.patch New patch has a configurable whitelist for variables with append enabled

[jira] [Commented] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522744#comment-14522744 ] Zhijie Shen commented on YARN-3551: --- Created a new patch to change timeline metric APIs

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522766#comment-14522766 ] Vinod Kumar Vavilapalli commented on YARN-3481: --- bq. Vinod Kumar Vavilapalli,

[jira] [Resolved] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-3481. --- Resolution: Duplicate Report NM aggregated container resource utilization in

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522774#comment-14522774 ] Vinod Kumar Vavilapalli commented on YARN-3332: --- Unfortunately, other pieces

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522790#comment-14522790 ] Vinod Kumar Vavilapalli commented on YARN-3044: --- Apologies for dropping off

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522754#comment-14522754 ] Vinod Kumar Vavilapalli commented on YARN-2619: --- Looks good to me too, +1.

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522779#comment-14522779 ] Vinod Kumar Vavilapalli commented on YARN-2942: --- That will definitely

[jira] [Commented] (YARN-2123) Progress bars in Web UI always at 100% due to non-US locale

2015-04-30 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522781#comment-14522781 ] Tsuyoshi Ozawa commented on YARN-2123: -- [~ajisakaa] maybe did you forget attaching the

[jira] [Updated] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3551: -- Attachment: YARN-3551-YARN-2928.4.patch Consolidate data model change according to the backend

[jira] [Commented] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522784#comment-14522784 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3551) Consolidate data model change according to the backend implementation

2015-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522785#comment-14522785 ] Sangjin Lee commented on YARN-3551: --- The latest patch looks good. Thanks for addressing

[jira] [Updated] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3534: -- Issue Type: Sub-task (was: New Feature) Parent: YARN-1011 Collect node

[jira] [Commented] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522768#comment-14522768 ] Vinod Kumar Vavilapalli commented on YARN-3534: --- Converting this to be a

[jira] [Updated] (YARN-1012) NM should report resource utilization of running containers to RM in heartbeat

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1012: -- Assignee: Inigo Goiri (was: Vinod Kumar Vavilapalli) YARN-3481 is closed as dup

[jira] [Commented] (YARN-2369) Environment variable handling assumes values should be appended

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522325#comment-14522325 ] Hadoop QA commented on YARN-2369: - (!) The patch artifact directory on has been removed!

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522418#comment-14522418 ] Zhijie Shen commented on YARN-3539: --- We perhaps need to mark generic history APIs related

[jira] [Commented] (YARN-3546) AbstractYarnScheduler.getApplicationAttempt seems misleading, and there're some misuse of it

2015-04-30 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522456#comment-14522456 ] sandflee commented on YARN-3546: ok, close it now, thanks [~jianhe]

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522569#comment-14522569 ] Sangjin Lee commented on YARN-3411: --- +1 on 1.0.1. [Storage implementation] explore the

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522556#comment-14522556 ] Li Lu commented on YARN-3411: - Awesome, thanks! [Storage implementation] explore the native

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1462: Attachment: YARN-1462-branch-2.7-1.patch AHS API and other AHS changes to handle tags for completed MR jobs

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1462: Attachment: YARN-1462.2.patch AHS API and other AHS changes to handle tags for completed MR jobs

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522678#comment-14522678 ] Hadoop QA commented on YARN-3134: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522724#comment-14522724 ] Hadoop QA commented on YARN-3534: - (!) A patch to test-patch or smart-apply-patch has been

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-30 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522737#comment-14522737 ] zhihai xu commented on YARN-2893: - TestContainerAllocation failure is not related to my

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-30 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522639#comment-14522639 ] Jun Gong commented on YARN-3366: [~sidharta-s] Thank you for the explanation. Could we set

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522672#comment-14522672 ] Xuan Gong commented on YARN-1462: - Address all the latest comments. And created a patch for

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522730#comment-14522730 ] Hadoop QA commented on YARN-1462: - (!) The patch artifact directory has been removed! This

[jira] [Updated] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3411: - Attachment: YARN-3411.poc.4.txt Hi [~gtCarrera9] Yes, sure we can use hbase 1.0.1. Attaching an updated

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522642#comment-14522642 ] Robert Kanter commented on YARN-2942: - Thanks for pointing me to YARN-1376 and related.

  1   2   >