[jira] [Updated] (YARN-3764) CapacityScheduler forbid of moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3764: - Description: Currently CapacityScheduler doesn't handle the case well, for example: A queue structure:

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571500#comment-14571500 ] Sunil G commented on YARN-3751: --- Thank you [~zjshen] for committing the patch!

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571607#comment-14571607 ] Vrushali C commented on YARN-3411: -- After evaluating both approaches of backend storage

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571606#comment-14571606 ] Vrushali C commented on YARN-3134: -- After evaluating both approaches of backend storage

[jira] [Updated] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

[ https://issues.apache.org/jira/browse/YARN-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3765: Description: There is one warning about reversing the return value of comparisons in YARN-2928 branch. This is a

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571480#comment-14571480 ] Hadoop QA commented on YARN-3453: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3044: Attachment: YARN-3044-YARN-2928.010.patch Hi [~zjshen], Please find the attached rebased

[jira] [Commented] (YARN-3276) Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warnings

[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571610#comment-14571610 ] Li Lu commented on YARN-3276: - The -1 appears to be irrelevant to the fix in this patch. I can

[jira] [Updated] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

[ https://issues.apache.org/jira/browse/YARN-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3765: Attachment: YARN-3765-YARN-2928.001.patch I looked into the warning message, and now I believe it's not a false

[jira] [Updated] (YARN-3276) Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warnings

[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3276: -- Attachment: YARN-3276-YARN-2928.v6.patch +1 for the last patch. Rebase it against the latest branch.

[jira] [Updated] (YARN-2928) YARN Timeline Service: Next generation

[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-2928: - Attachment: TimelineServiceStoragePerformanceTestSummaryYARN-2928.pdf We decided to evaluate two

[jira] [Created] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

Li Lu created YARN-3765: --- Summary: Fix findbugs the warning in YARN-2928 branch, TimelineMetric Key: YARN-3765 URL: https://issues.apache.org/jira/browse/YARN-3765 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571503#comment-14571503 ] Hudson commented on YARN-3751: -- FAILURE: Integrated in Hadoop-trunk-Commit #7952 (See

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571502#comment-14571502 ] Karthik Kambatla commented on YARN-3762: Thanks for the review, Arun. Good points.

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571623#comment-14571623 ] Zhijie Shen commented on YARN-1942: --- It seems that we have more than ConverterUtils that

[jira] [Updated] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3764: - Attachment: YARN-3764.1.patch Attached initial patch for review. CapacityScheduler should forbid moving

[jira] [Commented] (YARN-3764) CapacityScheduler should properly handle moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571479#comment-14571479 ] Vinod Kumar Vavilapalli commented on YARN-3764: --- bq. A short term fix is

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571486#comment-14571486 ] Wangda Tan commented on YARN-3764: -- [~vinodkv], agree. Update the title/desc and will

[jira] [Updated] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3764: - Summary: CapacityScheduler should forbid moving LeafQueue from one parent to another (was:

[jira] [Commented] (YARN-3276) Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warnings

[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571590#comment-14571590 ] Hadoop QA commented on YARN-3276: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571611#comment-14571611 ] Hadoop QA commented on YARN-3762: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Reopened] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-1462: --- Per discussion offline with Sid, my proposal is: 1.Revert the current commit, create and commit a new

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571618#comment-14571618 ] Karthik Kambatla commented on YARN-3762: Thanks Arun. Checking this in.

[jira] [Updated] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3762: --- Attachment: yarn-3762-2.patch Updated the patch to add more comments. FairScheduler: CME on

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571626#comment-14571626 ] Hudson commented on YARN-3762: -- FAILURE: Integrated in Hadoop-trunk-Commit #7955 (See

[jira] [Updated] (YARN-3764) CapacityScheduler forbid of moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3764: - Summary: CapacityScheduler forbid of moving LeafQueue from one parent to another (was: CapacityScheduler

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571512#comment-14571512 ] Arun Suresh commented on YARN-3762: --- Makes sense +1, LGTM FairScheduler: CME on

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571614#comment-14571614 ] Hadoop QA commented on YARN-3749: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571481#comment-14571481 ] Zhijie Shen commented on YARN-3751: --- +1 LGTM No more test case is required, while the

[jira] [Commented] (YARN-3764) CapacityScheduler should properly handle moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571477#comment-14571477 ] Wangda Tan commented on YARN-3764: -- Following test case can verify this issue: {code}

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571633#comment-14571633 ] Xuan Gong commented on YARN-1462: - I am ok with this plan. bq. 1.Revert the current commit,

[jira] [Commented] (YARN-19) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/YARN-19?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571632#comment-14571632 ] Abin Shahab commented on YARN-19: - Hi [~jdu] Can this be merged in 2.8? We at Altiscale are

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571542#comment-14571542 ] Hudson commented on YARN-3585: -- FAILURE: Integrated in Hadoop-trunk-Commit #7953 (See

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571575#comment-14571575 ] Wangda Tan commented on YARN-3510: -- [~sunilg], bq. and in general if the new approach

[jira] [Commented] (YARN-3655) FairScheduler: potential livelock due to maxAMShare limitation and container reservation

[ https://issues.apache.org/jira/browse/YARN-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571593#comment-14571593 ] Karthik Kambatla commented on YARN-3655: bq. IMHO, It is not good to add if

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571732#comment-14571732 ] Zhijie Shen commented on YARN-3044: --- [~Naganarasimha], thanks for updating the patch. It

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571761#comment-14571761 ] Sergey Shelukhin commented on YARN-1942: No, it's used in production code as far as

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571667#comment-14571667 ] Karthik Kambatla commented on YARN-3453: Should we add

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571668#comment-14571668 ] Vinod Kumar Vavilapalli commented on YARN-1942: --- bq. It seems that we have

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571669#comment-14571669 ] Zhijie Shen commented on YARN-1462: --- Reverted. AHS API and other AHS changes to handle

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571765#comment-14571765 ] Li Lu commented on YARN-2928: - Thanks [~sjlee0], [~jrottinghuis], and [~vrushalic] for hosting

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1462: Attachment: YARN-1462.4.patch AHS API and other AHS changes to handle tags for completed MR jobs

[jira] [Updated] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3766: Attachment: YARN-3766.1.patch Create a patch to fix it. No testcases needed ATS Web UI breaks because of

[jira] [Commented] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571859#comment-14571859 ] Hadoop QA commented on YARN-3453: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571676#comment-14571676 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-trunk-Commit #7956 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571797#comment-14571797 ] Hadoop QA commented on YARN-3764: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571867#comment-14571867 ] Hadoop QA commented on YARN-3766: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571896#comment-14571896 ] Hudson commented on YARN-3749: -- FAILURE: Integrated in Hadoop-trunk-Commit #7958 (See

[jira] [Commented] (YARN-3764) CapacityScheduler should forbid moving LeafQueue from one parent to another

[ https://issues.apache.org/jira/browse/YARN-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571872#comment-14571872 ] Jian He commented on YARN-3764: --- looks good, +1 CapacityScheduler should forbid moving

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571886#comment-14571886 ] Xuan Gong commented on YARN-3749: - Committed into trunk/branch-2. Thanks, Chun Chen. And

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571821#comment-14571821 ] Srikanth Kandula commented on YARN-3366: 1) Does this also capture the network

[jira] [Commented] (YARN-2513) Host framework UIs in YARN for use with the ATS

[ https://issues.apache.org/jira/browse/YARN-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571822#comment-14571822 ] Hitesh Shah commented on YARN-2513: --- +1 to making this available for ATS v1. Would be

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571685#comment-14571685 ] Hadoop QA commented on YARN-3044: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

[ https://issues.apache.org/jira/browse/YARN-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571709#comment-14571709 ] Hadoop QA commented on YARN-3765: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3453: -- Attachment: YARN-3453.2.patch Agreed.. Updating patch with your suggestion.. Fair Scheduler : Parts

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571755#comment-14571755 ] Zhijie Shen commented on YARN-1942: --- [~sershe], would you please comment? Many of

[jira] [Updated] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3766: Priority: Blocker (was: Major) ATS Web UI breaks because of YARN-3467

[jira] [Updated] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3766: Affects Version/s: 2.8.0 ATS Web UI breaks because of YARN-3467 --

[jira] [Created] (YARN-3766) ATS Web UI breaks because of YARN-3467

Xuan Gong created YARN-3766: --- Summary: ATS Web UI breaks because of YARN-3467 Key: YARN-3766 URL: https://issues.apache.org/jira/browse/YARN-3766 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571925#comment-14571925 ] Naganarasimha G R commented on YARN-3044: - Hi [~zjshen], bq. It not caused by this

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571658#comment-14571658 ] Wangda Tan commented on YARN-3733: -- Patch LGTM generally, will commit the patch once

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571660#comment-14571660 ] Sangjin Lee commented on YARN-2928: --- Thanks [~vrushalic] for the summary! YARN Timeline

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571811#comment-14571811 ] Xuan Gong commented on YARN-1462: - Create a new patch with compatible newInstance change.

[jira] [Updated] (YARN-3766) ATS Web UI breaks because of YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3766: Attachment: ATSWebPageBreaks.png Uploaded a screen shot ATS Web UI breaks because of YARN-3467

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571879#comment-14571879 ] Xuan Gong commented on YARN-3749: - ＋1. LGTM. Will commit We should make a copy of

[jira] [Updated] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3745: -- Attachment: YARN-3745.1.patch Added test. With previous implementation the test was failing

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570664#comment-14570664 ] Sunil G commented on YARN-3510: --- Hi [~cwelch] Thanks for taking this optimization up. I have

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570680#comment-14570680 ] Brahma Reddy Battula commented on YARN-3432: Kindly review the attached

[jira] [Commented] (YARN-3591) Resource Localisation on a bad disk causes subsequent containers failure

[ https://issues.apache.org/jira/browse/YARN-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570652#comment-14570652 ] Lavkesh Lahngir commented on YARN-3591: --- Thanks [~sunilg] and [~zxu] for comments and

[jira] [Updated] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3745: -- Attachment: YARN-3745.patch SerializedException should also try to instantiate internal

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570706#comment-14570706 ] Hadoop QA commented on YARN-3745: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3432: --- Attachment: YARN-3432-002.patch Cluster metrics have wrong Total Memory when there is

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570869#comment-14570869 ] Hadoop QA commented on YARN-3745: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570921#comment-14570921 ] Chang Li commented on YARN-2556: [~zjshen], [~djp] could you please help review the latest

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570950#comment-14570950 ] Hadoop QA commented on YARN-3733: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570937#comment-14570937 ] Sunil G commented on YARN-3733: --- Thank you [~rohithsharma] for the detailed information and

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570941#comment-14570941 ] Varun Saxena commented on YARN-3051: bq. I noticed there is a readerLimit for read

[jira] [Updated] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3733: - Attachment: 0002-YARN-3733.patch Thanks [~sunilg] and [~leftnoteasy] for sharing your thoughts.. I modified bit

[jira] [Updated] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3754: -- Attachment: NM.log Race condition when the NodeManager is shutting down and container is launched

[jira] [Commented] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570790#comment-14570790 ] Sunil G commented on YARN-3754: --- I have got the logs from [~bibinchundatt] offline.

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570970#comment-14570970 ] Sunil G commented on YARN-3745: --- HI [~lavkesh] Thanks for working on this patch. In

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570989#comment-14570989 ] Lavkesh Lahngir commented on YARN-3745: --- [~sunilg] : Uh.. IllegalArgumentException is

[jira] [Commented] (YARN-3745) SerializedException should also try to instantiate internal exception with the default constructor

[ https://issues.apache.org/jira/browse/YARN-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571235#comment-14571235 ] Sunil G commented on YARN-3745: --- Yes. Missed it :) Thanks! SerializedException should also

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571275#comment-14571275 ] Hadoop QA commented on YARN-41: --- \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571318#comment-14571318 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571335#comment-14571335 ] Sunil G commented on YARN-3751: --- Hi TestAHSWebServices fails after YARN-3467

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571272#comment-14571272 ] Karthik Kambatla commented on YARN-3762: The patch just adds read-write locks to

[jira] [Assigned] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-3453: - Assignee: Arun Suresh Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator

[jira] [Updated] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

[ https://issues.apache.org/jira/browse/YARN-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Shahid Khan updated YARN-3017: --- Attachment: YARN-3017_2.patch fixed the review comment ContainerID in

[jira] [Updated] (YARN-3453) Fair Scheduler : Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3453: -- Attachment: YARN-3453.1.patch [~peng.zhang], [~ashwinshankar77], Thank you reporting this.. and the

[jira] [Commented] (YARN-3751) TestAHSWebServices fails after YARN-3467

[ https://issues.apache.org/jira/browse/YARN-3751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571338#comment-14571338 ] Sunil G commented on YARN-3751: --- Hi [~zjshen] I checked the patch and the tests are getting

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1462: -- Target Version/s: 2.8.0 (was: 2.7.1) AHS API and other AHS changes to handle tags for completed MR

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571957#comment-14571957 ] Chun Chen commented on YARN-3749: - Thanks for reviewing and committing the patch, [~xgong].

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572000#comment-14572000 ] Joep Rottinghuis commented on YARN-3706: It turns out that the

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572010#comment-14572010 ] Sunil G commented on YARN-3510: --- Thank you [~leftnoteasy] for the pointer. I almost

[jira] [Resolved] (YARN-3752) TestRMFailover fails due to intermittent UnknownHostException

[ https://issues.apache.org/jira/browse/YARN-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved YARN-3752. Resolution: Duplicate Fix Version/s: 2.8.0 I can not reproduce the issue after

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572116#comment-14572116 ] Zhijie Shen commented on YARN-1462: --- +1 for the last patch. The change in

[jira] [Commented] (YARN-2578) NM does not failover timely if RM node network connection fails

[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572143#comment-14572143 ] Masatake Iwasaki commented on YARN-2578: Hi [~wilfreds], do you have any update on

[jira] [Commented] (YARN-19) 4-layer topology (with NodeGroup layer) implementation of Container Assignment and Task Scheduling (for YARN)

[ https://issues.apache.org/jira/browse/YARN-19?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572210#comment-14572210 ] Junping Du commented on YARN-19: Hi [~ashahab], thanks for your feedback on this! I remember

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572085#comment-14572085 ] Rohith commented on YARN-3733: -- bq. only memory or vcores are more in TestCapacityScheduler.

  1   2   >