[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202044#comment-15202044 ] Karthik Kambatla commented on YARN-4837: I am in favor of making these changes if it improves

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200544#comment-15200544 ] Junping Du commented on YARN-4837: -- Thanks for calling it out, [~vinodkv]! I also feel uncomfortable on

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199970#comment-15199970 ] Sunil G commented on YARN-4390: --- Thats very good, +1. If this is considering other parameters such as

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Summary: CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203721#comment-15203721 ] Naganarasimha G R commented on YARN-796: Yes [~jameszhouyi], in 2.6.0 this command is not yet

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203723#comment-15203723 ] Wangda Tan commented on YARN-3933: -- Looked at this issue, it seems only FairScheduler has this issue. CS

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203740#comment-15203740 ] Naganarasimha G R commented on YARN-796: Ok actually i meant the same ... create a document for

[jira] [Created] (YARN-4842) yarn logs command should not require the appOwner argument

Ram Venkatesh created YARN-4842: --- Summary: yarn logs command should not require the appOwner argument Key: YARN-4842 URL: https://issues.apache.org/jira/browse/YARN-4842 Project: Hadoop YARN

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203746#comment-15203746 ] Sunil G commented on YARN-3933: --- As per existing patch, new liveContainers check is done before below code

[jira] [Assigned] (YARN-4842) yarn logs command should not require the appOwner argument

[ https://issues.apache.org/jira/browse/YARN-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Venkatesh reassigned YARN-4842: --- Assignee: Ram Venkatesh > yarn logs command should not require the appOwner argument >

[jira] [Created] (YARN-4841) UT/FT tests for RM web UI pages

Rohith Sharma K S created YARN-4841: --- Summary: UT/FT tests for RM web UI pages Key: YARN-4841 URL: https://issues.apache.org/jira/browse/YARN-4841 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203684#comment-15203684 ] Yi Zhou commented on YARN-796: -- Hi [~Naganarasimha] It seems the below commands are still not supported in

[jira] [Updated] (YARN-4842) yarn logs command should not require the appOwner argument

[ https://issues.apache.org/jira/browse/YARN-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Venkatesh updated YARN-4842: Attachment: YARN-4842.1.patch > yarn logs command should not require the appOwner argument >

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203759#comment-15203759 ] Yi Zhou commented on YARN-796: -- Hi [~Naganarasimha], If you finished the jira for 2.6 doc, please kindly

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203738#comment-15203738 ] Wangda Tan commented on YARN-796: - [~Naganarasimha], Since we could possibly update node label features in

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203757#comment-15203757 ] Yi Zhou commented on YARN-796: -- Appreciate[~Naganarasimha] [~wangda] for you great help! > Allow for (admin)

[jira] [Assigned] (YARN-4838) TestLogAggregationService. testLocalFileDeletionOnDiskFull failed

[ https://issues.apache.org/jira/browse/YARN-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-4838: Assignee: Haibo Chen > TestLogAggregationService. testLocalFileDeletionOnDiskFull failed >

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198175#comment-15198175 ] Sangjin Lee commented on YARN-4736: --- Yes, sorry I meant HBASE-15436. I think we're more OK with the

[jira] [Updated] (YARN-4609) RM Nodes list page takes too much time to load

[ https://issues.apache.org/jira/browse/YARN-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4609: --- Attachment: 7k Nodes.png [~rohithsharma]/[~devaraj.k] Check the current implementation with 7

[jira] [Assigned] (YARN-4746) yarn web services should convert parse failures of appId to 400

[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-4746: -- Assignee: Bibin A Chundatt > yarn web services should convert parse failures of appId

[jira] [Updated] (YARN-4609) RM Nodes list page takes too much time to load

[ https://issues.apache.org/jira/browse/YARN-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4609: --- Attachment: sls-nodes.json sls-jobs.json > RM Nodes list page takes too much

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201895#comment-15201895 ] Vinod Kumar Vavilapalli commented on YARN-4837: --- [~sunilg] and [~sjlee0], Appreciate your

[jira] [Commented] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

[ https://issues.apache.org/jira/browse/YARN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203211#comment-15203211 ] Bibin A Chundatt commented on YARN-4833: [~sunilg] Thank you for looking into the issue. Actually

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203136#comment-15203136 ] Hadoop QA commented on YARN-3933: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4609) RM Nodes list page takes too much time to load

[ https://issues.apache.org/jira/browse/YARN-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4609: --- Attachment: 0001-YARN-4609.patch Attaching patch . Please do review > RM Nodes list page

[jira] [Assigned] (YARN-3773) hadoop-yarn-server-nodemanager's use of Linux /sbin/tc is non-portable

[ https://issues.apache.org/jira/browse/YARN-3773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Burlison reassigned YARN-3773: --- Assignee: Alan Burlison > hadoop-yarn-server-nodemanager's use of Linux /sbin/tc is

[jira] [Commented] (YARN-4609) RM Nodes list page takes too much time to load

[ https://issues.apache.org/jira/browse/YARN-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203247#comment-15203247 ] Hadoop QA commented on YARN-4609: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4831) Recovered containers will be killed after NM stateful restart

[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-4831: -- Attachment: YARN-4831.v1.patch > Recovered containers will be killed after NM stateful restart >

[jira] [Updated] (YARN-4766) NM should not aggregate logs older than the retention policy

[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4766: - Attachment: yarn4766.003.patch > NM should not aggregate logs older than the retention policy >

[jira] [Commented] (YARN-4831) Recovered containers will be killed after NM stateful restart

[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197895#comment-15197895 ] Siqi Li commented on YARN-4831: --- When NM does a stateful restart, the ContainerManagerImpl will try to

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198436#comment-15198436 ] Eric Payne commented on YARN-4108: -- Thanks, [~leftnoteasy]. The patch looks good to me. >

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200863#comment-15200863 ] Hadoop QA commented on YARN-4766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-4062: - Attachment: YARN-4062-YARN-2928.09.patch Attaching v9. Thanks [~sjlee0] for the debugging to fix the

[jira] [Commented] (YARN-4732) *ProcessTree classes have too many whitespace issues

[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203396#comment-15203396 ] Hudson commented on YARN-4732: -- FAILURE: Integrated in Hadoop-trunk-Commit #9479 (See

[jira] [Commented] (YARN-4809) De-duplicate container completion across schedulers

[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203416#comment-15203416 ] Sunil G commented on YARN-4809: --- Yes. That's perfectly fine. Thank You. > De-duplicate container completion

[jira] [Commented] (YARN-4636) Make blacklist tracking policy pluggable for more extensions.

[ https://issues.apache.org/jira/browse/YARN-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203367#comment-15203367 ] Sunil G commented on YARN-4636: --- As YARN improves in its blacklist/whitelist node functionality, one of the

[jira] [Updated] (YARN-4732) *ProcessTree classes have too many whitespace issues

[ https://issues.apache.org/jira/browse/YARN-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4732: --- Release Note: was:YARN-4732 Cleanup whitespace issues in *ProcessTree classes >

[jira] [Commented] (YARN-4067) available resource could be set negative

[ https://issues.apache.org/jira/browse/YARN-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203401#comment-15203401 ] Karthik Kambatla commented on YARN-4067: IMO, available resource being negative is misleading. Even

[jira] [Commented] (YARN-3933) Race condition when calling AbstractYarnScheduler.completedContainer.

[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203404#comment-15203404 ] Karthik Kambatla commented on YARN-3933: The fix here seems benign and should be okay to get in.

[jira] [Commented] (YARN-4809) De-duplicate container completion across schedulers

[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203407#comment-15203407 ] Karthik Kambatla commented on YARN-4809: [~sunilg] - we might want to wait until YARN-3933 gets in,

[jira] [Created] (YARN-4839) ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt

Jason Lowe created YARN-4839: Summary: ResourceManager deadlock between RMAppAttemptImpl and SchedulerApplicationAttempt Key: YARN-4839 URL: https://issues.apache.org/jira/browse/YARN-4839 Project:

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203371#comment-15203371 ] Sunil G commented on YARN-4576: --- bq.When YARN detects possible failures, it should blacklist nodes within the

[jira] [Updated] (YARN-4699) Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node

[ https://issues.apache.org/jira/browse/YARN-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4699: -- Attachment: 0002-YARN-4699.patch Attaching new patch with test case. I had to add a sleep because event

[jira] [Commented] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198530#comment-15198530 ] Robert Kanter commented on YARN-4812: - +1 > TestFairScheduler#testContinuousScheduling fails

[jira] [Updated] (YARN-4609) RM Nodes list page takes too much time to load

[ https://issues.apache.org/jira/browse/YARN-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4609: --- Attachment: 0002-YARN-4609.patch > RM Nodes list page takes too much time to load >

[jira] [Updated] (YARN-4809) De-duplicate container completion across schedulers

[ https://issues.apache.org/jira/browse/YARN-4809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4809: -- Attachment: 0001-YARN-4809.patch Sharing an initial version of patch. Kindly help to check the same. >

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203611#comment-15203611 ] Rohith Sharma K S commented on YARN-4002: - Thanks [~leftnoteasy] for the looking at the patch.. I

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203616#comment-15203616 ] Hadoop QA commented on YARN-4808: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4607) AppAttempt page TotalOutstandingResource Requests table support pagination

[ https://issues.apache.org/jira/browse/YARN-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203635#comment-15203635 ] Rohith Sharma K S commented on YARN-4607: - Overall patch looks good, can you add screenshot of

[jira] [Updated] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-4002: -- Attachment: YARN-4002-rwlock-v2.patch Uploaded YARN-4002-rwlock-v2.patch for an improvement: make the

[jira] [Commented] (YARN-1040) De-link container life cycle from an Allocation

[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203496#comment-15203496 ] Vinod Kumar Vavilapalli commented on YARN-1040: --- Thanks for the document, [~asuresh]!

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4808: --- Attachment: yarn-4808-2.patch Rebased patch and made a few more cosmetic changes. >

[jira] [Commented] (YARN-4699) Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node

[ https://issues.apache.org/jira/browse/YARN-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203557#comment-15203557 ] Hadoop QA commented on YARN-4699: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203522#comment-15203522 ] Vinod Kumar Vavilapalli commented on YARN-4837: --- bq. "DISKS_FAILED" shouldn't be skipped for

[jira] [Commented] (YARN-4609) RM Nodes list page takes too much time to load

[ https://issues.apache.org/jira/browse/YARN-4609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203477#comment-15203477 ] Hadoop QA commented on YARN-4609: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203519#comment-15203519 ] Vinod Kumar Vavilapalli commented on YARN-4576: --- bq. To the more general point of nodes