[jira] [Commented] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498937#comment-14498937 ] Xuan Gong commented on YARN-2605: - [~adhoot] Feel free to assign back to yourself, if you

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499204#comment-14499204 ] Craig Welch commented on YARN-3463: --- bq. how about change it to MapString, String to

[jira] [Created] (YARN-3499) Optimize ResourceManager Web loading speed

Peter Shi created YARN-3499: --- Summary: Optimize ResourceManager Web loading speed Key: YARN-3499 URL: https://issues.apache.org/jira/browse/YARN-3499 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-3501) problem in running yarn scheduler load simulator

[ https://issues.apache.org/jira/browse/YARN-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3501: --- Fix Version/s: (was: 2.3.0) problem in running yarn scheduler load simulator

[jira] [Updated] (YARN-3501) problem in running yarn scheduler load simulator

[ https://issues.apache.org/jira/browse/YARN-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3501: --- Target Version/s: (was: 2.6.0) problem in running yarn scheduler load simulator

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499247#comment-14499247 ] Zhijie Shen commented on YARN-3437: --- Per my comment on [YARN-3390 |

[jira] [Commented] (YARN-3501) problem in running yarn scheduler load simulator

[ https://issues.apache.org/jira/browse/YARN-3501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499375#comment-14499375 ] Naganarasimha G R commented on YARN-3501: - Can some more information be given on

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499285#comment-14499285 ] Hadoop QA commented on YARN-3463: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499326#comment-14499326 ] Li Lu commented on YARN-3134: - Hi [~djp] and [~zjshen], thanks a lot for the review! I'll fix

[jira] [Resolved] (YARN-3499) Optimize ResourceManager Web loading speed

[ https://issues.apache.org/jira/browse/YARN-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Shi resolved YARN-3499. - Resolution: Duplicate duplicated with YARN-3500 Optimize ResourceManager Web loading speed

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499314#comment-14499314 ] Zhijie Shen commented on YARN-3431: --- Right, TimelineEntity is the generic Java form for

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499288#comment-14499288 ] Hadoop QA commented on YARN-3493: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3501) problem in running yarn scheduler load simulator

Awadhesh kumar shukla created YARN-3501: --- Summary: problem in running yarn scheduler load simulator Key: YARN-3501 URL: https://issues.apache.org/jira/browse/YARN-3501 Project: Hadoop YARN

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499393#comment-14499393 ] Sunil G commented on YARN-3487: --- Hi [~leftnoteasy] I am sorry for providing lesser content

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499264#comment-14499264 ] Zhijie Shen commented on YARN-3134: --- Some thoughts about backend POC, not just limited to

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499399#comment-14499399 ] Sunil G commented on YARN-1963: --- Yes. We could try support both Integer and Label (with

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.68.patch Integrate OrderingPolicy Framework with CapacityScheduler

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499205#comment-14499205 ] Craig Welch commented on YARN-3463: --- btw, the tests pass on my box with the change,

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499245#comment-14499245 ] Zhijie Shen commented on YARN-3390: --- The only conflict part between YARN-3437 and this

[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed

[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499297#comment-14499297 ] Peter Shi commented on YARN-3500: - Yes, i have mark 3499 with duplicate Optimize

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499398#comment-14499398 ] Li Lu commented on YARN-3134: - Hi [~zjshen] could you please provide some more information to

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499413#comment-14499413 ] Li Lu commented on YARN-3431: - bq. After receiving the entity from the endpoint of the web

[jira] [Commented] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499435#comment-14499435 ] Steve Loughran commented on YARN-2605: -- patch looks good in production; 307 is the

[jira] [Created] (YARN-3503) Expose disk utilization percentage on NM via JMX

Varun Vasudev created YARN-3503: --- Summary: Expose disk utilization percentage on NM via JMX Key: YARN-3503 URL: https://issues.apache.org/jira/browse/YARN-3503 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3503) Expose disk utilization percentage on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Description: It would be useful to expose the disk utilization on the NMs via JMX so that alerts can

[jira] [Commented] (YARN-3496) Add a configuration to disable/enable storing localization state in NMLeveldbStateStore

[ https://issues.apache.org/jira/browse/YARN-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499537#comment-14499537 ] zhihai xu commented on YARN-3496: - Hi [~jlowe], You are right. Based on my profiling at

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Description: Based on the profiling, The bottleneck in PublicLocalizer#addResource is

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499401#comment-14499401 ] Sunil G commented on YARN-2003: --- HI [~leftnoteasy] bq. authenticateApplicationPriority, I'm

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499534#comment-14499534 ] zhihai xu commented on YARN-3491: - Hi [~jlowe], You are right, I am really sorry all my

[jira] [Commented] (YARN-3261) rewrite resourcemanager restart doc to remove roadmap bits

[ https://issues.apache.org/jira/browse/YARN-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499517#comment-14499517 ] Gururaj Shetty commented on YARN-3261: -- Hi [~aw] Kindly review the update patch and

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Description: Based on the profiling, The bottleneck in PublicLocalizer#addResource is

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Description: Based on the profiling, The bottleneck in PublicLocalizer#addResource is

[jira] [Updated] (YARN-3502) Expose number of unhealthy disks on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3502: Description: It would be useful to expose the number of unhealthy disks on the NMs via JM so that

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Attachment: YARN-3491.000.patch PublicLocalizer#addResource is too slow.

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499402#comment-14499402 ] Sunil G commented on YARN-2003: --- Thank you [~leftnoteasy] for sharing comments. I will rebase

[jira] [Created] (YARN-3502) Expose number of unhealthy disks on NM via JMX

Varun Vasudev created YARN-3502: --- Summary: Expose number of unhealthy disks on NM via JMX Key: YARN-3502 URL: https://issues.apache.org/jira/browse/YARN-3502 Project: Hadoop YARN Issue Type:

[jira] [Resolved] (YARN-3496) Add a configuration to disable/enable storing localization state in NMLeveldbStateStore

[ https://issues.apache.org/jira/browse/YARN-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved YARN-3496. - Resolution: Not A Problem Add a configuration to disable/enable storing localization state in

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499764#comment-14499764 ] Junping Du commented on YARN-3134: -- bq. 1. At the current stage, I suggest we focus on

[jira] [Updated] (YARN-3381) A typographical error in InvalidStateTransitonException

[ https://issues.apache.org/jira/browse/YARN-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3381: --- Attachment: YARN-3381-002.patch A typographical error in

[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499750#comment-14499750 ] Hadoop QA commented on YARN-2268: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499609#comment-14499609 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3181) FairScheduler: Fix up outdated findbugs issues

[ https://issues.apache.org/jira/browse/YARN-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499667#comment-14499667 ] Tsuyoshi Ozawa commented on YARN-3181: -- I agree with Karthik's comment - this is not

[jira] [Commented] (YARN-3495) Confusing log generated by FairScheduler

[ https://issues.apache.org/jira/browse/YARN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499702#comment-14499702 ] Tsuyoshi Ozawa commented on YARN-3495: -- Oops, I meant discussion on YARN-3197.

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499803#comment-14499803 ] Thomas Graves commented on YARN-3434: - Ok, I'll make the changes and post an updated

[jira] [Commented] (YARN-3381) A typographical error in InvalidStateTransitonException

[ https://issues.apache.org/jira/browse/YARN-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499836#comment-14499836 ] Hadoop QA commented on YARN-3381: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3381) A typographical error in InvalidStateTransitonException

[ https://issues.apache.org/jira/browse/YARN-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499797#comment-14499797 ] Brahma Reddy Battula commented on YARN-3381: Rebased the patch.. Kindly

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499580#comment-14499580 ] Hadoop QA commented on YARN-3491: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499641#comment-14499641 ] Rohith commented on YARN-2268: -- I verified the patch deploying in HA cluster and Non-HA

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499684#comment-14499684 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #157 (See

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499621#comment-14499621 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-Yarn-trunk #900 (See

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499675#comment-14499675 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2098 (See

[jira] [Commented] (YARN-3495) Confusing log generated by FairScheduler

[ https://issues.apache.org/jira/browse/YARN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499701#comment-14499701 ] Tsuyoshi Ozawa commented on YARN-3495: -- +1. I checked the discussion YARN-3495, and

[jira] [Updated] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2268: - Issue Type: Improvement (was: Bug) Disallow formatting the RMStateStore when there is an RM running

[jira] [Updated] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2268: - Attachment: 0001-YARN-2268.patch Disallow formatting the RMStateStore when there is an RM running

[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499638#comment-14499638 ] Rohith commented on YARN-2268: -- Attached the patch for disallowing format store using previous

[jira] [Commented] (YARN-3503) Expose disk utilization percentage on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499885#comment-14499885 ] Vinod Kumar Vavilapalli commented on YARN-3503: --- Given we are starting afresh

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499939#comment-14499939 ] Arun Suresh commented on YARN-2962: --- [~varun_saxena], wondering if you need any help with

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1442#comment-1442 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #167 (See

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500019#comment-14500019 ] Junping Du commented on YARN-1402: -- Latest patch looks good to me. [~xgong], can you file

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500287#comment-14500287 ] Inigo Goiri commented on YARN-3482: --- Yes, that one is good. My proposal for the third one

[jira] [Updated] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3410: - Attachment: 0004-YARN-3410.patch Updated the patch fixing usage format.. kindly review updated patch YARN admin

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500257#comment-14500257 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500277#comment-14500277 ] Karthik Kambatla commented on YARN-3482: For the third config, would something like

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: 00012-YARN-3136.patch Rebased against trunk. Also changed the findbugs suppression for

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500308#comment-14500308 ] Hadoop QA commented on YARN-3410: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500398#comment-14500398 ] Sangjin Lee commented on YARN-3431: --- I know [~zjshen]'s updating the patch, but I'll

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500395#comment-14500395 ] Sunil G commented on YARN-3482: --- Hi [~elgoiri] bq. better to report the resources utilized

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500405#comment-14500405 ] zhihai xu commented on YARN-3491: - I uploaded a new patch YARN-3491.001.patch for review I

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500417#comment-14500417 ] Hadoop QA commented on YARN-2003: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500338#comment-14500338 ] Wangda Tan commented on YARN-3410: -- bq. Yes, in the same user two RM can not be started.

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500342#comment-14500342 ] Wangda Tan commented on YARN-3487: -- Thanks for feedback from [~sunilg], [~jlowe]. Make

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500348#comment-14500348 ] Inigo Goiri commented on YARN-3482: --- To make it match

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500223#comment-14500223 ] Inigo Goiri commented on YARN-3482: --- Makes sense. I think we should implement both and

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500298#comment-14500298 ] Rohith commented on YARN-3410: -- bq. I think RM will check pid while start to avoid this case,

[jira] [Updated] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3487: - Issue Type: Sub-task (was: Bug) Parent: YARN-3091 CapacityScheduler scheduler lock obtained

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Attachment: YARN-3491.001.patch PublicLocalizer#addResource is too slow.

[jira] [Updated] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated YARN-3021: Release Note: ResourceManager renews delegation tokens for applications. This behavior has been

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500037#comment-14500037 ] Junping Du commented on YARN-3046: -- Thanks [~rkanter] and [~zjshen] for review and

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500062#comment-14500062 ] Sangjin Lee commented on YARN-3390: --- Thanks Zhijie. I'll move forward with the existing

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500268#comment-14500268 ] Wangda Tan commented on YARN-3410: -- One question: What will happen if a running app is

[jira] [Commented] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500307#comment-14500307 ] Xuan Gong commented on YARN-2605: - Thanks for the review. [~ste...@apache.org] bq. Why is a

[jira] [Updated] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3487: - Attachment: YARN-3487.003.patch Thanks for the feedback, Wangda and Sunil. In the interest of keeping

[jira] [Updated] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0007-YARN-2003.patch Rebased the patch and addressed the comments. Thank you [~leftnoteasy]

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500368#comment-14500368 ] Yongjun Zhang commented on YARN-3021: - Thanks also to [~ka...@cloudera.com] for the

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500029#comment-14500029 ] Yongjun Zhang commented on YARN-3021: - Thanks again [~jianhe] for the

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500152#comment-14500152 ] Zhijie Shen commented on YARN-3390: --- bq. How's that sound? Sure, I'll take care of it.

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500184#comment-14500184 ] Wangda Tan commented on YARN-3463: -- [~cwelch], Thanks for update, patch LGTM, +1.

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500193#comment-14500193 ] Junping Du commented on YARN-1402: -- bq. This is a good point. The reports also need to be

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Attachment: YARN-3046-v3.patch Incorporate [~zjshen] and [~rkanter]'s comments in v3 patch! Also, identify

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: (was: 00011-YARN-3136.patch) getTransferredContainers can be a bottleneck during AM

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500097#comment-14500097 ] Karthik Kambatla commented on YARN-3482: bq. With this and the containers

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: 00011-YARN-3136.patch Checking jenkins again getTransferredContainers can be a bottleneck during

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500187#comment-14500187 ] Jonathan Eagles commented on YARN-3437: --- Now that I have dug into timeline server

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500112#comment-14500112 ] Zhijie Shen commented on YARN-3437: --- Will take a look today. convert load test driver

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500044#comment-14500044 ] Hudson commented on YARN-3021: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Description: Based on the profiling, The bottleneck in PublicLocalizer#addResource is

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500200#comment-14500200 ] Wangda Tan commented on YARN-2696: -- Failed test is tracked by YARN-2483 Queue sorting in

[jira] [Updated] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3410: - Attachment: 0003-YARN-3410.patch YARN admin should be able to remove individual application records from

[jira] [Updated] (YARN-3500) Optimize ResourceManager Web loading speed

[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3500: --- Priority: Major (was: Minor) Optimize ResourceManager Web loading speed

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14500481#comment-14500481 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of

  1   2   >