[jira] [Updated] (YARN-9639) DecommissioningNodesWatcher cause memory leak

[ https://issues.apache.org/jira/browse/YARN-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-9639: -- Priority: Blocker (was: Critical) > DecommissioningNodesWatcher cause memory leak >

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893792#comment-16893792 ] Tan, Wangda commented on YARN-9698: --- [~cane] , is the feature you mentioned supported by FairScheduler?

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878079#comment-16878079 ] Tan, Wangda commented on YARN-9660: --- Thanks [~pbacsko] for working on this. All great improvements! >

[jira] [Commented] (YARN-9559) Create AbstractContainersLauncher for pluggable ContainersLauncher logic

[ https://issues.apache.org/jira/browse/YARN-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867128#comment-16867128 ] Tan, Wangda commented on YARN-9559: --- Gotcha, make sense, thanks for the clarification. [~jhung] >

[jira] [Commented] (YARN-9559) Create AbstractContainersLauncher for pluggable ContainersLauncher logic

[ https://issues.apache.org/jira/browse/YARN-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867030#comment-16867030 ] Tan, Wangda commented on YARN-9559: --- [~jhung], could you share what is the use cases of this? Why we

[jira] [Comment Edited] (YARN-9327) ProtoUtils#convertToProtoFormat block Application Master Service and many more

[ https://issues.apache.org/jira/browse/YARN-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862433#comment-16862433 ] Tan, Wangda edited comment on YARN-9327 at 6/12/19 8:22 PM: This seems tricky,

[jira] [Commented] (YARN-9327) ProtoUtils#convertToProtoFormat block Application Master Service and many more

[ https://issues.apache.org/jira/browse/YARN-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862433#comment-16862433 ] Tan, Wangda commented on YARN-9327: --- This seems tricky, because the ResourcePBImpl doesn't have proper

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858095#comment-16858095 ] Tan, Wangda commented on YARN-6875: --- [~larsfrancke], this is already usable in append-able file system

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858066#comment-16858066 ] Tan, Wangda commented on YARN-9607: --- Thanks [~adam.antal], I would vote to enforcing the roll size to

[jira] [Commented] (YARN-3213) Respect labels in Capacity Scheduler when computing user-limit

[ https://issues.apache.org/jira/browse/YARN-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857131#comment-16857131 ] Tan, Wangda commented on YARN-3213: --- This Jira is about respect the queue's user-limit for per-label

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16856807#comment-16856807 ] Tan, Wangda commented on YARN-9525: --- Good news, Patch looks good, thanks [~adam.antal] and [~pbacsko]

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852175#comment-16852175 ] Tan, Wangda commented on YARN-9525: --- Thanks [~adam.antal],     For the rolling issue, is it still

[jira] [Commented] (YARN-9386) destroying yarn-service is allowed even though running state

[ https://issues.apache.org/jira/browse/YARN-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852169#comment-16852169 ] Tan, Wangda commented on YARN-9386: --- Thanks [~kyungwan nam], IIUC, only app owner or queue/cluster admin

[jira] [Commented] (YARN-9581) LogsCli getAMContainerInfoForRMWebService ignores rm2

[ https://issues.apache.org/jira/browse/YARN-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847962#comment-16847962 ] Tan, Wangda commented on YARN-9581: --- Nice catch, thanks [~Prabhu Joseph]. > LogsCli

[jira] [Commented] (YARN-9521) RM filed to start due to system services

[ https://issues.apache.org/jira/browse/YARN-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846230#comment-16846230 ] Tan, Wangda commented on YARN-9521: --- Thanks [~kyungwan nam] for the patch.   cc: [~rohithsharma],

[jira] [Commented] (YARN-9576) ResourceUsageMultiNodeLookupPolicy may cause Application starve forever

[ https://issues.apache.org/jira/browse/YARN-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846213#comment-16846213 ] Tan, Wangda commented on YARN-9576: --- [~jutia], actually this behavior is not caused by multi-node lookup

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846088#comment-16846088 ] Tan, Wangda commented on YARN-9567: --- [~Tao Yang] {quote}Is it ok to support like this in UI1?  Please

[jira] [Commented] (YARN-9569) Auto-created leaf queues do not honor cluster-wide min/max memory/vcores

[ https://issues.apache.org/jira/browse/YARN-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846085#comment-16846085 ] Tan, Wangda commented on YARN-9569: --- Thanks [~ccondit], good catch.  I remember the reason why we

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846081#comment-16846081 ] Tan, Wangda commented on YARN-7494: --- + [~cheersyang] > Add muti-node lookup mechanism and pluggable

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845054#comment-16845054 ] Tan, Wangda commented on YARN-9525: --- Thanks [~pbacsko] for the patch. The change looks good to me,

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844506#comment-16844506 ] Tan, Wangda commented on YARN-9567: --- This looks great! Huge thanks to [~Tao Yang] for pushing it! How

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844496#comment-16844496 ] Tan, Wangda commented on YARN-4946: --- Thanks [~ccondit],  I'm not entirely convinced that fix of this

[jira] [Updated] (YARN-9570) application in pending-ordering-policy is not considered while container allocation

[ https://issues.apache.org/jira/browse/YARN-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-9570: -- Summary: application in pending-ordering-policy is not considered while container allocation (was:

[jira] [Commented] (YARN-9543) UI2 should handle missing ATSv2 gracefully

[ https://issues.apache.org/jira/browse/YARN-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844309#comment-16844309 ] Tan, Wangda commented on YARN-9543: --- Cool, thanks [~giovanni.fumarola] :) > UI2 should handle missing

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844308#comment-16844308 ] Tan, Wangda commented on YARN-4946: --- Thanks [~snemeth], [~ccondit] for commenting.  The question I was

[jira] [Commented] (YARN-9543) UI2 should handle missing ATSv2 gracefully

[ https://issues.apache.org/jira/browse/YARN-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844212#comment-16844212 ] Tan, Wangda commented on YARN-9543: --- [~giovanni.fumarola], do you have the same request internally? It

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844133#comment-16844133 ] Tan, Wangda commented on YARN-9525: --- Thanks [~pbacsko]. > IFile format is not working against s3a

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844097#comment-16844097 ] Tan, Wangda commented on YARN-9525: --- [~pbacsko], can you rename the patch to YARN-9525.001.poc.patch,

[jira] [Commented] (YARN-9517) When aggregation is not enabled, can't see the container log

[ https://issues.apache.org/jira/browse/YARN-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829570#comment-16829570 ] Tan, Wangda commented on YARN-9517: --- [~shurong.mai], thanks for putting a patch. However, I'm not sure

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-8193: -- Target Version/s: 2.9.2 Priority: Blocker (was: Critical) > YARN RM hangs abruptly (stops

[jira] [Commented] (YARN-9445) yarn.admin.acl is futile

[ https://issues.apache.org/jira/browse/YARN-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812881#comment-16812881 ] Tan, Wangda commented on YARN-9445: --- [~shuzirra], [~snemeth], Changing yarn.admin.acl could cause some

[jira] [Updated] (YARN-9319) Fix compilation issue of handling typedef an existing name by gcc compiler

[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-9319: -- Summary: Fix compilation issue of handling typedef an existing name by gcc compiler (was: Fix

[jira] [Commented] (YARN-9319) YARN-9060 does not compile

[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774430#comment-16774430 ] Tan, Wangda commented on YARN-9319: --- Committing this patch now, thanks [~tangzhankun] and everybody for

[jira] [Updated] (YARN-9319) Fix compilation issue of

[ https://issues.apache.org/jira/browse/YARN-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-9319: -- Summary: Fix compilation issue of (was: YARN-9060 does not compile) > Fix compilation issue of >

[jira] [Updated] (YARN-9310) Test submarine maven module build

[ https://issues.apache.org/jira/browse/YARN-9310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-9310: -- Attachment: YARN-9310.001.patch > Test submarine maven module build > -

[jira] [Created] (YARN-9310) Test submarine maven module build

Tan, Wangda created YARN-9310: - Summary: Test submarine maven module build Key: YARN-9310 URL: https://issues.apache.org/jira/browse/YARN-9310 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-5600) Add a parameter to ContainerLaunchContext to emulate yarn.nodemanager.delete.debug-delay-sec on a per-application basis

[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655703#comment-15655703 ] Tan, Wangda commented on YARN-5600: --- This is a very useful feature without any doubt, thanks

[jira] [Commented] (YARN-5864) Capacity Scheduler preemption for fragmented cluster

[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655514#comment-15655514 ] Tan, Wangda commented on YARN-5864: --- Thanks [~curino] for sharing these insightful suggestions. The