[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862697#comment-16862697 ] Weiwei Yang commented on YARN-9567: --- Hi [~Tao Yang] I will take a look at this later this week. Will

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862696#comment-16862696 ] Tao Yang commented on YARN-9578: Thanks [~cheersyang] for the review and commit! I will update the patch 

[jira] [Commented] (YARN-9620) oozie completed jobs didn't send to yarn job history server

2019-06-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862694#comment-16862694 ] Prabhu Joseph commented on YARN-9620: - [~zhoubh] Have seen this issue earlier for below two reasons #

[jira] [Assigned] (YARN-9359) Avoid code duplication in Resources for calculation methods

2019-06-12 Thread WEI-HSIAO-LEE (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WEI-HSIAO-LEE reassigned YARN-9359: --- Assignee: WEI-HSIAO-LEE > Avoid code duplication in Resources for calculation methods >

[jira] [Assigned] (YARN-9455) SchedulerInvalidResoureRequestException has a typo in its class (and file) name

2019-06-12 Thread WEI-HSIAO-LEE (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] WEI-HSIAO-LEE reassigned YARN-9455: --- Assignee: WEI-HSIAO-LEE > SchedulerInvalidResoureRequestException has a typo in its class

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-12 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862678#comment-16862678 ] zhuqi commented on YARN-8995: - cc  [~Tao Yang] Thanks [~Tao Yang] for your comment. Thank you very much for

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862669#comment-16862669 ] Hudson commented on YARN-9578: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16737 (See

[jira] [Updated] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-06-12 Thread zhuqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-8995: Attachment: YARN-8995.003.patch > Log the event type of the too big AsyncDispatcher event queue size, and add >

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862658#comment-16862658 ] Weiwei Yang commented on YARN-9578: --- Thanks [~Tao Yang] for the updates, it looks good to me now. +1 for

[jira] [Updated] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9578: -- Hadoop Flags: Incompatible change > Add limit/actions/summarize options for app activities REST API >

[jira] [Created] (YARN-9620) oozie completed jobs didn't send to yarn job history server

2019-06-12 Thread ZHOUBEIHUA (JIRA)
ZHOUBEIHUA created YARN-9620: Summary: oozie completed jobs didn't send to yarn job history server Key: YARN-9620 URL: https://issues.apache.org/jira/browse/YARN-9620 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2019-06-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862605#comment-16862605 ] Hadoop QA commented on YARN-5727: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5727) Improve YARN shared cache support for LinuxContainerExecutor

2019-06-12 Thread zhenzhao wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhenzhao wang updated YARN-5727: Attachment: YARN-5727-Design-v2.pdf > Improve YARN shared cache support for LinuxContainerExecutor

[jira] [Commented] (YARN-9613) Avoid remote lookups for RegistryDNS domain

2019-06-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862481#comment-16862481 ] Billie Rinaldi commented on YARN-9613: -- Thanks for the comment, [~eyang]. That sounds reasonable. >

[jira] [Comment Edited] (YARN-9327) ProtoUtils#convertToProtoFormat block Application Master Service and many more

2019-06-12 Thread Tan, Wangda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862433#comment-16862433 ] Tan, Wangda edited comment on YARN-9327 at 6/12/19 8:22 PM: This seems tricky,

[jira] [Commented] (YARN-9327) ProtoUtils#convertToProtoFormat block Application Master Service and many more

2019-06-12 Thread Tan, Wangda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862433#comment-16862433 ] Tan, Wangda commented on YARN-9327: --- This seems tricky, because the ResourcePBImpl doesn't have proper

[jira] [Commented] (YARN-9301) Too many InvalidStateTransitionException with SLS

2019-06-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862397#comment-16862397 ] Bibin A Chundatt commented on YARN-9301: [~BilwaST] Please fix the checkstyle issue.. > Too many

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862386#comment-16862386 ] Eric Badger commented on YARN-9560: --- bq. Perhaps we could have the OCI interface class expose a

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862348#comment-16862348 ] Eric Yang commented on YARN-9560: - [~ccondit] {quote}Perhaps we could have the OCI interface class expose

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862343#comment-16862343 ] Eric Yang commented on YARN-9560: - [~ebadger] Does this mean runc specific config will use prefix

[jira] [Comment Edited] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862337#comment-16862337 ] Craig Condit edited comment on YARN-9560 at 6/12/19 6:17 PM: - {quote}In the

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862337#comment-16862337 ] Craig Condit commented on YARN-9560: Perhaps we could have the OCI interface class expose a

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-06-12 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862331#comment-16862331 ] Steve Loughran commented on YARN-9545: -- thanks > Create healthcheck REST endpoint for ATSv2 >

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

2019-06-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862329#comment-16862329 ] Eric Badger commented on YARN-9560: --- {quote} At this time, the end user configuration

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862215#comment-16862215 ] Hadoop QA commented on YARN-9607: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-06-12 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862210#comment-16862210 ] Jim Brennan commented on YARN-9202: --- I am +1 on patch 002 (non-binding). > RM does not track nodes

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-12 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862164#comment-16862164 ] Sunil Govindan commented on YARN-9607: -- Hi [~adam.antal] Could we add a new config which says

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-06-12 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9607: - Attachment: YARN-9607.001.patch > Auto-configuring rollover-size of IFile format for non-appendable

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862154#comment-16862154 ] Hadoop QA commented on YARN-9608: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9327) ProtoUtils#convertToProtoFormat block Application Master Service and many more

2019-06-12 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862153#comment-16862153 ] Sunil Govindan commented on YARN-9327: -- This is a good catch. I have seen in some other proto class

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862138#comment-16862138 ] Hadoop QA commented on YARN-9578: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-06-12 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862121#comment-16862121 ] Sunil Govindan commented on YARN-9545: -- Corrected and committed patch w/o the hidden dir which caused

[jira] [Commented] (YARN-9545) Create healthcheck REST endpoint for ATSv2

2019-06-12 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862112#comment-16862112 ] Sunil Govindan commented on YARN-9545: -- Hi [~ste...@apache.org], you are correct. Its a mistake

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862041#comment-16862041 ] Abhishek Modi commented on YARN-9608: - Thanks [~tangzhankun] for reviewing it. I have taken care of

[jira] [Updated] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9608: Attachment: YARN-9608.002.patch > DecommissioningNodesWatcher should get lists of running

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16862024#comment-16862024 ] Tao Yang commented on YARN-9578: Thanks [~cheersyang] for the feedback. Attached v6 patch with updates:

[jira] [Updated] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9578: --- Attachment: YARN-9578.006.patch > Add limit/actions/summarize options for app activities REST API >

[jira] [Comment Edited] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861943#comment-16861943 ] Zhankun Tang edited comment on YARN-9608 at 6/12/19 10:24 AM: -- Thanks for the

[jira] [Comment Edited] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861943#comment-16861943 ] Zhankun Tang edited comment on YARN-9608 at 6/12/19 10:17 AM: -- Thanks for the

[jira] [Commented] (YARN-9578) Add limit/actions/summarize options for app activities REST API

2019-06-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861949#comment-16861949 ] Weiwei Yang commented on YARN-9578: --- Thanks [~Tao Yang]. I see, then it's fine, given subList won't have

[jira] [Commented] (YARN-9608) DecommissioningNodesWatcher should get lists of running applications on node from RMNode.

2019-06-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16861943#comment-16861943 ] Zhankun Tang commented on YARN-9608: Thanks for the patch! [~abmodi]. I took a glance at it. One minor

[jira] [Resolved] (YARN-6875) New aggregated log file format for YARN log aggregation.

2019-06-12 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke resolved YARN-6875. Resolution: Fixed > New aggregated log file format for YARN log aggregation. >