[jira] [Commented] (YARN-8613) Old RM UI shows wrong vcores total value

2020-01-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014235#comment-17014235 ] Hadoop QA commented on YARN-8613: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8613) Old RM UI shows wrong vcores total value

2020-01-13 Thread panlijie (Jira)
[ https://issues.apache.org/jira/browse/YARN-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014122#comment-17014122 ] panlijie commented on YARN-8613: We find the same problem in our platform of  Hadoop 3.1.2-SNAPSHOT, 

[jira] [Updated] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-13 Thread Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kinga Marton updated YARN-10070: Attachment: YARN-10070.001.patch > NPE if no rule is defined and application-tag-based-placement

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9525: - Attachment: YARN-9525.007.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014194#comment-17014194 ] Adam Antal commented on YARN-9525: -- [~snemeth] thanks for the review! Uploaded patch v7 that adds some

[jira] [Commented] (YARN-9925) CapacitySchedulerQueueManager allows unsupported Queue hierarchy

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014116#comment-17014116 ] Szilard Nemeth commented on YARN-9925: -- +1 on closing > CapacitySchedulerQueueManager allows

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

2020-01-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014233#comment-17014233 ] Hadoop QA commented on YARN-9525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014243#comment-17014243 ] Hadoop QA commented on YARN-10070: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-13 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-9970: --- Attachment: YARN-9970.008.patch > Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping >

[jira] [Comment Edited] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014418#comment-17014418 ] Adam Antal edited comment on YARN-10028 at 1/13/20 3:43 PM: Provisioned a

[jira] [Comment Edited] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014418#comment-17014418 ] Adam Antal edited comment on YARN-10028 at 1/13/20 3:42 PM: Provisioned a

[jira] [Commented] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2020-01-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014466#comment-17014466 ] Hudson commented on YARN-9912: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17859 (See

[jira] [Commented] (YARN-10027) Add ability for ATS (log servlet) to read logs of running apps

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014459#comment-17014459 ] Adam Antal commented on YARN-10027: --- If the application is in running state, we temporary redirect to

[jira] [Resolved] (YARN-9772) CapacitySchedulerQueueManager has incorrect list of queues

2020-01-13 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R resolved YARN-9772. Resolution: Duplicate > CapacitySchedulerQueueManager has incorrect list of queues >

[jira] [Commented] (YARN-9772) CapacitySchedulerQueueManager has incorrect list of queues

2020-01-13 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014492#comment-17014492 ] Manikandan R commented on YARN-9772: YARN-9879 cover this. Closing this as duplicate. >

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-13 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014484#comment-17014484 ] Manikandan R commented on YARN-9970: Rebasing.. > Refactor

[jira] [Commented] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014418#comment-17014418 ] Adam Antal commented on YARN-10028: --- Provisioned a cluster with the above change. I ran a

[jira] [Commented] (YARN-10070) NPE if no rule is defined and application-tag-based-placement is enabled

2020-01-13 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014290#comment-17014290 ] Prabhu Joseph commented on YARN-10070: -- [~kmarton] Thanks for the patch. The patch looks good. Can

[jira] [Comment Edited] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014418#comment-17014418 ] Adam Antal edited comment on YARN-10028 at 1/13/20 3:44 PM: Provisioned a

[jira] [Comment Edited] (YARN-10028) Integrate the new abstract log servlet to the JobHistory server

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014418#comment-17014418 ] Adam Antal edited comment on YARN-10028 at 1/13/20 3:44 PM: Provisioned a

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014443#comment-17014443 ] Szilard Nemeth commented on YARN-9868: -- Thanks [~maniraj...@gmail.com]! Latest patch LGTM, committed

[jira] [Updated] (YARN-9868) Validate %primary_group queue in CS queue manager

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9868: - Fix Version/s: 3.3.0 > Validate %primary_group queue in CS queue manager >

[jira] [Commented] (YARN-10026) Pull out common code pieces from ATS v1.5 and v2

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014283#comment-17014283 ] Adam Antal commented on YARN-10026: --- Thanks! > Pull out common code pieces from ATS v1.5 and v2 >

[jira] [Commented] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014447#comment-17014447 ] Szilard Nemeth commented on YARN-9912: -- Hi [~maniraj...@gmail.com]! Latest patch LGTM, committed to

[jira] [Updated] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10083: -- Summary: Provide utility to ask whether an application is in final status (was: Provide utility to )

[jira] [Created] (YARN-10083) Provide utility to

2020-01-13 Thread Adam Antal (Jira)
Adam Antal created YARN-10083: - Summary: Provide utility to Key: YARN-10083 URL: https://issues.apache.org/jira/browse/YARN-10083 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Commented] (YARN-9868) Validate %primary_group queue in CS queue manager

2020-01-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014454#comment-17014454 ] Hudson commented on YARN-9868: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17858 (See

[jira] [Commented] (YARN-9989) Typo in CapacityScheduler documentation: Runtime Configuration

2020-01-13 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014438#comment-17014438 ] Hudson commented on YARN-9989: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17857 (See

[jira] [Updated] (YARN-9912) Capacity scheduler: support u:user2:%secondary_group queue mapping

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9912: - Fix Version/s: 3.3.0 > Capacity scheduler: support u:user2:%secondary_group queue mapping >

[jira] [Updated] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10082: Attachment: YARN-10082-001.patch > FS-CS converter: disable terminal placement rule checking >

[jira] [Commented] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014449#comment-17014449 ] Peter Bacsko commented on YARN-10082: - Attached patch v1 without tests. > FS-CS converter: disable

[jira] [Updated] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10082: Description: Before YARN-8967, {{QueuePlacementRule}} class had a method called {{isTerminal()}}.

[jira] [Created] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10082: --- Summary: FS-CS converter: disable terminal placement rule checking Key: YARN-10082 URL: https://issues.apache.org/jira/browse/YARN-10082 Project: Hadoop YARN

[jira] [Updated] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-10083: -- Attachment: YARN-10083.001.patch > Provide utility to ask whether an application is in final status >

[jira] [Commented] (YARN-10027) Add ability for ATS (log servlet) to read logs of running apps

2020-01-13 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014430#comment-17014430 ] Adam Antal commented on YARN-10027: --- TODO: check that using TFile format and rolling log aggregation

[jira] [Commented] (YARN-9989) Typo in CapacityScheduler documentation: Runtime Configuration

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014431#comment-17014431 ] Szilard Nemeth commented on YARN-9989: -- Hi [~pingsutw]! Patch LGTM, committed to trunk. Thanks

[jira] [Updated] (YARN-9989) Typo in CapacityScheduler documentation: Runtime Configuration

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9989: - Fix Version/s: 3.3.0 > Typo in CapacityScheduler documentation: Runtime Configuration >

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-13 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014452#comment-17014452 ] Szilard Nemeth commented on YARN-9970: -- Hi [~maniraj...@gmail.com]! Patch does not apply to trunk.

[jira] [Commented] (YARN-9292) Implement logic to keep docker image consistent in application that uses :latest tag

2020-01-13 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014687#comment-17014687 ] Eric Yang commented on YARN-9292: - [~ebadger] {quote}the image wouldn't have been pulled to that node

[jira] [Commented] (YARN-9970) Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping

2020-01-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014595#comment-17014595 ] Hadoop QA commented on YARN-9970: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10082) FS-CS converter: disable terminal placement rule checking

2020-01-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014605#comment-17014605 ] Hadoop QA commented on YARN-10082: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9292) Implement logic to keep docker image consistent in application that uses :latest tag

2020-01-13 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014600#comment-17014600 ] Eric Badger commented on YARN-9292: --- {quote} The node might have an old Docker image on it. It would be

[jira] [Commented] (YARN-10083) Provide utility to ask whether an application is in final status

2020-01-13 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014726#comment-17014726 ] Hadoop QA commented on YARN-10083: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-13 Thread Eric Payne (Jira)
Eric Payne created YARN-10084: - Summary: Allow inheritance of max app lifetime / default app lifetime Key: YARN-10084 URL: https://issues.apache.org/jira/browse/YARN-10084 Project: Hadoop YARN

[jira] [Updated] (YARN-8529) Add timeout to RouterWebServiceUtil#invokeRMWebService

2020-01-13 Thread Minni Mittal (Jira)
[ https://issues.apache.org/jira/browse/YARN-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minni Mittal updated YARN-8529: --- Attachment: YARN-8529.v4.patch > Add timeout to RouterWebServiceUtil#invokeRMWebService >