[jira] [Commented] (YARN-9701) Yarn service cli commands do not connect to ssl enabled RM using ssl-client.xml configs

2019-08-09 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904321#comment-16904321 ] Tarun Parimi commented on YARN-9701: Thanks [~Prabhu Joseph] for reviewing the patch. Attaching a new

[jira] [Updated] (YARN-9701) Yarn service cli commands do not connect to ssl enabled RM using ssl-client.xml configs

2019-08-09 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9701: --- Attachment: YARN-9701.002.patch > Yarn service cli commands do not connect to ssl enabled RM using >

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904311#comment-16904311 ] Hadoop QA commented on YARN-9719: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904308#comment-16904308 ] Hadoop QA commented on YARN-9730: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-9719: --- Attachment: YARN-9719.007.patch > Failed to restart yarn-service if it doesn’t exist in RM >

[jira] [Updated] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

2019-08-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9698: - Target Version/s: 3.3.0 > [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler >

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-09 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904280#comment-16904280 ] Jonathan Hung commented on YARN-9730: - Attached 001 patch. 1a and 1b are handled in

[jira] [Updated] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-09 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9730: Description: Use case: queue X has all of its workload in non-default (exclusive) partition P (by

[jira] [Updated] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-09 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9730: Attachment: YARN-9730.001.patch > Support forcing configured partitions to be exclusive based on

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904256#comment-16904256 ] Eric Yang commented on YARN-9442: - [~ebadger] [~Jim_Brennan] Thank you for the confirmation. > container

[jira] [Commented] (YARN-6539) Create SecureLogin inside Router

2019-08-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904254#comment-16904254 ] Subru Krishnan commented on YARN-6539: -- [~yifan.stan], great to hear that you are running Federation

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904219#comment-16904219 ] Eric Badger commented on YARN-9564: --- The skopeo error looks to be because {{XDG_RUNTIME_DIR}} is set to

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904218#comment-16904218 ] Jim Brennan commented on YARN-9442: --- [~eyang], [~ebadger] thanks for the discussion.  I have tested on a

[jira] [Commented] (YARN-9708) Add Yarnclient#getDelegationToken API implementation and SecureLogin in router

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904212#comment-16904212 ] Hadoop QA commented on YARN-9708: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-9708) Add Yarnclient#getDelegationToken API implementation and SecureLogin in router

2019-08-09 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned YARN-9708: - Assignee: Xie YiFan > Add Yarnclient#getDelegationToken API implementation and

[jira] [Created] (YARN-9736) Recursively configure app ordering policies

2019-08-09 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9736: --- Summary: Recursively configure app ordering policies Key: YARN-9736 URL: https://issues.apache.org/jira/browse/YARN-9736 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-9718) Yarn REST API, services endpoint remote command ejection

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904201#comment-16904201 ] Hadoop QA commented on YARN-9718: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904188#comment-16904188 ] Eric Yang commented on YARN-9564: - If I added sudo to skopeo, the script only fail on removing temp

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904182#comment-16904182 ] Eric Yang commented on YARN-9564: - [~ebadger] Thank for the patch 003.  The script seems to progress

[jira] [Commented] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-08-09 Thread Thomas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904179#comment-16904179 ] Thomas commented on YARN-9728: -- Hi Prabhu Joseph, I didn't plan to submit a patch, so sure you can work on

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904172#comment-16904172 ] Eric Badger commented on YARN-9442: --- YARN-88 gives some relevant discussion based on the permissions in

[jira] [Commented] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-08-09 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904170#comment-16904170 ] Prabhu Joseph commented on YARN-9728: - Hi [~tde], Thanks for the detailed description. Do you want to

[jira] [Created] (YARN-9735) Allow User Keytab to submit YARN Native Service

2019-08-09 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9735: --- Summary: Allow User Keytab to submit YARN Native Service Key: YARN-9735 URL: https://issues.apache.org/jira/browse/YARN-9735 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-9734) LogAggregationIndexedFileController fails to upload logs in rolling fashion

2019-08-09 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9734: --- Summary: LogAggregationIndexedFileController fails to upload logs in rolling fashion Key: YARN-9734 URL: https://issues.apache.org/jira/browse/YARN-9734 Project:

[jira] [Commented] (YARN-9718) Yarn REST API, services endpoint remote command ejection

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904167#comment-16904167 ] Eric Yang commented on YARN-9718: - Patch 004 fixed checkstyle issues from patch 003. > Yarn REST API,

[jira] [Updated] (YARN-9718) Yarn REST API, services endpoint remote command ejection

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9718: Attachment: YARN-9718.004.patch > Yarn REST API, services endpoint remote command ejection >

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904159#comment-16904159 ] Eric Yang commented on YARN-9442: - [~Jim_Brennan] I agree with you regarding read permission.  Sorry, I

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904142#comment-16904142 ] Jim Brennan commented on YARN-9442: --- [~eyang] read permission is needed for directory listing.  execute

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904140#comment-16904140 ] Eric Yang commented on YARN-9442: - [~Jim_Brennan] I could be wrong, but I thought the group executable

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904139#comment-16904139 ] Hadoop QA commented on YARN-6492: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904132#comment-16904132 ] Jim Brennan commented on YARN-9442: --- I am actually testing out a change - [~ebadger] and I discussed

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904131#comment-16904131 ] Eric Yang commented on YARN-9442: - +1 for commit and back port. > container working directory has group

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904118#comment-16904118 ] Eric Badger commented on YARN-9442: --- [~Jim_Brennan], [~eyang], [~shaneku...@gmail.com], [~jeagles], what

[jira] [Commented] (YARN-9527) Rogue LocalizerRunner/ContainerLocalizer repeatedly downloading same file

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904112#comment-16904112 ] Hudson commented on YARN-9527: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17078 (See

[jira] [Commented] (YARN-9527) Rogue LocalizerRunner/ContainerLocalizer repeatedly downloading same file

2019-08-09 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904109#comment-16904109 ] Jim Brennan commented on YARN-9527: --- Thanks [~eyang] and [~ebadger]! > Rogue

[jira] [Commented] (YARN-9527) Rogue LocalizerRunner/ContainerLocalizer repeatedly downloading same file

2019-08-09 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904104#comment-16904104 ] Eric Badger commented on YARN-9527: --- Thanks, [~eyang]! > Rogue LocalizerRunner/ContainerLocalizer

[jira] [Commented] (YARN-9732) yarn.system-metrics-publisher.enabled=false is not honored by RM

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904045#comment-16904045 ] Hudson commented on YARN-9732: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17077 (See

[jira] [Commented] (YARN-9732) yarn.system-metrics-publisher.enabled=false is not honored by RM

2019-08-09 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904037#comment-16904037 ] Abhishek Modi commented on YARN-9732: - Thanks [~magnum] for patch and [~Prabhu Joseph] for review.

[jira] [Updated] (YARN-9732) yarn.system-metrics-publisher.enabled=false is not honored by RM

2019-08-09 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9732: Summary: yarn.system-metrics-publisher.enabled=false is not honored by RM (was:

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2019-08-09 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6492: --- Attachment: YARN-6492.005.WIP.patch > Generate queue metrics for each partition >

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-08-09 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904027#comment-16904027 ] Manikandan R commented on YARN-6492: Ok, [~eepayne]. Will look into this. Some observations on

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904018#comment-16904018 ] Hadoop QA commented on YARN-9719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903989#comment-16903989 ] Hadoop QA commented on YARN-8586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-9719: --- Attachment: YARN-9719.006.patch > Failed to restart yarn-service if it doesn’t exist in RM >

[jira] [Updated] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-9719: --- Attachment: (was: YARN-9719.006.patch) > Failed to restart yarn-service if it doesn’t exist in RM

[jira] [Updated] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-9719: --- Attachment: YARN-9719.006.patch > Failed to restart yarn-service if it doesn’t exist in RM >

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903963#comment-16903963 ] Abhishek Modi commented on YARN-9731: - Thanks [~magnum] for the patch. Thanks [~Prabhu Joseph] for

[jira] [Commented] (YARN-9732) yarn.system-metrics-publisher.enabled=false does not work

2019-08-09 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903961#comment-16903961 ] Abhishek Modi commented on YARN-9732: - Thanks [~magnum] for the patch. I will commit it in couple of

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.003.patch > Extract log aggregation related fields and methods from RMAppImpl >

[jira] [Commented] (YARN-7721) TestContinuousScheduling fails sporadically with NPE

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903848#comment-16903848 ] Hadoop QA commented on YARN-7721: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-08-09 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903827#comment-16903827 ] Prabhu Joseph commented on YARN-8199: - Thanks [~snemeth]. > Logging fileSize of log files under NM

[jira] [Updated] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8199: - Hadoop Flags: Reviewed > Logging fileSize of log files under NM Local Dir >

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903820#comment-16903820 ] Szilard Nemeth commented on YARN-8199: -- Hi [~Prabhu Joseph]]! Thanks for the other patches, commited

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903816#comment-16903816 ] Hadoop QA commented on YARN-9217: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903807#comment-16903807 ] Hadoop QA commented on YARN-9134: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903805#comment-16903805 ] Peter Bacsko commented on YARN-9133: [~snemeth] similarly to YARN-9140, conflict resolution might not

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903802#comment-16903802 ] Peter Bacsko commented on YARN-9140: [~snemeth] there are already 4 commits difference between trunk

[jira] [Commented] (YARN-9715) [UI2] yarn-container-log URI need to be encoded to avoid potential misuses

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903800#comment-16903800 ] Hudson commented on YARN-9715: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17073 (See

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903792#comment-16903792 ] Hadoop QA commented on YARN-9731: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9729) [UI2] Fix error message for logs without ATSv2

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903787#comment-16903787 ] Hadoop QA commented on YARN-9729: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.008.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Commented] (YARN-9692) ContainerAllocationExpirer is missspelled

2019-08-09 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903782#comment-16903782 ] Adam Antal commented on YARN-9692: -- Hi [~runzhouwu], Thanks for filing this issue. To be honest, it

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903776#comment-16903776 ] Hadoop QA commented on YARN-9217: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7721) TestContinuousScheduling fails sporadically with NPE

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903773#comment-16903773 ] Szilard Nemeth commented on YARN-7721: -- Hi [~sunilg]! Would you reupload the latest patch? If we have

[jira] [Commented] (YARN-9729) [UI2] Fix error message for logs without ATSv2

2019-08-09 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903768#comment-16903768 ] Akhil PB commented on YARN-9729: [~zsiegl] Could you please use follow code snippet in

[jira] [Updated] (YARN-9729) [UI2] Fix error message for logs without ATSv2

2019-08-09 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-9729: --- Attachment: Screenshot 2019-08-09 at 3.22.19 PM.png > [UI2] Fix error message for logs without ATSv2 >

[jira] [Commented] (YARN-9124) Resolve contradiction in ResourceUtils: addMandatoryResources / checkMandatoryResources work differently

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903761#comment-16903761 ] Szilard Nemeth commented on YARN-9124: -- Hi [~adam.antal]! Thanks for the latest patches for other

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903741#comment-16903741 ] Peter Bacsko commented on YARN-9134: Uploaded patch v4. _"Also, setupResourceTypes has been

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.004.patch > No test coverage for redefining FPGA / GPU resource types in

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903739#comment-16903739 ] Hadoop QA commented on YARN-9719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903737#comment-16903737 ] Hadoop QA commented on YARN-9217: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903706#comment-16903706 ] KWON BYUNGCHANG edited comment on YARN-9731 at 8/9/19 8:38 AM: --- [~Prabhu

[jira] [Updated] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KWON BYUNGCHANG updated YARN-9731: -- Attachment: YARN-9731.002.patch > In ATS v1.5, all jobs are visible to all users without

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903706#comment-16903706 ] KWON BYUNGCHANG commented on YARN-9731: --- [~Prabhu Joseph] I've attaced patch fixed testcases. > In

[jira] [Commented] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903703#comment-16903703 ] Hudson commented on YARN-9092: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17071 (See

[jira] [Commented] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903700#comment-16903700 ] Hudson commented on YARN-9727: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17071 (See

[jira] [Commented] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903701#comment-16903701 ] Hudson commented on YARN-9094: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17071 (See

[jira] [Commented] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-08-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903702#comment-16903702 ] Hudson commented on YARN-9096: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17071 (See

[jira] [Commented] (YARN-9723) ApplicationPlacementContext is not required for terminated jobs during recovery

2019-08-09 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903698#comment-16903698 ] Prabhu Joseph commented on YARN-9723: - Thanks [~adam.antal] for reviewing. [~snemeth] Can you review

[jira] [Commented] (YARN-9722) PlacementRule logs object ID in place of queue name.

2019-08-09 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903699#comment-16903699 ] Prabhu Joseph commented on YARN-9722: - Thanks [~sunilg] for reviewing. [~snemeth] Can you review and

[jira] [Commented] (YARN-9723) ApplicationPlacementContext is not required for terminated jobs during recovery

2019-08-09 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903696#comment-16903696 ] Adam Antal commented on YARN-9723: -- This patch looks straightforward. +1 (non-binding) >

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903692#comment-16903692 ] Szilard Nemeth commented on YARN-9134: -- Hi [~pbacsko]! Could you please check the javac issue above?

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.007.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Updated] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9096: - Fix Version/s: 3.1.3 3.2.1 3.3.0 > Some GpuResourcePlugin

[jira] [Updated] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9094: - Fix Version/s: 3.1.3 3.2.1 3.3.0 > Remove unused interface

[jira] [Commented] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903688#comment-16903688 ] Szilard Nemeth commented on YARN-9092: -- Hi [~shuzirra]]! Thanks for this patch, committed to trunk,

[jira] [Commented] (YARN-9729) [UI2] Fix error message for logs without ATSv2

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903687#comment-16903687 ] Hadoop QA commented on YARN-9729: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9732) yarn.system-metrics-publisher.enabled=false does not work

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903685#comment-16903685 ] Hadoop QA commented on YARN-9732: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9681) AM resource limit is incorrect for queue

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903679#comment-16903679 ] Hadoop QA commented on YARN-9681: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903678#comment-16903678 ] Szilard Nemeth commented on YARN-9096: -- Hi [[~shuzirra]! Thanks for the latest patch, committed to

[jira] [Commented] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903672#comment-16903672 ] Szilard Nemeth commented on YARN-9094: -- Hi [~shuzirra]! Thanks for this patch! +1 committed to trunk,

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903665#comment-16903665 ] Szilard Nemeth commented on YARN-9217: -- Hi [~pbacsko]! Please fix the checkstyle, findbugs and unit

[jira] [Commented] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903657#comment-16903657 ] Szilard Nemeth commented on YARN-9727: -- Hi [~zsiegl]! Committed to trunk! Please verify if we need

[jira] [Commented] (YARN-9733) Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0 when subprocess of container dead

2019-08-09 Thread qian han (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903658#comment-16903658 ] qian han commented on YARN-9733: Thanks > Method getCpuUsagePercent in Class ProcfsBasedProcessTree

[jira] [Commented] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903654#comment-16903654 ] Szilard Nemeth commented on YARN-9727: -- Hi [~zsiegl]! +1, committing this soon. > Allowed Origin

[jira] [Commented] (YARN-9729) [UI2] Fix error message for logs without ATSv2

2019-08-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903650#comment-16903650 ] Szilard Nemeth commented on YARN-9729: -- Hi [~zsiegl]! I will start to review this once we have a

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903648#comment-16903648 ] Prabhu Joseph commented on YARN-9731: - [~magnum] Failed testcases are related, can you fix the same.

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903626#comment-16903626 ] Hadoop QA commented on YARN-9731: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-09 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-9719: --- Attachment: YARN-9719.005.patch > Failed to restart yarn-service if it doesn’t exist in RM >

[jira] [Updated] (YARN-9715) [UI2] yarn-container-log URI need to be encoded to avoid potential misuses

2019-08-09 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-9715: - Summary: [UI2] yarn-container-log URI need to be encoded to avoid potential misuses (was: [YARN

  1   2   >