[jira] [Comment Edited] (YARN-8036) Memory Available shows a negative value after running updateNodeResource

2020-06-17 Thread yinghua_zh (Jira)
[ https://issues.apache.org/jira/browse/YARN-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138925#comment-17138925 ] yinghua_zh edited comment on YARN-8036 at 6/18/20, 12:53 AM: - 2020-06-16

[jira] [Commented] (YARN-8036) Memory Available shows a negative value after running updateNodeResource

2020-06-17 Thread yinghua_zh (Jira)
[ https://issues.apache.org/jira/browse/YARN-8036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138925#comment-17138925 ] yinghua_zh commented on YARN-8036: -- 2020-06-16 15:10:16,235 [INFO] [main] |app.DAGAppMaster|: In Session

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138899#comment-17138899 ] Eric Badger commented on YARN-9809: --- I can see pros and cons to both approaches. On the one hand, if the

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138894#comment-17138894 ] Eric Yang commented on YARN-9809: - [~ebadger] Sorry, my statement was not clear. If the script name is

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138892#comment-17138892 ] Eric Badger commented on YARN-9809: --- {noformat:title=NodeHealthScriptRunner.newInstance()} if

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138853#comment-17138853 ] Eric Yang commented on YARN-9809: - [~Jim_Brennan] Thank you for the instruction. I updated my check

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138833#comment-17138833 ] Jim Brennan commented on YARN-9809: --- [~eyang] I believe the health check script output must contain a

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138685#comment-17138685 ] Eric Yang commented on YARN-9809: - [~ebadger] Thank you for the patch. The patch looks very close to

[jira] [Commented] (YARN-10321) Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios

2020-06-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138655#comment-17138655 ] Hadoop QA commented on YARN-10321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-10310) YARN Service - User is able to launch a service with same name

2020-06-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138637#comment-17138637 ] Bilwa S T edited comment on YARN-10310 at 6/17/20, 4:50 PM: Hi [~eyang] I

[jira] [Commented] (YARN-10310) YARN Service - User is able to launch a service with same name

2020-06-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138637#comment-17138637 ] Bilwa S T commented on YARN-10310: -- Hi [~eyang] I could see that ServiceClient#submitapp adds

[jira] [Commented] (YARN-10308) Update javadoc and variable names for keytab in yarn services as it supports filesystems other than hdfs and local file system

2020-06-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138630#comment-17138630 ] Bilwa S T commented on YARN-10308: -- Thanks [~eyang] > Update javadoc and variable names for keytab in

[jira] [Commented] (YARN-10308) Update javadoc and variable names for keytab in yarn services as it supports filesystems other than hdfs and local file system

2020-06-17 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138619#comment-17138619 ] Hudson commented on YARN-10308: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18359 (See

[jira] [Comment Edited] (YARN-10308) Update javadoc and variable names for keytab in yarn services as it supports filesystems other than hdfs and local file system

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138608#comment-17138608 ] Eric Yang edited comment on YARN-10308 at 6/17/20, 4:07 PM: +1 I just

[jira] [Updated] (YARN-10308) Update javadoc and variable names for keytab in yarn services as it supports filesystems other than hdfs and local file system

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-10308: - Fix Version/s: 3.4.0 Target Version/s: 3.4.0 > Update javadoc and variable names for keytab in

[jira] [Comment Edited] (YARN-10310) YARN Service - User is able to launch a service with same name

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138573#comment-17138573 ] Eric Yang edited comment on YARN-10310 at 6/17/20, 3:56 PM: [~BilwaST] The

[jira] [Commented] (YARN-10311) Yarn Service should support obtaining tokens from multiple name services

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138597#comment-17138597 ] Eric Yang commented on YARN-10311: -- [~prabhujoseph] [~kyungwan nam], thank you for your input for

[jira] [Commented] (YARN-10310) YARN Service - User is able to launch a service with same name

2020-06-17 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138573#comment-17138573 ] Eric Yang commented on YARN-10310: -- [~BilwaST] The root cause is the parameter -appTypes unit-test.

[jira] [Commented] (YARN-9460) QueueACLsManager and ReservationsACLManager should not use instanceof checks

2020-06-17 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-9460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138552#comment-17138552 ] Hudáky Márton Gyula commented on YARN-9460: --- +1 (non-binding) > QueueACLsManager and

[jira] [Commented] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138550#comment-17138550 ] Hadoop QA commented on YARN-10281: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10321) Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios

2020-06-17 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10321: -- Attachment: YARN-10321.001.patch > Break down TestUserGroupMappingPlacementRule#testMapping

[jira] [Commented] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138412#comment-17138412 ] Hudson commented on YARN-10281: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18357 (See

[jira] [Commented] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138401#comment-17138401 ] Szilard Nemeth commented on YARN-10281: --- Thanks [~shuzirra] for workin on this! Patch LGTM,

[jira] [Comment Edited] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138401#comment-17138401 ] Szilard Nemeth edited comment on YARN-10281 at 6/17/20, 12:37 PM: --

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10281: -- Fix Version/s: 3.3.1 3.4.0 > Redundant QueuePath usage in

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-06-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138388#comment-17138388 ] Peter Bacsko commented on YARN-9930: So after talkin about the problems over voice chat, here is our

[jira] [Assigned] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-10281: - Assignee: Adam Antal (was: Gergely Pollak) > Redundant QueuePath usage in

[jira] [Assigned] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-10281: - Assignee: Gergely Pollak (was: Adam Antal) > Redundant QueuePath usage in

[jira] [Updated] (YARN-10321) Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios

2020-06-17 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10321: -- Description:

[jira] [Created] (YARN-10321) Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios

2020-06-17 Thread Szilard Nemeth (Jira)
Szilard Nemeth created YARN-10321: - Summary: Break down TestUserGroupMappingPlacementRule#testMapping into test scenarios Key: YARN-10321 URL: https://issues.apache.org/jira/browse/YARN-10321

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2020-06-17 Thread Gergely Pollak (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-10281: -- Attachment: YARN-10281.branch-3.3.001.patch > Redundant QueuePath usage in

[jira] [Assigned] (YARN-10320) Replace FSDataInputStream#read with readFully in Log Aggregation

2020-06-17 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-10320: Assignee: Tanu Ajmera > Replace FSDataInputStream#read with readFully in Log Aggregation

[jira] [Created] (YARN-10320) Replace FSDataInputStream#read with readFully in Log Aggregation

2020-06-17 Thread Prabhu Joseph (Jira)
Prabhu Joseph created YARN-10320: Summary: Replace FSDataInputStream#read with readFully in Log Aggregation Key: YARN-10320 URL: https://issues.apache.org/jira/browse/YARN-10320 Project: Hadoop YARN

[jira] [Updated] (YARN-8106) Update LogAggregationIndexedFileController to use readFully instead read to avoid IOException while loading log meta

2020-06-17 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-8106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8106: Summary: Update LogAggregationIndexedFileController to use readFully instead read to avoid

[jira] [Commented] (YARN-10311) Yarn Service should support obtaining tokens from multiple name services

2020-06-17 Thread kyungwan nam (Jira)
[ https://issues.apache.org/jira/browse/YARN-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138226#comment-17138226 ] kyungwan nam commented on YARN-10311: - Hi, I've met same issue in YARN-9905. I wanted to seperate the

[jira] [Commented] (YARN-10311) Yarn Service should support obtaining tokens from multiple name services

2020-06-17 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138189#comment-17138189 ] Prabhu Joseph commented on YARN-10311: -- Hi [~eyang], [~BilwaST] Have faced same issue. This issue

[jira] [Commented] (YARN-10311) Yarn Service should support obtaining tokens from multiple name services

2020-06-17 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138170#comment-17138170 ] Bilwa S T commented on YARN-10311: -- Hi [~eyang] I had set "yarn.nodemanager.remote-app-log-dir" to