[jira] [Created] (YARN-8446) Support of managing multi-dimensional resources

2018-06-21 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8446: - Summary: Support of managing multi-dimensional resources Key: YARN-8446 URL: https://issues.apache.org/jira/browse/YARN-8446 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-8446) Support of managing multi-dimensional resources

2018-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8446: -- Description: To better support long running jobs and services, we need to extend YARN to support other

[jira] [Updated] (YARN-8446) Support of managing multi-dimensional resources

2018-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8446: -- Description: To better support long running jobs and services, we need to extend YARN to support other

[jira] [Updated] (YARN-8446) Support of managing multi-dimensional resources

2018-06-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8446: -- Description: To better support long running jobs and services, we need to extend YARN to support other

[jira] [Updated] (YARN-8103) Add CLI interface to query node attributes

2018-06-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8103: --- Attachment: YARN-8103-YARN-3409.005.patch > Add CLI interface to query node attributes >

[jira] [Commented] (YARN-8103) Add CLI interface to query node attributes

2018-06-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519051#comment-16519051 ] Bibin A Chundatt commented on YARN-8103: [~Naganarasimha] Attached updated patch with new line

[jira] [Comment Edited] (YARN-8103) Add CLI interface to query node attributes

2018-06-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519051#comment-16519051 ] Bibin A Chundatt edited comment on YARN-8103 at 6/21/18 8:10 AM: -

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

2018-06-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519002#comment-16519002 ] Bibin A Chundatt commented on YARN-8434: cc: [~giovanni.fumarola] > Nodemanager not registering

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519313#comment-16519313 ] genericqa commented on YARN-8438: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8103) Add CLI interface to query node attributes

2018-06-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519335#comment-16519335 ] genericqa commented on YARN-8103: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7451) Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7451: - Attachment: YARN-7451.015.patch > Add missing tests to verify the presence of custom resources of

[jira] [Updated] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8438: - Attachment: YARN-8438.002.patch > TestContainer.testKillOnNew flaky on trunk >

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519245#comment-16519245 ] Szilard Nemeth commented on YARN-8438: -- Hi [~szegedim]! Thanks for your comments. Indeed, the name

[jira] [Updated] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8438: - Attachment: (was: YARN-8438.002.patch) > TestContainer.testKillOnNew flaky on trunk >

[jira] [Updated] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8438: - Attachment: YARN-8438.002.patch > TestContainer.testKillOnNew flaky on trunk >

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519408#comment-16519408 ] Szilard Nemeth commented on YARN-6966: -- Hi [~fly_in_gis]! Do you mind if I take this over as I want

[jira] [Commented] (YARN-7451) Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519218#comment-16519218 ] Szilard Nemeth commented on YARN-7451: -- Hi [~rkanter]! Thanks for your comments. # Test failure is

[jira] [Commented] (YARN-7451) Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints

2018-06-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519352#comment-16519352 ] genericqa commented on YARN-7451: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7514) TestAggregatedLogDeletionService.testRefreshLogRetentionSettings is flaky

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7514: Assignee: Szilard Nemeth >

[jira] [Assigned] (YARN-7748) TestContainerResizing.testIncreaseContainerUnreservedWhenApplicationCompleted failed

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7748: Assignee: Szilard Nemeth >

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6966: - Attachment: YARN-6966.004.patch > NodeManager metrics may return wrong negative values when NM

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-06-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519562#comment-16519562 ] Eric Payne commented on YARN-4606: -- [~maniraj...@gmail.com], I am fine with using this JIRA to fix the

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6966: - Attachment: YARN-6966.004.patch > NodeManager metrics may return wrong negative values when NM

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6966: - Attachment: (was: YARN-6966.004.patch) > NodeManager metrics may return wrong negative values

[jira] [Commented] (YARN-8445) YARN native service doesn't allow service name equals to component name

2018-06-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519484#comment-16519484 ] Eric Yang commented on YARN-8445: - +1 looks good to me.   > YARN native service doesn't allow service

[jira] [Commented] (YARN-8445) YARN native service doesn't allow service name equals to component name

2018-06-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519527#comment-16519527 ] Hudson commented on YARN-8445: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14459 (See

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519536#comment-16519536 ] Szilard Nemeth commented on YARN-6966: -- Hi [~fly_in_gis]! See my updated patch. I wanted to pass

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-06-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519599#comment-16519599 ] genericqa commented on YARN-6966: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7300) DiskValidator is not used in LocalDirAllocator

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7300: Assignee: Szilard Nemeth > DiskValidator is not used in LocalDirAllocator >

[jira] [Assigned] (YARN-7456) TestAMRMClient.testAMRMClientWithContainerResourceChange[0] failed

2018-06-21 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-7456: Assignee: Szilard Nemeth > TestAMRMClient.testAMRMClientWithContainerResourceChange[0]

[jira] [Commented] (YARN-8444) NodeResourceMonitor crashes on bad swapFree value

2018-06-21 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519549#comment-16519549 ] Jim Brennan commented on YARN-8444: --- [~eepayne], can you please review?   > NodeResourceMonitor

[jira] [Created] (YARN-8447) Support configurable IPC mode in docker runtime

2018-06-21 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-8447: Summary: Support configurable IPC mode in docker runtime Key: YARN-8447 URL: https://issues.apache.org/jira/browse/YARN-8447 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8448) AM HTTPS Support

2018-06-21 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-8448: --- Summary: AM HTTPS Support Key: YARN-8448 URL: https://issues.apache.org/jira/browse/YARN-8448 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Created] (YARN-8449) RM HA for AM HTTPS Support

2018-06-21 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-8449: --- Summary: RM HA for AM HTTPS Support Key: YARN-8449 URL: https://issues.apache.org/jira/browse/YARN-8449 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6586) YARN to facilitate HTTPS in AM web server

2018-06-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519751#comment-16519751 ] Robert Kanter commented on YARN-6586: - Created subtasks: # YARN-8448: to do the certificate generation

[jira] [Commented] (YARN-8412) Move ResourceRequest.clone logic everywhere into a proper API

2018-06-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519935#comment-16519935 ] Botong Huang commented on YARN-8412: Great, thx [~elgoiri]! > Move ResourceRequest.clone logic

[jira] [Assigned] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-06-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri reassigned YARN-1013: - Assignee: Weiwei Yang (was: Arun C Murthy) > CS should watch resource utilization of containers

[jira] [Commented] (YARN-8412) Move ResourceRequest.clone logic everywhere into a proper API

2018-06-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519907#comment-16519907 ] Hudson commented on YARN-8412: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14461 (See

[jira] [Commented] (YARN-8412) Move ResourceRequest.clone logic everywhere into a proper API

2018-06-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519904#comment-16519904 ] Íñigo Goiri commented on YARN-8412: --- Thanks [~botong] for the patch. Committed to trunk and branch-2. >

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

2018-06-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519861#comment-16519861 ] Miklos Szegedi commented on YARN-8438: -- Thank you for the patch [~snemeth]. This will still return

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-06-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519860#comment-16519860 ] Haibo Chen commented on YARN-1013: -- [~cheersyang] FYI, there is YARN-6794 that does container promotion

[jira] [Commented] (YARN-8047) RMWebApp make external class pluggable

2018-06-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16519998#comment-16519998 ] genericqa commented on YARN-8047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8435) NullPointerException when client first time connect to Yarn Router

2018-06-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16518950#comment-16518950 ] genericqa commented on YARN-8435: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||