[jira] [Commented] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-10-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640520#comment-16640520 ] Szilard Nemeth commented on YARN-8659: -- Thanks [~haibochen] for your comments. Both issues are fixed.

[jira] [Commented] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-10-06 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640584#comment-16640584 ] Szilard Nemeth commented on YARN-8659: -- patch004 fixes a unit test failre, that was introduced with

[jira] [Updated] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-10-06 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8659: - Attachment: YARN-8659.005.patch > RMWebServices returns only RUNNING apps when filtered with

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-06 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.005.patch > Update QueueMetrics with custom resource values >

[jira] [Comment Edited] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-01 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634630#comment-16634630 ] Szilard Nemeth edited comment on YARN-8732 at 10/1/18 9:01 PM: --- As the

[jira] [Commented] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-01 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634630#comment-16634630 ] Szilard Nemeth commented on YARN-8732: -- As the testcases in {{ApplicationMasterService}} were tied to

[jira] [Updated] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-01 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8732: - Attachment: YARN-8732.002.patch > Add unit tests of min/max allocation for custom resource types

[jira] [Updated] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-01 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8732: - Attachment: YARN-8732.003.patch > Add unit tests of min/max allocation for custom resource types

[jira] [Commented] (YARN-8732) Add unit tests of min/max allocation for custom resource types in FairScheduler

2018-10-01 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634665#comment-16634665 ] Szilard Nemeth commented on YARN-8732: -- Patch003 removes {{TestApplicationMasterService}}, this was

[jira] [Commented] (YARN-8621) Add REST API tests for Resource Types fields for the apps/ endpoint

2018-08-30 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16597383#comment-16597383 ] Szilard Nemeth commented on YARN-8621: -- [~shuzirra]: Thanks for the review! Some hints for the

[jira] [Created] (YARN-8732) Create new testcase in TestApplicationMasterService that tests min/max allocation but for FairScheduler

2018-08-30 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8732: Summary: Create new testcase in TestApplicationMasterService that tests min/max allocation but for FairScheduler Key: YARN-8732 URL:

[jira] [Updated] (YARN-8732) Create new testcase in TestApplicationMasterService that tests min/max allocation but for FairScheduler

2018-08-30 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8732: - Attachment: YARN-8732.001.patch > Create new testcase in TestApplicationMasterService that tests

[jira] [Updated] (YARN-8759) Copy of "resource-types.xml" is not deleted if test fails, causes other test failures

2018-09-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8759: - Labels: unit-test (was: ) > Copy of "resource-types.xml" is not deleted if test fails, causes

[jira] [Updated] (YARN-8792) Revisit FairScheduler QueuePlacementPolicy

2018-09-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8792: - Summary: Revisit FairScheduler QueuePlacementPolicy (was: Revisit FiarScheduler

[jira] [Updated] (YARN-8793) QueuePlacementPolicy bind more information to assigning result

2018-09-27 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8793: - Summary: QueuePlacementPolicy bind more information to assigning result (was:

[jira] [Commented] (YARN-8818) Yarn log aggregation of spark streaming job

2018-09-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627337#comment-16627337 ] Szilard Nemeth commented on YARN-8818: -- Hi [~ayushChauhan]! Do you mind if I take this? > Yarn log

[jira] [Updated] (YARN-7291) Better input parsing for resource in allocation file

2018-11-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7291: - Attachment: YARN-7291.001.patch > Better input parsing for resource in allocation file >

[jira] [Updated] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8738: - Attachment: YARN-8738.001.patch > FairScheduler configures maxResources or minResources as

[jira] [Commented] (YARN-8818) Yarn log aggregation of spark streaming job

2018-11-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689796#comment-16689796 ] Szilard Nemeth commented on YARN-8818: -- Hi [~ayushChauhan]! Could you please elaborate on this a

[jira] [Commented] (YARN-7291) Better input parsing for resource in allocation file

2018-11-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689777#comment-16689777 ] Szilard Nemeth commented on YARN-7291: -- The patch001 is based on YARN-8738, so that this Jira is not

[jira] [Updated] (YARN-9213) RM Web UI does not show custom resource allocations for containers page

2019-01-19 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9213: - Attachment: YARN-9213.001.patch > RM Web UI does not show custom resource allocations for

[jira] [Created] (YARN-9213) RM Web UI does not show custom resource allocations for containers page

2019-01-19 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9213: Summary: RM Web UI does not show custom resource allocations for containers page Key: YARN-9213 URL: https://issues.apache.org/jira/browse/YARN-9213 Project: Hadoop

[jira] [Updated] (YARN-7291) Better input parsing for resource in allocation file

2018-12-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7291: - Attachment: YARN-7291.003.patch > Better input parsing for resource in allocation file >

[jira] [Commented] (YARN-7291) Better input parsing for resource in allocation file

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719963#comment-16719963 ] Szilard Nemeth commented on YARN-7291: -- The UT failure is a known flaky:

[jira] [Commented] (YARN-7291) Better input parsing for resource in allocation file

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719968#comment-16719968 ] Szilard Nemeth commented on YARN-7291: -- patch004 fixes the checkstyle issues. > Better input parsing

[jira] [Updated] (YARN-7291) Better input parsing for resource in allocation file

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7291: - Attachment: YARN-7291.004.patch > Better input parsing for resource in allocation file >

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719988#comment-16719988 ] Szilard Nemeth commented on YARN-5106: -- Hi [~kasha]! Do you have time to review this one? Thanks! >

[jira] [Updated] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9118: - Attachment: YARN-9118.002.patch > Handle issues with parsing user defined GPU devives in

[jira] [Created] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-13 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9118: Summary: Handle issues with parsing user defined GPU devives in GpuDiscoverer Key: YARN-9118 URL: https://issues.apache.org/jira/browse/YARN-9118 Project: Hadoop

[jira] [Created] (YARN-9119) Clean up testcase TestGpuDiscoverer.testLinuxGpuResourceDiscoverPluginConfig

2018-12-13 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9119: Summary: Clean up testcase TestGpuDiscoverer.testLinuxGpuResourceDiscoverPluginConfig Key: YARN-9119 URL: https://issues.apache.org/jira/browse/YARN-9119 Project:

[jira] [Created] (YARN-9120) Need to have a way to turn off GPU auto-discovery in GpuDiscoverer

2018-12-13 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9120: Summary: Need to have a way to turn off GPU auto-discovery in GpuDiscoverer Key: YARN-9120 URL: https://issues.apache.org/jira/browse/YARN-9120 Project: Hadoop YARN

[jira] [Updated] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9118: - Attachment: YARN-9118.001.patch > Handle issues with parsing user defined GPU devives in

[jira] [Updated] (YARN-9118) Handle issues with parsing user defined GPU devices in GpuDiscoverer

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9118: - Summary: Handle issues with parsing user defined GPU devices in GpuDiscoverer (was: Handle

[jira] [Commented] (YARN-9099) GpuResourceAllocator.getReleasingGpus calculates number of GPUs in a wrong way

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723882#comment-16723882 ] Szilard Nemeth commented on YARN-9099: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723883#comment-16723883 ] Szilard Nemeth commented on YARN-9100: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9098) Separate mtab file reader code and cgroups file system hierarchy parser code from CGroupsHandlerImpl and ResourceHandlerModule

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723881#comment-16723881 ] Szilard Nemeth commented on YARN-9098: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9123) Clean up and split testcases in TestNMWebServices for GPU support

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723879#comment-16723879 ] Szilard Nemeth commented on YARN-9123: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723874#comment-16723874 ] Szilard Nemeth commented on YARN-9127: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723876#comment-16723876 ] Szilard Nemeth commented on YARN-9140: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9139) Simplify initializer code of GpuDiscoverer

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723870#comment-16723870 ] Szilard Nemeth commented on YARN-9139: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9118) Handle issues with parsing user defined GPU devices in GpuDiscoverer

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723868#comment-16723868 ] Szilard Nemeth commented on YARN-9118: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9121) Users of GpuDiscoverer.getInstance() are not possible to test as instance is a static field

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723867#comment-16723867 ] Szilard Nemeth commented on YARN-9121: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Comment Edited] (YARN-9118) Handle issues with parsing user defined GPU devices in GpuDiscoverer

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723868#comment-16723868 ] Szilard Nemeth edited comment on YARN-9118 at 12/18/18 9:46 AM:

[jira] [Commented] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723872#comment-16723872 ] Szilard Nemeth commented on YARN-9096: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723880#comment-16723880 ] Szilard Nemeth commented on YARN-9092: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723871#comment-16723871 ] Szilard Nemeth commented on YARN-9138: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9128) Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723873#comment-16723873 ] Szilard Nemeth commented on YARN-9128: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723913#comment-16723913 ] Szilard Nemeth commented on YARN-9033: -- Hi [~tangzhankun]! I took an initial look on your

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723877#comment-16723877 ] Szilard Nemeth commented on YARN-9133: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723875#comment-16723875 ] Szilard Nemeth commented on YARN-9134: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2018-12-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723878#comment-16723878 ] Szilard Nemeth commented on YARN-9135: -- [~devaraj.k], [~tangzhankun], [~zyluo], [~sunilg],

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9100: - Attachment: YARN-9100.003.patch > Add tests for GpuResourceAllocator and do minor code cleanup >

[jira] [Updated] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9118: - Attachment: YARN-9118.004.patch > Handle issues with parsing user defined GPU devives in

[jira] [Commented] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723154#comment-16723154 ] Szilard Nemeth commented on YARN-9118: -- Hi [~pbacsko]! Thanks for your review comments! # Fixed the

[jira] [Commented] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-12-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16717874#comment-16717874 ] Szilard Nemeth commented on YARN-9047: -- Hmm jenkins said differently. I don't get how this testcase

[jira] [Updated] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-12-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9047: - Attachment: YARN-9047.003.patch > FairScheduler: default resource calculator is not resource type

[jira] [Commented] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-12-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Szilard Nemeth commented on YARN-9047: -- [~wilfreds]: As discussed offline, we need to use the

[jira] [Commented] (YARN-9093) Remove commented code block from the beginning of TestDefaultContainerExecutor

2018-12-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718535#comment-16718535 ] Szilard Nemeth commented on YARN-9093: -- Hi [~vbmudalige]! Sure, assigned this to you. Btw, you should

[jira] [Assigned] (YARN-9093) Remove commented code block from the beginning of TestDefaultContainerExecutor

2018-12-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9093: Assignee: Vidura Bhathiya Mudalige > Remove commented code block from the beginning of

[jira] [Created] (YARN-9139) Simplify initializer code of GpuDiscoverer

2018-12-16 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9139: Summary: Simplify initializer code of GpuDiscoverer Key: YARN-9139 URL: https://issues.apache.org/jira/browse/YARN-9139 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9139) Simplify initializer code of GpuDiscoverer

2018-12-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9139: - Attachment: YARN-9139.001.patch > Simplify initializer code of GpuDiscoverer >

[jira] [Created] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2018-12-16 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9140: Summary: Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager Key: YARN-9140 URL: https://issues.apache.org/jira/browse/YARN-9140

[jira] [Created] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2018-12-16 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9138: Summary: Test error handling of nvidia-smi binary execution of GpuDiscoverer Key: YARN-9138 URL: https://issues.apache.org/jira/browse/YARN-9138 Project: Hadoop YARN

[jira] [Updated] (YARN-9136) getNMResourceInfo NodeManager REST API method is not documented

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9136: - Description: I cannot find documentation for the resources endpoint in NMWebServices:

[jira] [Updated] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2018-12-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9138: - Attachment: YARN-9138.001.patch > Test error handling of nvidia-smi binary execution of

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2018-12-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9140: - Attachment: YARN-9140.001.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Commented] (YARN-9120) Need to have a way to turn off GPU auto-discovery in GpuDiscoverer

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721009#comment-16721009 ] Szilard Nemeth commented on YARN-9120: -- I see that the designed way to turn off GPU on a specific

[jira] [Updated] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9094: - Labels: newbie newbie++ (was: ) > Remove unused interface method: >

[jira] [Updated] (YARN-9119) Clean up testcase TestGpuDiscoverer.testLinuxGpuResourceDiscoverPluginConfig

2018-12-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9119: - Labels: newbie newbie++ (was: ) > Clean up testcase

[jira] [Created] (YARN-9123) Clean up and split testcases in TestNMWebServices for GPU support

2018-12-14 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9123: Summary: Clean up and split testcases in TestNMWebServices for GPU support Key: YARN-9123 URL: https://issues.apache.org/jira/browse/YARN-9123 Project: Hadoop YARN

[jira] [Created] (YARN-9124) Resolve contradiction in ResourceUtils: addMandatoryResources / checkMandatoryResources work differently

2018-12-14 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9124: Summary: Resolve contradiction in ResourceUtils: addMandatoryResources / checkMandatoryResources work differently Key: YARN-9124 URL:

[jira] [Commented] (YARN-9120) Need to have a way to turn off GPU auto-discovery in GpuDiscoverer

2018-12-14 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16721194#comment-16721194 ] Szilard Nemeth commented on YARN-9120: -- [~tangzhankun]: I agree that the runtime ability of replace

[jira] [Updated] (YARN-9123) Clean up and split testcases in TestNMWebServices for GPU support

2018-12-14 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9123: - Attachment: YARN-9123.001.patch > Clean up and split testcases in TestNMWebServices for GPU

[jira] [Assigned] (YARN-9124) Resolve contradiction in ResourceUtils: addMandatoryResources / checkMandatoryResources work differently

2018-12-14 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9124: Assignee: Alex Bodo > Resolve contradiction in ResourceUtils: addMandatoryResources / >

[jira] [Assigned] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2018-12-14 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9094: Assignee: Alex Bodo > Remove unused interface method: >

[jira] [Assigned] (YARN-9119) Clean up testcase TestGpuDiscoverer.testLinuxGpuResourceDiscoverPluginConfig

2018-12-14 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9119: Assignee: Alex Bodo > Clean up testcase

[jira] [Created] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2018-12-14 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9127: Summary: Create more tests to verify GpuDeviceInformationParser Key: YARN-9127 URL: https://issues.apache.org/jira/browse/YARN-9127 Project: Hadoop YARN

[jira] [Updated] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9118: - Attachment: YARN-9118.003.patch > Handle issues with parsing user defined GPU devives in

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722867#comment-16722867 ] Szilard Nemeth commented on YARN-9134: -- I think the deprecation warnings could be assigned in a

[jira] [Updated] (YARN-9123) Clean up and split testcases in TestNMWebServices for GPU support

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9123: - Attachment: YARN-9123.002.patch > Clean up and split testcases in TestNMWebServices for GPU

[jira] [Updated] (YARN-9099) GpuResourceAllocator.getReleasingGpus calculates number of GPUs in a wrong way

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9099: - Attachment: YARN-9099.002.patch > GpuResourceAllocator.getReleasingGpus calculates number of GPUs

[jira] [Commented] (YARN-9094) Remove unused interface method: NodeResourceUpdaterPlugin#handleUpdatedResourceFromRM

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722845#comment-16722845 ] Szilard Nemeth commented on YARN-9094: -- Hi [~alex.bodo]! Thanks for your patch! LGTM, +1

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722868#comment-16722868 ] Szilard Nemeth commented on YARN-9133: -- Re-uploading the patch as build haven't kicked off. > Make

[jira] [Commented] (YARN-9098) Separate mtab file reader code and cgroups file system hierarchy parser code from CGroupsHandlerImpl and ResourceHandlerModule

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722927#comment-16722927 ] Szilard Nemeth commented on YARN-9098: -- Patch003 is fixing the checkstyle issues, except the ones

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9127: - Attachment: YARN-9127.002.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722866#comment-16722866 ] Szilard Nemeth commented on YARN-9127: -- patch002 fixes the XML indentations, replacing tabs with 4

[jira] [Updated] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9133: - Attachment: YARN-9133.001.patch > Make tests more easy to comprehend in TestGpuResourceHandler >

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722869#comment-16722869 ] Szilard Nemeth commented on YARN-9135: -- I haven't touched the code that generated the checkstyle

[jira] [Commented] (YARN-9123) Clean up and split testcases in TestNMWebServices for GPU support

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722886#comment-16722886 ] Szilard Nemeth commented on YARN-9123: -- Patch002 is fixing the checkstyle issue. > Clean up and

[jira] [Updated] (YARN-9098) Separate mtab file reader code and cgroups file system hierarchy parser code from CGroupsHandlerImpl and ResourceHandlerModule

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9098: - Attachment: YARN-9098.003.patch > Separate mtab file reader code and cgroups file system

[jira] [Commented] (YARN-9118) Handle issues with parsing user defined GPU devives in GpuDiscoverer

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722864#comment-16722864 ] Szilard Nemeth commented on YARN-9118: -- Patch003 is fixing the checkstyle issues. > Handle issues

[jira] [Commented] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722896#comment-16722896 ] Szilard Nemeth commented on YARN-9092: -- Patch002 is fixing the checkstyle issue. > Create an object

[jira] [Updated] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9092: - Attachment: YARN-9092.002.patch > Create an object for cgroups mount enable and cgroups mount

[jira] [Commented] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722998#comment-16722998 ] Szilard Nemeth commented on YARN-9092: -- patch 003 fixes the compilation errors in

[jira] [Updated] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9133: - Attachment: YARN-9133.002.patch > Make tests more easy to comprehend in TestGpuResourceHandler >

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9100: - Attachment: YARN-9100.002.patch > Add tests for GpuResourceAllocator and do minor code cleanup >

[jira] [Updated] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9092: - Attachment: YARN-9092.003.patch > Create an object for cgroups mount enable and cgroups mount

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723003#comment-16723003 ] Szilard Nemeth commented on YARN-9133: -- Thanks [~pbacsko] for your review comments! 1. No it's not a

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723139#comment-16723139 ] Szilard Nemeth commented on YARN-9100: -- patch003 fixes the compilation error. > Add tests for

[jira] [Commented] (YARN-9092) Create an object for cgroups mount enable and cgroups mount path as they belong together

2018-12-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723145#comment-16723145 ] Szilard Nemeth commented on YARN-9092: -- UT failure seems unrelated > Create an object for cgroups

<    2   3   4   5   6   7   8   9   10   11   >