[jira] [Reopened] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reopened YARN-9552: > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934080#comment-16934080 ] Peter Bacsko commented on YARN-9552: [~Steven Rand] it shouldn't be a big deal to create patches that

[jira] [Updated] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9840: --- Summary: Capacity scheduler: add support for Secondary Group rule mapping (was: Capacity scheduler:

[jira] [Created] (YARN-9841) Capacity scheduler: add support for combined %user + %primary_group mapping

2019-09-19 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9841: -- Summary: Capacity scheduler: add support for combined %user + %primary_group mapping Key: YARN-9841 URL: https://issues.apache.org/jira/browse/YARN-9841 Project: Hadoop

[jira] [Updated] (YARN-9840) Capacity scheduler: add support for Secondary Group user mapping

2019-09-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9840: --- Component/s: capacity scheduler > Capacity scheduler: add support for Secondary Group user mapping >

[jira] [Created] (YARN-9840) Capacity scheduler: add support for Secondary Group user mapping

2019-09-19 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9840: -- Summary: Capacity scheduler: add support for Secondary Group user mapping Key: YARN-9840 URL: https://issues.apache.org/jira/browse/YARN-9840 Project: Hadoop YARN

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-18 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932170#comment-16932170 ] Peter Bacsko commented on YARN-9011: [~adam.antal] absolutely, this patch needs some explanation - it

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-004.patch > Race condition during decommissioning >

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-003.patch > Race condition during decommissioning >

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: (was: YARN-9011-003.patch) > Race condition during decommissioning >

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-003.patch > Race condition during decommissioning >

[jira] [Updated] (YARN-9833) Race condition when DirectoryCollection.checkDirs() runs during container launch

2019-09-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9833: --- Attachment: YARN-9833-001.patch > Race condition when DirectoryCollection.checkDirs() runs during

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929234#comment-16929234 ] Peter Bacsko commented on YARN-9011: Uploaded v2, it's still considered to be a POC. > Race condition

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-13 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-002.patch > Race condition during decommissioning >

[jira] [Created] (YARN-9833) Race condition when DirectoryCollection.checkDirs() runs during container launch

2019-09-12 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-9833: -- Summary: Race condition when DirectoryCollection.checkDirs() runs during container launch Key: YARN-9833 URL: https://issues.apache.org/jira/browse/YARN-9833 Project:

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928981#comment-16928981 ] Peter Bacsko commented on YARN-6715: ping [~szegedim] > Fix documentation about

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928826#comment-16928826 ] Peter Bacsko commented on YARN-9011: Ignore patch v1, it's not enough. The proper solution is more

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Attachment: YARN-9011-001.patch > Race condition during decommissioning >

[jira] [Updated] (YARN-9011) Race condition during decommissioning

2019-09-12 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9011: --- Component/s: nodemanager > Race condition during decommissioning >

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1691#comment-1691 ] Peter Bacsko commented on YARN-6715: [~szegedim] yes, that's fine. > Fix documentation about

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-09-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921218#comment-16921218 ] Peter Bacsko commented on YARN-9477: [~jojochuang] thanks for informing me about this and following-up

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-02 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920762#comment-16920762 ] Peter Bacsko commented on YARN-6715: [~miklos.szeg...@cloudera.com] can I ask you to review & commit?

[jira] [Commented] (YARN-9699) Migration tool that help to generate CS configs based on FS

2019-08-29 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918549#comment-16918549 ] Peter Bacsko commented on YARN-9699: Just add some extra thoughts: the tool would work similarly to

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-08-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-003.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-08-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-002.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-08-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Attachment: YARN-6715-001.patch > Fix documentation about NodeHealthScriptRunner >

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-08-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Component/s: documentation > Fix documentation about NodeHealthScriptRunner >

[jira] [Comment Edited] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917691#comment-16917691 ] Peter Bacsko edited comment on YARN-9290 at 8/28/19 11:20 AM: -- Some minor

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-28 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917691#comment-16917691 ] Peter Bacsko commented on YARN-9290: Some minor comments: {code} public List

[jira] [Commented] (YARN-9786) testCancelledDelegationToken fails intermittently

2019-08-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915916#comment-16915916 ] Peter Bacsko commented on YARN-9786: [~adam.antal] this is a duplicate of YARN-9461. It's been solved

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-16 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.branch-3.2.001.patch > Nodemanager will fail to start if GPU is misconfigured

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-16 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.012.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-08-16 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100.branch-3.2.002.patch > Add tests for GpuResourceAllocator and do minor code

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-08-16 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908905#comment-16908905 ] Peter Bacsko commented on YARN-9100: Branch-3.1 failures are due to compilation errors. Fixed in

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-08-16 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100.branch-3.1.002.patch > Add tests for GpuResourceAllocator and do minor code

[jira] [Commented] (YARN-9749) TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908384#comment-16908384 ] Peter Bacsko commented on YARN-9749: +1 non-binding > TestAppLogAggregatorImpl#testDFSQuotaExceeded

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100-009.patch > Add tests for GpuResourceAllocator and do minor code cleanup >

[jira] [Created] (YARN-9749) TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk

2019-08-15 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9749: -- Summary: TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk Key: YARN-9749 URL: https://issues.apache.org/jira/browse/YARN-9749 Project: Hadoop YARN

[jira] [Updated] (YARN-9749) TestAppLogAggregatorImpl#testDFSQuotaExceeded fails on trunk

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9749: --- Component/s: (was: yarn) test log-aggregation >

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.011.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: (was: YARN-9217.011.patch) > Nodemanager will fail to start if GPU is misconfigured

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.011.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907985#comment-16907985 ] Peter Bacsko commented on YARN-9217: Rebased patch (again) + introduced new fail-fast property. >

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.010.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586-branch-3.1.001.patch > Extract log aggregation related fields and methods from

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.branch-3.1.001.patch > Code cleanup in ResourcePluginManager.initialize and in

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907224#comment-16907224 ] Peter Bacsko commented on YARN-9140: ASF license warning can be ignored. > Code cleanup in

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.branch-3.2.001.patch > Extract log aggregation related fields and methods from

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907137#comment-16907137 ] Peter Bacsko commented on YARN-9140: I managed to have this patch apply on branch-3.2. Let's wait for

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.branch-3.2.001.patch > Code cleanup in ResourcePluginManager.initialize and in

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907074#comment-16907074 ] Peter Bacsko commented on YARN-9133: ASF license issue can be ignored. > Make tests more easy to

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.009.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906266#comment-16906266 ] Peter Bacsko commented on YARN-9133: Uploaded patch for branch-3.2. Again, patch for branch-3.1 is not

[jira] [Updated] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9133: --- Attachment: YARN-9133.branch-3.2.001.patch > Make tests more easy to comprehend in

[jira] [Updated] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9133: --- Attachment: YARN-9133.007.patch > Make tests more easy to comprehend in TestGpuResourceHandler >

[jira] [Commented] (YARN-9676) Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906018#comment-16906018 ] Peter Bacsko commented on YARN-9676: +1 LGTM (non-binding) > Add DEBUG and TRACE level messages to

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905452#comment-16905452 ] Peter Bacsko commented on YARN-9134: ASF warning can be safely ignored: {noformat} Lines that start

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.004.patch > Extract log aggregation related fields and methods from RMAppImpl >

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905327#comment-16905327 ] Peter Bacsko commented on YARN-9140: Unit test failure is unrelated. > Code cleanup in

[jira] [Comment Edited] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905323#comment-16905323 ] Peter Bacsko edited comment on YARN-9134 at 8/12/19 3:49 PM: - [~snemeth] I'd

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905323#comment-16905323 ] Peter Bacsko commented on YARN-9134: [~snemeth] I'd skip 3.1. Way too many conflicts even if I use the

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.branch-3.2.001.patch > No test coverage for redefining FPGA / GPU resource

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.006.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905233#comment-16905233 ] Peter Bacsko commented on YARN-9140: Note: patch v3, v4 and v5 are totally unrelated changesets. I

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-08-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904453#comment-16904453 ] Peter Bacsko commented on YARN-9100: Patch v5 no longer applies. Created v6. > Add tests for

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-08-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100-006.patch > Add tests for GpuResourceAllocator and do minor code cleanup >

[jira] [Updated] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-08-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9135: --- Attachment: YARN-9105.branch-3.1.001.patch > NM State store ResourceMappings serialization are tested

[jira] [Updated] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-08-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9135: --- Attachment: YARN-9105.branch-3.2.001.patch > NM State store ResourceMappings serialization are tested

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.003.patch > Extract log aggregation related fields and methods from RMAppImpl >

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903805#comment-16903805 ] Peter Bacsko commented on YARN-9133: [~snemeth] similarly to YARN-9140, conflict resolution might not

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903802#comment-16903802 ] Peter Bacsko commented on YARN-9140: [~snemeth] there are already 4 commits difference between trunk

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.008.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903741#comment-16903741 ] Peter Bacsko commented on YARN-9134: Uploaded patch v4. _"Also, setupResourceTypes has been

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.004.patch > No test coverage for redefining FPGA / GPU resource types in

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.007.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.003.patch > No test coverage for redefining FPGA / GPU resource types in

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902007#comment-16902007 ] Peter Bacsko commented on YARN-9134: Rebased the patch. > No test coverage for redefining FPGA / GPU

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16901986#comment-16901986 ] Peter Bacsko commented on YARN-9217: This patch needed yet another rebase due to renames. >

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-07 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.006.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-08-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900236#comment-16900236 ] Peter Bacsko commented on YARN-9667: Ah sorry it wasn't clear. I kept those only because they occur

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-08-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900227#comment-16900227 ] Peter Bacsko commented on YARN-9667: [~eyang] [~snemeth] pls check this out when you have some time.

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-08-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900226#comment-16900226 ] Peter Bacsko commented on YARN-9667: Changes in the patch: # Removed unnecessary \{{fflush()}} calls

[jira] [Updated] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-08-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9667: --- Attachment: YARN-9667-001.patch > Container-executor.c duplicates messages to stdout >

[jira] [Commented] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-07-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889508#comment-16889508 ] Peter Bacsko commented on YARN-9217: [~snemeth] I rebased the patch but the amount of conflicts forced

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-07-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.005.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Assigned] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-19 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9667: -- Assignee: Peter Bacsko > Container-executor.c duplicates messages to stdout >

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-19 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889002#comment-16889002 ] Peter Bacsko commented on YARN-9667: [~eyang] sure, I'm on vacation right now, but I'll upload a patch

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.005.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-07-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883728#comment-16883728 ] Peter Bacsko commented on YARN-9133: Unit test failure seems to be unrelated. > Make tests more easy

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883072#comment-16883072 ] Peter Bacsko commented on YARN-9100: Ok, I had to retrigger the build for v5. It just failed for no

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883064#comment-16883064 ] Peter Bacsko commented on YARN-9135: OK, so apparently there are no findbugs issues anymore, which is

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883049#comment-16883049 ] Peter Bacsko commented on YARN-9127: XML -> I think that's because of the missing DTD that cannot be

[jira] [Comment Edited] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883049#comment-16883049 ] Peter Bacsko edited comment on YARN-9127 at 7/11/19 2:56 PM: - XML -> That's

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883047#comment-16883047 ] Peter Bacsko commented on YARN-9140: [~snemeth] that's patch v3 build result. Not sure if build for v4

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883045#comment-16883045 ] Peter Bacsko commented on YARN-9100: [~snemeth] Please wait for the build result of patch v5. The

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: YARN-9127.005.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882936#comment-16882936 ] Peter Bacsko commented on YARN-9135: Reuploaded patch v5 so that we can see the findbugs problems

[jira] [Updated] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9135: --- Attachment: YARN-9135.006.patch > NM State store ResourceMappings serialization are tested with

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: YARN-9127.004.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882900#comment-16882900 ] Peter Bacsko commented on YARN-9127: Patch v4: did a small cleanup at various places. > Create more

<    8   9   10   11   12   13   14   15   16   17   >