[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

2019-05-20 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: YARN-9525-001.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9482) DistributedShell job with localization fails in unsecure cluster

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840231#comment-16840231 ] Peter Bacsko commented on YARN-9482: If that's the case, then I give +1 (non-binding). >

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840256#comment-16840256 ] Peter Bacsko commented on YARN-9552: [~snemeth] I added a short comment to the testcase. >

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-003.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-004.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-15 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840350#comment-16840350 ] Peter Bacsko commented on YARN-9552: Thanks Szilard. Ok, I uploaded patch v4 just to make checkstyle

[jira] [Updated] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-05-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9552: --- Attachment: YARN-9552-002.patch > FairScheduler: NODE_UPDATE can cause NoSuchElementException >

[jira] [Commented] (YARN-9476) Create unit tests for VE plugin

2019-04-29 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829205#comment-16829205 ] Peter Bacsko commented on YARN-9476: [~sunilg] [~tangzhankun] could you please also review and commit

[jira] [Updated] (YARN-9475) Create basic VE plugin

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9475: --- Fix Version/s: 3.3.0 > Create basic VE plugin > -- > > Key:

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-POC2.patch > Implement VE discovery using libudev >

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-POC3.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-04-30 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830297#comment-16830297 ] Peter Bacsko commented on YARN-9477: Thanks [~snemeth] for the comments. _In

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-05-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831631#comment-16831631 ] Peter Bacsko commented on YARN-9477: [~snemeth] could you please check patch v1? > Implement VE

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-05-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-001.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-05-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831605#comment-16831605 ] Peter Bacsko commented on YARN-9477: I uploaded the first version of this. I immediately realized two

[jira] [Comment Edited] (YARN-9477) Implement VE discovery using libudev

2019-05-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831605#comment-16831605 ] Peter Bacsko edited comment on YARN-9477 at 5/2/19 1:09 PM: I uploaded the

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-05-06 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-003.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-05-06 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833805#comment-16833805 ] Peter Bacsko commented on YARN-9477: [~snemeth] thanks for the comments, patch v3 fixes these. >

[jira] [Comment Edited] (YARN-9477) Implement VE discovery using libudev

2019-05-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832510#comment-16832510 ] Peter Bacsko edited comment on YARN-9477 at 5/3/19 1:45 PM: Test failure seems

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-05-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-002.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-05-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832510#comment-16832510 ] Peter Bacsko commented on YARN-9477: Test failure seems to be unrelated to this patch. Instead, it was

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Issue Type: Sub-task (was: Bug) Parent: YARN-8472 > Enhance documentation of Docker on YARN

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-04 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878652#comment-16878652 ] Peter Bacsko commented on YARN-9660: Moved this under YARN-8472 > Enhance documentation of Docker on

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-06-26 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-007.patch > Implement VE discovery using libudev >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-06-26 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873458#comment-16873458 ] Peter Bacsko commented on YARN-9477: OK, now patch is should be good. Unit test failure is unrelated.

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882020#comment-16882020 ] Peter Bacsko commented on YARN-9100: Some changes in v4: * rebased patch * removed {{RetryCommand}}

[jira] [Comment Edited] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882020#comment-16882020 ] Peter Bacsko edited comment on YARN-9100 at 7/10/19 12:53 PM: -- Some changes

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.003.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100-004.patch > Add tests for GpuResourceAllocator and do minor code cleanup >

[jira] [Assigned] (YARN-9011) Race condition during decommissioning

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9011: -- Assignee: Peter Bacsko (was: Antal Bálint Steinbach) > Race condition during decommissioning

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Description: NodeHealthScriptRunner does *not* report a bad health if the script exits with an exit

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882150#comment-16882150 ] Peter Bacsko commented on YARN-6715: Updated the JIRA description and title. > Fix documentation

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Description: NodeHealthScriptRunner does *not* report a bad health if the script exits with an exit

[jira] [Updated] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Summary: Fix documentation about NodeHealthScriptRunner (was: Correct documentation about

[jira] [Assigned] (YARN-6715) NodeHealthScriptRunner does not handle non-zero exit codes properly

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-6715: -- Assignee: Peter Bacsko > NodeHealthScriptRunner does not handle non-zero exit codes properly >

[jira] [Updated] (YARN-6715) Correct documentation about NodeHealthScriptRunner

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-6715: --- Summary: Correct documentation about NodeHealthScriptRunner (was: NodeHealthScriptRunner does not

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-10 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882463#comment-16882463 ] Peter Bacsko commented on YARN-9667: [~eyang] I'm not exactly sure how to properly reproduce this, it

[jira] [Updated] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9135: --- Attachment: YARN-9135.006.patch > NM State store ResourceMappings serialization are tested with

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: YARN-9127.005.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882936#comment-16882936 ] Peter Bacsko commented on YARN-9135: Reuploaded patch v5 so that we can see the findbugs problems

[jira] [Updated] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9100: --- Attachment: YARN-9100-005.patch > Add tests for GpuResourceAllocator and do minor code cleanup >

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: (was: YARN-9124.004.patch) > Create more tests to verify GpuDeviceInformationParser >

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: YARN-9124.004.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.004.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9127: --- Attachment: YARN-9127.004.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882900#comment-16882900 ] Peter Bacsko commented on YARN-9127: Patch v4: did a small cleanup at various places. > Create more

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883047#comment-16883047 ] Peter Bacsko commented on YARN-9140: [~snemeth] that's patch v3 build result. Not sure if build for v4

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883049#comment-16883049 ] Peter Bacsko commented on YARN-9127: XML -> I think that's because of the missing DTD that cannot be

[jira] [Comment Edited] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883049#comment-16883049 ] Peter Bacsko edited comment on YARN-9127 at 7/11/19 2:56 PM: - XML -> That's

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883064#comment-16883064 ] Peter Bacsko commented on YARN-9135: OK, so apparently there are no findbugs issues anymore, which is

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883072#comment-16883072 ] Peter Bacsko commented on YARN-9100: Ok, I had to retrigger the build for v5. It just failed for no

[jira] [Commented] (YARN-9100) Add tests for GpuResourceAllocator and do minor code cleanup

2019-07-11 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883045#comment-16883045 ] Peter Bacsko commented on YARN-9100: [~snemeth] Please wait for the build result of patch v5. The

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-07-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883728#comment-16883728 ] Peter Bacsko commented on YARN-9133: Unit test failure seems to be unrelated. > Make tests more easy

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-07-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.005.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-09 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881181#comment-16881181 ] Peter Bacsko commented on YARN-9660: Thanks [~shaneku...@gmail.com] - could you or [~eyang] commit

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Attachment: YARN-9660-001.patch > Enhance documentation of Docker on YARN support >

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-02 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876992#comment-16876992 ] Peter Bacsko commented on YARN-9660: Uploaded patch v1 to enhance the markdown file. > Enhance

[jira] [Commented] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876144#comment-16876144 ] Peter Bacsko commented on YARN-9660: cc [~shaneku...@gmail.com] [~eyang] [~snemeth] - what do you guys

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Description: Right now, using Docker on YARN has some hard requirements. If these requirements are

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Description: Right now, using Docker on YARN has some hard requirements. If these requirements are

[jira] [Created] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9660: -- Summary: Enhance documentation of Docker on YARN support Key: YARN-9660 URL: https://issues.apache.org/jira/browse/YARN-9660 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9660: --- Description: Right now, using Docker on YARN has some hard requirements. If these requirements are

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880552#comment-16880552 ] Peter Bacsko commented on YARN-9667: Oh, thanks for saying - I didn't see that it's not you. Anyway,

[jira] [Comment Edited] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880582#comment-16880582 ] Peter Bacsko edited comment on YARN-9667 at 7/8/19 5:50 PM: I just found that

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-08 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880582#comment-16880582 ] Peter Bacsko commented on YARN-9667: I just found that this is probably even better:

[jira] [Commented] (YARN-9475) Create basic VE plugin

2019-04-23 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16823873#comment-16823873 ] Peter Bacsko commented on YARN-9475: IMO it's OK to move forward with the current solution - at least

[jira] [Updated] (YARN-9476) Create unit tests for VE plugin

2019-04-23 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9476: --- Attachment: YARN-9476-001.patch > Create unit tests for VE plugin > --- >

[jira] [Updated] (YARN-9476) Create unit tests for VE plugin

2019-04-23 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9476: --- Attachment: YARN-9476-002.patch > Create unit tests for VE plugin > --- >

[jira] [Commented] (YARN-9476) Create unit tests for VE plugin

2019-04-23 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824061#comment-16824061 ] Peter Bacsko commented on YARN-9476: [~snemeth] please review this patch, thanks! > Create unit tests

[jira] [Commented] (YARN-9476) Create unit tests for VE plugin

2019-04-23 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824002#comment-16824002 ] Peter Bacsko commented on YARN-9476: Fixed checksyle problems. > Create unit tests for VE plugin >

[jira] [Updated] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-04-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9473: --- Component/s: nodemanager > [Umbrella] Support Vector Engine ( a new accelerator hardware) based on >

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-04-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826084#comment-16826084 ] Peter Bacsko commented on YARN-9477: Note that this part is the heart of the improvement: {code}

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-04-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16826085#comment-16826085 ] Peter Bacsko commented on YARN-9477: [~tangzhankun] [~snemeth] could you please check out this POC? >

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-04-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Attachment: YARN-9477-POC.patch > Implement VE discovery using libudev >

[jira] [Updated] (YARN-9476) Create unit tests for VE plugin

2019-04-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9476: --- Attachment: YARN-9476-004.patch > Create unit tests for VE plugin > --- >

[jira] [Commented] (YARN-9482) DistributedShell job with localization fails in unsecure cluster

2019-04-17 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819930#comment-16819930 ] Peter Bacsko commented on YARN-9482: [~Prabhu Joseph] wouldn't it be better wrap filesystem calls in

[jira] [Commented] (YARN-9483) DistributedShell does not release container when failed to localize at launch

2019-04-17 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819965#comment-16819965 ] Peter Bacsko commented on YARN-9483: LGTM +1 (non-binding) > DistributedShell does not release

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-16 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818853#comment-16818853 ] Peter Bacsko commented on YARN-9080: +1 (non-binding) > Bucket Directories as part of ATS done

[jira] [Commented] (YARN-9476) Create unit tests for VE plugin

2019-04-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824986#comment-16824986 ] Peter Bacsko commented on YARN-9476: Thanks [~snemeth] updated the patch with your suggestions. >

[jira] [Updated] (YARN-9477) Implement VE discovery using libudev

2019-04-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9477: --- Summary: Implement VE discovery using libudev (was: Investigate device discovery mechanisms) >

[jira] [Updated] (YARN-9476) Create unit tests for VE plugin

2019-04-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9476: --- Attachment: YARN-9476-003.patch > Create unit tests for VE plugin > --- >

[jira] [Assigned] (YARN-9477) Implement VE discovery using libudev

2019-04-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9477: -- Assignee: Peter Bacsko > Implement VE discovery using libudev >

[jira] [Assigned] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-04-24 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9473: -- Assignee: Peter Bacsko > [Umbrella] Support Vector Engine ( a new accelerator hardware) based

[jira] [Resolved] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9473. Resolution: Fixed Fix Version/s: 3.3.0 > [Umbrella] Support Vector Engine ( a new

[jira] [Assigned] (YARN-9660) Enhance documentation of Docker on YARN support

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9660: -- Assignee: Peter Bacsko > Enhance documentation of Docker on YARN support >

[jira] [Commented] (YARN-9473) [Umbrella] Support Vector Engine ( a new accelerator hardware) based on pluggable device framework

2019-07-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876454#comment-16876454 ] Peter Bacsko commented on YARN-9473: Subtasks have been committed to trunk - closing this ticket. >

[jira] [Updated] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9133: --- Attachment: YARN-9133.branch-3.2.001.patch > Make tests more easy to comprehend in

[jira] [Updated] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9217: --- Attachment: YARN-9217.009.patch > Nodemanager will fail to start if GPU is misconfigured on the node

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-13 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906266#comment-16906266 ] Peter Bacsko commented on YARN-9133: Uploaded patch for branch-3.2. Again, patch for branch-3.1 is not

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905233#comment-16905233 ] Peter Bacsko commented on YARN-9140: Note: patch v3, v4 and v5 are totally unrelated changesets. I

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.006.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.branch-3.2.001.patch > No test coverage for redefining FPGA / GPU resource

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905323#comment-16905323 ] Peter Bacsko commented on YARN-9134: [~snemeth] I'd skip 3.1. Way too many conflicts even if I use the

[jira] [Comment Edited] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905323#comment-16905323 ] Peter Bacsko edited comment on YARN-9134 at 8/12/19 3:49 PM: - [~snemeth] I'd

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.004.patch > Extract log aggregation related fields and methods from RMAppImpl >

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905452#comment-16905452 ] Peter Bacsko commented on YARN-9134: ASF warning can be safely ignored: {noformat} Lines that start

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905327#comment-16905327 ] Peter Bacsko commented on YARN-9140: Unit test failure is unrelated. > Code cleanup in

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907137#comment-16907137 ] Peter Bacsko commented on YARN-9140: I managed to have this patch apply on branch-3.2. Let's wait for

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.branch-3.2.001.patch > Code cleanup in ResourcePluginManager.initialize and in

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-14 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.branch-3.2.001.patch > Extract log aggregation related fields and methods from

<    1   2   3   4   5   6   7   8   9   10   >