[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758917#comment-16758917 ] Hadoop QA commented on YARN-9253: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-8555) Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-8555: --- Assignee: Prabhu Joseph > Parameterize TestSchedulingRequestContainerAllocation(Async) to

[jira] [Updated] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9253: Attachment: YARN-9253-002.patch > Add UT to verify Placement Constraint in Distributed Shell >

[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758899#comment-16758899 ] Prabhu Joseph commented on YARN-9253: - Attached v2 patch fixing whitespace issue. Test case timing out

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758885#comment-16758885 ] Hadoop QA commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758875#comment-16758875 ] Hadoop QA commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9273) Flexing a component of YARN service does not work as documented when using relative number

2019-02-01 Thread Masahiro Tanaka (JIRA)
Masahiro Tanaka created YARN-9273: - Summary: Flexing a component of YARN service does not work as documented when using relative number Key: YARN-9273 URL: https://issues.apache.org/jira/browse/YARN-9273

[jira] [Commented] (YARN-9174) Backport YARN-7224 for refactoring of GpuDevice class

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758841#comment-16758841 ] Hadoop QA commented on YARN-9174: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9174) Backport YARN-7224 for refactoring of GpuDevice class

2019-02-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9174: Attachment: YARN-9174-YARN-8200.002.patch > Backport YARN-7224 for refactoring of GpuDevice class >

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758787#comment-16758787 ] Eric Yang commented on YARN-7129: - [~billie.rinaldi] I think patch 21 fixed all issues that you disclosed

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2019-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.021.patch > Application Catalog for YARN applications >

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2019-02-01 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.020.patch > Application Catalog for YARN applications >

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758760#comment-16758760 ] Hadoop QA commented on YARN-8549: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758759#comment-16758759 ] Hadoop QA commented on YARN-9180: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9271) Backport YARN-6927 for resource type support in MapReduce

2019-02-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9271: Description: This is already in branch-3.0. Need to port it to YARN-8200/branch-2. > Backport

[jira] [Updated] (YARN-9272) Backport YARN-7738 for refreshing max allocation for multiple resource types

2019-02-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9272: Environment: (was: Backport to YARN-8200 feature branch (for branch-2).) > Backport YARN-7738

[jira] [Updated] (YARN-9272) Backport YARN-7738 for refreshing max allocation for multiple resource types

2019-02-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9272: Description: Need to port to YARN-8200.branch3 (for branch-3.0) and YARN-8200 (for branch-2) >

[jira] [Created] (YARN-9272) Backport YARN-7738 for refreshing max allocation for multiple resource types

2019-02-01 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9272: --- Summary: Backport YARN-7738 for refreshing max allocation for multiple resource types Key: YARN-9272 URL: https://issues.apache.org/jira/browse/YARN-9272 Project:

[jira] [Commented] (YARN-8219) Add application launch time to ATSV2

2019-02-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758744#comment-16758744 ] Vrushali C commented on YARN-8219: -- Thanks for the patch Abhishek! We discussed last night in the call

[jira] [Comment Edited] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2019-02-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758740#comment-16758740 ] Vrushali C edited comment on YARN-8549 at 2/1/19 10:43 PM: --- Hi Prabha Can you

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2019-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758742#comment-16758742 ] Hudson commented on YARN-8549: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15868 (See

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2019-02-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758740#comment-16758740 ] Vrushali C commented on YARN-8549: -- Hi Prabha Can you update the patch for branch-2 as well to make it

[jira] [Created] (YARN-9271) Backport YARN-6927 for resource type support in MapReduce

2019-02-01 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9271: --- Summary: Backport YARN-6927 for resource type support in MapReduce Key: YARN-9271 URL: https://issues.apache.org/jira/browse/YARN-9271 Project: Hadoop YARN

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2019-02-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758728#comment-16758728 ] Vrushali C commented on YARN-8549: -- Committed to trunk as part of

[jira] [Updated] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-02-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9180: Attachment: YARN-9180-YARN-8200.004.patch > Port YARN-7033 NM recovery of assigned resources to

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-02-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758714#comment-16758714 ] Jonathan Hung commented on YARN-9180: - Indeed. Uploaded YARN-9180-YARN-8200.004 to fix checkstyle. >

[jira] [Commented] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2019-02-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758704#comment-16758704 ] Vrushali C commented on YARN-8549: -- +1 on patch v5. I need to confirm this applies to latest trunk,

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-02-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758701#comment-16758701 ] Arun Suresh commented on YARN-9180: --- Thanks for the backport [~jhung] The checkstyles look fixable

[jira] [Commented] (YARN-9246) NPE when executing a command yarn node -status or -states without additional arguments

2019-02-01 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758615#comment-16758615 ] Suma Shivaprasad commented on YARN-9246: Thanks [~masatana]. Will commit this by EOD today. > NPE

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758604#comment-16758604 ] Hadoop QA commented on YARN-9060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758509#comment-16758509 ] Hadoop QA commented on YARN-9253: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758491#comment-16758491 ] Hadoop QA commented on YARN-9253: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9258) DistributedShell PlacementSpec fails to parse

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758454#comment-16758454 ] Prabhu Joseph commented on YARN-9258: - Hi [~cheersyang], Currently it is difficult to differentiate

[jira] [Updated] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9253: Attachment: YARN-9253-001.patch > Add UT to verify Placement Constraint in Distributed Shell >

[jira] [Updated] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9253: Attachment: (was: YARN-9253-001.patch) > Add UT to verify Placement Constraint in Distributed

[jira] [Commented] (YARN-9258) DistributedShell PlacementSpec fails to parse

2019-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758442#comment-16758442 ] Weiwei Yang commented on YARN-9258: --- Hi [~Prabhu Joseph] Thanks for the patch. The syntax is changed

[jira] [Updated] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9253: Attachment: YARN-9253-001.patch > Add UT to verify Placement Constraint in Distributed Shell >

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.017.patch > [YARN-8851] Phase 1 - Support device isolation and use the

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758368#comment-16758368 ] Zhankun Tang commented on YARN-9060: [~sunilg] , Thanks. And there's indeed a potential issue that it

[jira] [Commented] (YARN-9262) TestRMAppAttemptTransitions is failing with an NPE

2019-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758386#comment-16758386 ] Weiwei Yang commented on YARN-9262: --- Thanks [~sunilg] for the quick review. >

[jira] [Comment Edited] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758357#comment-16758357 ] Zhankun Tang edited comment on YARN-9060 at 2/1/19 2:30 PM: [~sunilg] , Thanks

[jira] [Commented] (YARN-9190) [Submarine] Submarine job will fail to run as a first job on a new created Hadoop 3.2.0 RC1 cluster

2019-02-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758365#comment-16758365 ] Billie Rinaldi commented on YARN-9190: -- [~tangzhankun] Since I haven't seen this locally, I'll

[jira] [Comment Edited] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758368#comment-16758368 ] Zhankun Tang edited comment on YARN-9060 at 2/1/19 2:39 PM: [~sunilg] , 

[jira] [Comment Edited] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758357#comment-16758357 ] Zhankun Tang edited comment on YARN-9060 at 2/1/19 2:29 PM: [~sunilg] , Thanks

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758364#comment-16758364 ] Sunil Govindan commented on YARN-9060: -- Yes, snprintf ensures a trailing /0 and hence this existing

[jira] [Commented] (YARN-9263) TestConfigurationNodeAttributesProvider fails after Mockito updated

2019-02-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758352#comment-16758352 ] Sunil Govindan commented on YARN-9263: -- +1. Committing shortly. >

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758357#comment-16758357 ] Zhankun Tang commented on YARN-9060: [~sunilg] , Thanks for mentioning this good question. >From what

[jira] [Commented] (YARN-9262) TestRMAppAttemptTransitions is failing with an NPE

2019-02-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758356#comment-16758356 ] Sunil Govindan commented on YARN-9262: -- +1. Lets get this in shortly. > TestRMAppAttemptTransitions

[jira] [Commented] (YARN-9186) [CSI] Upgrade CSI proto to v1.0

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758331#comment-16758331 ] Hadoop QA commented on YARN-9186: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9258) DistributedShell PlacementSpec fails to parse

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758302#comment-16758302 ] Hadoop QA commented on YARN-9258: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9265) FPGA plugin fails to recognize Intel Processing Accelerator Card

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758312#comment-16758312 ] Zhankun Tang commented on YARN-9265: [~pbacsko] , Thanks for following up the FPGA features. I think

[jira] [Commented] (YARN-9265) FPGA plugin fails to recognize Intel Processing Accelerator Card

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758296#comment-16758296 ] Peter Bacsko commented on YARN-9265: We _really_ a good solution to this. There are several approach I

[jira] [Comment Edited] (YARN-9265) FPGA plugin fails to recognize Intel Processing Accelerator Card

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758296#comment-16758296 ] Peter Bacsko edited comment on YARN-9265 at 2/1/19 1:29 PM: We _really_ a good

[jira] [Commented] (YARN-9263) TestConfigurationNodeAttributesProvider fails after Mockito updated

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758293#comment-16758293 ] Hadoop QA commented on YARN-9263: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9262) TestRMAppAttemptTransitions is failing with an NPE

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758274#comment-16758274 ] Hadoop QA commented on YARN-9262: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9270) Minor cleanup in TestFpgaDiscoverer

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9270: -- Summary: Minor cleanup in TestFpgaDiscoverer Key: YARN-9270 URL: https://issues.apache.org/jira/browse/YARN-9270 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-9269) Minor cleanup in FpgaResourceAllocator

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9269: --- Description: Some stuff that we observed: * {{addFpga()}} - we check for duplicate devices, but we

[jira] [Created] (YARN-9269) Minor cleanup in FpgaResourceAllocator

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9269: -- Summary: Minor cleanup in FpgaResourceAllocator Key: YARN-9269 URL: https://issues.apache.org/jira/browse/YARN-9269 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-9268) Various fixes are needed in FpgaDevice

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9268: --- Description: Need to fix the following the class {{FpgaDevice}}: * It implements {{Comparable}}, but

[jira] [Updated] (YARN-9267) Various fixes are needed in FpgaResourceHandlerImpl

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9267: --- Description: Fix some problems in {{FpgaResourceHandlerImpl}}: * {{preStart()}} does not reconfigure

[jira] [Updated] (YARN-9266) Various fixes are needed in IntelFpgaOpenclPlugin

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9266: --- Description: Problems identified in this class: * {{InnerShellExecutor}} ignores the timeout

[jira] [Updated] (YARN-9267) Various fixes are needed in FpgaResourceHandlerImpl

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9267: --- Description: Fix some problems in {{FpgaResourceHandlerImpl}}: * {{preStart()}} does not reconfigure

[jira] [Created] (YARN-9268) Various fixes are needed in FpgaDevice

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9268: -- Summary: Various fixes are needed in FpgaDevice Key: YARN-9268 URL: https://issues.apache.org/jira/browse/YARN-9268 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-9266) Various fixes are needed in IntelFpgaOpenclPlugin

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9266: -- Summary: Various fixes are needed in IntelFpgaOpenclPlugin Key: YARN-9266 URL: https://issues.apache.org/jira/browse/YARN-9266 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-9267) Various fixes are needed in FpgaResourceHandlerImpl

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9267: -- Summary: Various fixes are needed in FpgaResourceHandlerImpl Key: YARN-9267 URL: https://issues.apache.org/jira/browse/YARN-9267 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-9265) FPGA plugin fails to recognize Intel Processing Accelerator Card

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9265: --- Summary: FPGA plugin fails to recognize Intel Processing Accelerator Card (was: FPGA plugin fails to

[jira] [Created] (YARN-9265) FPGA plugin fails to recognize Intel PAC card

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9265: -- Summary: FPGA plugin fails to recognize Intel PAC card Key: YARN-9265 URL: https://issues.apache.org/jira/browse/YARN-9265 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9265) FPGA plugin fails to recognize Intel PAC card

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9265: --- Description: The plugin cannot autodetect Intel FPGA PAC (Processing Accelerator Card). There are

[jira] [Updated] (YARN-9265) FPGA plugin fails to recognize Intel PAC card

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9265: --- Description: The plugin cannot autodetect Intel FPGA PAC (Processing Accelerator Card). There are

[jira] [Created] (YARN-9264) [Umbrella] Follow-up on IntelOpenCL FPGA plugin

2019-02-01 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9264: -- Summary: [Umbrella] Follow-up on IntelOpenCL FPGA plugin Key: YARN-9264 URL: https://issues.apache.org/jira/browse/YARN-9264 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-9264) [Umbrella] Follow-up on IntelOpenCL FPGA plugin

2019-02-01 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9264: -- Assignee: Peter Bacsko > [Umbrella] Follow-up on IntelOpenCL FPGA plugin >

[jira] [Updated] (YARN-9263) TestConfigurationNodeAttributesProvider fails after Mockito updated

2019-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9263: -- Attachment: YARN-9263.01.patch > TestConfigurationNodeAttributesProvider fails after Mockito updated >

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758240#comment-16758240 ] Weiwei Yang commented on YARN-9060: --- TestConfigurationNodeAttributesProvider UT failure should not be

[jira] [Updated] (YARN-9258) DistributedShell PlacementSpec fails to parse

2019-02-01 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9258: Attachment: YARN-9258-001.patch > DistributedShell PlacementSpec fails to parse >

[jira] [Created] (YARN-9263) TestConfigurationNodeAttributesProvider fails after Mockito updated

2019-02-01 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-9263: - Summary: TestConfigurationNodeAttributesProvider fails after Mockito updated Key: YARN-9263 URL: https://issues.apache.org/jira/browse/YARN-9263 Project: Hadoop YARN

[jira] [Commented] (YARN-9248) RMContainerImpl:Invalid event: ACQUIRED at KILLED

2019-02-01 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758226#comment-16758226 ] lujie commented on YARN-9248: - TestRMAppAttemptTransitions#testContainerRemovedBeforeAllocate fails will be

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758212#comment-16758212 ] Hadoop QA commented on YARN-9161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758200#comment-16758200 ] Sunil Govindan commented on YARN-9060: -- Hi [~tangzhankun] Sorry for this late comments. I have some

[jira] [Updated] (YARN-9262) TestRMAppAttemptTransitions is failing with an NPE

2019-02-01 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-9262: Attachment: YARN-9262_1.patch > TestRMAppAttemptTransitions is failing with an NPE >

[jira] [Updated] (YARN-9186) [CSI] Upgrade CSI proto to v1.0

2019-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9186: -- Attachment: YARN-9186.02.patch > [CSI] Upgrade CSI proto to v1.0 > --- > >

[jira] [Commented] (YARN-9186) [CSI] Upgrade CSI proto to v1.0

2019-02-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758192#comment-16758192 ] Weiwei Yang commented on YARN-9186: --- Hi [~sunilg] Thanks for the comments. {quote}do we need to know or

[jira] [Comment Edited] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-02-01 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758170#comment-16758170 ] Zhaohui Xin edited comment on YARN-9184 at 2/1/19 10:14 AM: [~liushaohui],

[jira] [Commented] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-02-01 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758170#comment-16758170 ] Zhaohui Xin commented on YARN-9184: --- [~liushaohui], Hi, Thanks for your comment. If this config is in

[jira] [Commented] (YARN-9262) TestRMAppAttemptTransitions is failing with an NPE

2019-02-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758145#comment-16758145 ] Wilfred Spiegelenburg commented on YARN-9262: - The failure occurs because no {{Allocation}}

[jira] [Comment Edited] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-02-01 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758134#comment-16758134 ] Liu Shaohui edited comment on YARN-9184 at 2/1/19 9:24 AM: --- Nice feature. It

[jira] [Updated] (YARN-9190) [Submarine] Submarine job will fail to run as a first job on a new created Hadoop 3.2.0 RC1 cluster

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9190: --- Priority: Major (was: Minor) > [Submarine] Submarine job will fail to run as a first job on a new

[jira] [Commented] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-02-01 Thread Liu Shaohui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758134#comment-16758134 ] Liu Shaohui commented on YARN-9184: --- Nice feature. It will better if this option can be set per job. Eg:

[jira] [Commented] (YARN-9190) [Submarine] Submarine job will fail to run as a first job on a new created Hadoop 3.2.0 RC1 cluster

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758129#comment-16758129 ] Zhankun Tang commented on YARN-9190: [~sunilg], [~billie.rinaldi], [~leftnoteasy] . I just encountered

[jira] [Commented] (YARN-1655) Add implementations to FairScheduler to support increase/decrease container resource

2019-02-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758120#comment-16758120 ] Wilfred Spiegelenburg commented on YARN-1655: - I have started working on this already. I have

[jira] [Commented] (YARN-9186) [CSI] Upgrade CSI proto to v1.0

2019-02-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758115#comment-16758115 ] Sunil Govindan commented on YARN-9186: -- Thanks [~cheersyang] for checking CTrox driver as well. Let's

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758113#comment-16758113 ] Zac Zhou commented on YARN-9161: Thanks, [~sunilg] Yeah. For the latest patch, I just changed the 

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-01 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758106#comment-16758106 ] Sunil Govindan commented on YARN-9161: -- Hi [~yuan_zac] I was trying to understand latest change in

[jira] [Assigned] (YARN-1655) Add implementations to FairScheduler to support increase/decrease container resource

2019-02-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-1655: --- Assignee: Wilfred Spiegelenburg (was: Sandy Ryza) > Add implementations to

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation and use the Nvidia GPU plugin as an example

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758078#comment-16758078 ] Hadoop QA commented on YARN-9060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-02-01 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.005.patch > GPU hierarchy/topology scheduling support >

[jira] [Commented] (YARN-9180) Port YARN-7033 NM recovery of assigned resources to branch-3.0/branch-2

2019-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758065#comment-16758065 ] Hadoop QA commented on YARN-9180: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||