[jira] [Commented] (YARN-9138) Test error handling of nvidia-smi binary execution of GpuDiscoverer

2019-02-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759547#comment-16759547 ] Szilard Nemeth commented on YARN-9138: -- UT failure seems unrelated. > Test error handling of

[jira] [Commented] (YARN-9123) Clean up and split testcases in TestNMWebServices for GPU support

2019-02-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759548#comment-16759548 ] Szilard Nemeth commented on YARN-9123: -- UT failure seems unrelated. > Clean up and split testcases

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759464#comment-16759464 ] Hadoop QA commented on YARN-9161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759466#comment-16759466 ] Hadoop QA commented on YARN-9253: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-02-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-8967: --- Fix Version/s: 3.3 > Change FairScheduler to use PlacementRule interface >

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-02-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-8967: --- Fix Version/s: (was: 3.3) > Change FairScheduler to use PlacementRule interface >

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-02-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759562#comment-16759562 ] Yufei Gu commented on YARN-8967: Hi [~wilfreds], the patch v4 doesn't apply to the trunk. Can you rebase

[jira] [Updated] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-02-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-8967: Attachment: YARN-8967.005.patch > Change FairScheduler to use PlacementRule

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-02-03 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759579#comment-16759579 ] Wilfred Spiegelenburg commented on YARN-8967: - Rebased to trunk, the mockito changes prevented

[jira] [Updated] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9253: Attachment: YARN-9253-004.patch > Add UT to verify Placement Constraint in Distributed Shell >

[jira] [Created] (YARN-9277) Add more restrictions when preemption

2019-02-03 Thread Zhaohui Xin (JIRA)
Zhaohui Xin created YARN-9277: - Summary: Add more restrictions when preemption Key: YARN-9277 URL: https://issues.apache.org/jira/browse/YARN-9277 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-9276) Filter non-existent resource requests actively

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759347#comment-16759347 ] Hadoop QA commented on YARN-9276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9258) Support to specify allocation tags without constraint in distributed shell CLI

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759349#comment-16759349 ] Prabhu Joseph commented on YARN-9258: - [~cheersyang] Thanks for the detailed response. Have tried

[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759339#comment-16759339 ] Hadoop QA commented on YARN-9253: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-8088) [atsv2 read acls] REST API to get domain info by id

2019-02-03 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi resolved YARN-8088. - Resolution: Duplicate > [atsv2 read acls] REST API to get domain info by id >

[jira] [Commented] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759362#comment-16759362 ] Hadoop QA commented on YARN-9253: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9277) Add more restrictions In FairScheduler Preemption

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9277: -- Description:   I think we should add more restrictions in fair scheduler preemption.  * We should not

[jira] [Commented] (YARN-9258) Support to specify allocation tags without constraint in distributed shell CLI

2019-02-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759413#comment-16759413 ] Weiwei Yang commented on YARN-9258: --- Thanks [~Prabhu Joseph], yeah, pls go ahead with option #1. Let me

[jira] [Updated] (YARN-9278) Shuffle nodes when selecting to be preempted nodes

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9278: -- Description: We should *shuffle* the nodes to avoid some nodes being preempted frequently.  Also, we

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759404#comment-16759404 ] Zac Zhou commented on YARN-9161: Since [YARN-9262|https://issues.apache.org/jira/browse/YARN-9262] fix the

[jira] [Created] (YARN-9278) Shuffle nodes when selecting to be preempted nodes

2019-02-03 Thread Zhaohui Xin (JIRA)
Zhaohui Xin created YARN-9278: - Summary: Shuffle nodes when selecting to be preempted nodes Key: YARN-9278 URL: https://issues.apache.org/jira/browse/YARN-9278 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9278) Shuffle nodes when selecting to be preempted nodes

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9278: -- Description: We should *shuffle* the nodes to avoid some nodes being preempted frequently.  Also, we

[jira] [Updated] (YARN-9278) Shuffle nodes when selecting to be preempted nodes

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9278: -- Description: We should shuffle the nodes to avoid some nodes being preempted frequently. > Shuffle

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.012.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9277) Add more restrictions when preemption

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9277: -- Description:   I think we should add more restrictions when preempti * We should not preempt AM

[jira] [Updated] (YARN-9253) Add UT to verify Placement Constraint in Distributed Shell

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9253: Attachment: YARN-9253-005.patch > Add UT to verify Placement Constraint in Distributed Shell >

[jira] [Commented] (YARN-9277) Add more restrictions In FairScheduler Preemption

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759452#comment-16759452 ] Hadoop QA commented on YARN-9277: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9277) Add more restrictions when preemption

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9277: -- Summary: Add more restrictions when preemption (was: Add more restrictions when preemption) > Add

[jira] [Updated] (YARN-9277) Add more restrictions In FairScheduler Preemption

2019-02-03 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9277: -- Summary: Add more restrictions In FairScheduler Preemption (was: Add more restrictions when

[jira] [Created] (YARN-9279) Remove the old hamlet package

2019-02-03 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-9279: --- Summary: Remove the old hamlet package Key: YARN-9279 URL: https://issues.apache.org/jira/browse/YARN-9279 Project: Hadoop YARN Issue Type: Improvement

[jira] [Assigned] (YARN-9279) Remove the old hamlet package

2019-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-9279: --- Assignee: Akira Ajisaka > Remove the old hamlet package > - > >

[jira] [Updated] (YARN-9279) Remove the old hamlet package

2019-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-9279: Attachment: YARN-9279.01.patch > Remove the old hamlet package > - > >

[jira] [Commented] (YARN-9279) Remove the old hamlet package

2019-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759595#comment-16759595 ] Akira Ajisaka commented on YARN-9279: - The only usage I can see is Apache Slider, however, the

[jira] [Updated] (YARN-9279) Remove the old hamlet package

2019-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-9279: Hadoop Flags: Incompatible change Release Note: org.apache.hadoop.yarn.webapp.hamlet package was

[jira] [Commented] (YARN-8967) Change FairScheduler to use PlacementRule interface

2019-02-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759601#comment-16759601 ] Hadoop QA commented on YARN-8967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9065) App's diags is too long,written zk error

2019-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759655#comment-16759655 ] Akira Ajisaka commented on YARN-9065: - Closing this as duplicate of YARN-6125. > App's diags is too

[jira] [Resolved] (YARN-9065) App's diags is too long,written zk error

2019-02-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-9065. - Resolution: Duplicate > App's diags is too long,written zk error >

[jira] [Updated] (YARN-9258) Support to specify allocation tags without constraint in distributed shell CLI

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9258: Attachment: YARN-9258-001.patch > Support to specify allocation tags without constraint in

[jira] [Updated] (YARN-9258) Support to specify allocation tags without constraint in distributed shell CLI

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9258: Attachment: YARN-9258-002.patch > Support to specify allocation tags without constraint in

[jira] [Updated] (YARN-9258) Support to specify allocation tags without constraint in distributed shell CLI

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9258: Attachment: (was: YARN-9258-001.patch) > Support to specify allocation tags without constraint

[jira] [Commented] (YARN-9258) Support to specify allocation tags without constraint in distributed shell CLI

2019-02-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759658#comment-16759658 ] Prabhu Joseph commented on YARN-9258: - Attached V2 patch with option #1. Have used ")," as the

[jira] [Commented] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-02-03 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759661#comment-16759661 ] Bilwa S T commented on YARN-9233: - Hi [~bibinchundatt]     i think instead we can just set boolean value

[jira] [Updated] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-02-03 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9233: Attachment: YARN-9233-001.patch > RM may report allocated container which is killed (but not acquired by AM

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-02-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759667#comment-16759667 ] Hudson commented on YARN-9206: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15877 (See

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-02-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759668#comment-16759668 ] Sunil Govindan commented on YARN-9206: -- [~kshukla] Thanks. I could commit to trunk and branch-3.2.

[jira] [Commented] (YARN-9263) TestConfigurationNodeAttributesProvider fails after Mockito updated

2019-02-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759666#comment-16759666 ] Sunil Govindan commented on YARN-9263: -- Thanks [~cheersyang]. Cherry picked to branch-3.2 as well. >

[jira] [Updated] (YARN-9263) TestConfigurationNodeAttributesProvider fails after Mockito updated

2019-02-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-9263: - Fix Version/s: 3.2.1 > TestConfigurationNodeAttributesProvider fails after Mockito updated >