[jira] [Commented] (YARN-9178) TestRMAdminCli#testHelp is failing in trunk

2019-01-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734930#comment-16734930 ] Weiwei Yang commented on YARN-9178: --- Hi [~abmodi] Do you know which Jira breaks it? Do

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2019-01-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734918#comment-16734918 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu] Thanks for pointing me to YARN-9055.

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734906#comment-16734906 ] Weiwei Yang commented on YARN-9173: --- Hi [~wilfreds] Thanks for fixing this and adding m

[jira] [Comment Edited] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734906#comment-16734906 ] Weiwei Yang edited comment on YARN-9173 at 1/5/19 2:01 PM: --- Hi [

[jira] [Comment Edited] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734135#comment-16734135 ] Weiwei Yang edited comment on YARN-9173 at 1/4/19 1:33 PM: --- Sure

[jira] [Commented] (YARN-9173) FairShare calculation broken for large values after YARN-8833

2019-01-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734135#comment-16734135 ] Weiwei Yang commented on YARN-9173: --- Sure, thanks [~wilfreds] for working on this, I wil

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2019-01-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16733952#comment-16733952 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu] {quote}Actually that would introduce

[jira] [Commented] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16733640#comment-16733640 ] Weiwei Yang commented on YARN-9164: --- {color:#33}I have committed the patch to trunk,

[jira] [Updated] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9164: -- Fix Version/s: 3.0.4 > Shutdown NM may cause NPE when opportunistic container scheduling is enabled > --

[jira] [Updated] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9164: -- Fix Version/s: 3.1.2 > Shutdown NM may cause NPE when opportunistic container scheduling is enabled > --

[jira] [Updated] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9164: -- Fix Version/s: 3.2.1 > Shutdown NM may cause NPE when opportunistic container scheduling is enabled > --

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16733062#comment-16733062 ] Weiwei Yang commented on YARN-9038: --- Hi [~sunilg] There is only 1 checkstyle issue left

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732843#comment-16732843 ] Weiwei Yang commented on YARN-9038: --- Thanks [~sunilg], I've triggered the jenkins job, l

[jira] [Comment Edited] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732769#comment-16732769 ] Weiwei Yang edited comment on YARN-9164 at 1/3/19 8:53 AM: --- Than

[jira] [Commented] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732769#comment-16732769 ] Weiwei Yang commented on YARN-9164: --- Thanks [~xiaoheipangzi], latest patch looks good, a

[jira] [Updated] (YARN-9164) Shutdown NM may cause NPE when opportunistic container scheduling is enabled

2019-01-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9164: -- Summary: Shutdown NM may cause NPE when opportunistic container scheduling is enabled (was: NullPointer

[jira] [Commented] (YARN-9168) DistributedShell client timeout should be -1 by default

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732614#comment-16732614 ] Weiwei Yang commented on YARN-9168: --- Hi [~tangzhankun] {quote}And the timeout value "-1"

[jira] [Comment Edited] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732149#comment-16732149 ] Weiwei Yang edited comment on YARN-9163 at 1/2/19 3:41 PM: --- Hi [

[jira] [Commented] (YARN-9168) DistributedShell client timeout should be -1 by default

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732169#comment-16732169 ] Weiwei Yang commented on YARN-9168: --- Hi [~tangzhankun] I think it introduced such a fin

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732150#comment-16732150 ] Weiwei Yang commented on YARN-9163: --- +[~Tao Yang] in the loop > Deadlock when use yarn

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732149#comment-16732149 ] Weiwei Yang commented on YARN-9163: --- Hi [~ziqian hu] This seems to be a blocker, or at

[jira] [Comment Edited] (YARN-9157) Failed deletion dirs in yarn.nodemanager.local-dirs causes accumulation lots of files under the path yarn.nodemanager.local-dirs and causes operation systerm's I

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732126#comment-16732126 ] Weiwei Yang edited comment on YARN-9157 at 1/2/19 3:01 PM: --- Hi [

[jira] [Commented] (YARN-9157) Failed deletion dirs in yarn.nodemanager.local-dirs causes accumulation lots of files under the path yarn.nodemanager.local-dirs and causes operation systerm's Inode

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732126#comment-16732126 ] Weiwei Yang commented on YARN-9157: --- Hi [~jj336013] If I remember correctly, DeletionSe

[jira] [Updated] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9163: -- Priority: Blocker (was: Major) > Deadlock when use yarn rmadmin -refreshQueues > --

[jira] [Commented] (YARN-9164) NullPointerException crash the ResourceManager

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732086#comment-16732086 ] Weiwei Yang commented on YARN-9164: --- Hi [~xiaoheipangzi] I noticed this one and YARN-91

[jira] [Commented] (YARN-9165) NPE which is similar to YARN-5918

2019-01-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732081#comment-16732081 ] Weiwei Yang commented on YARN-9165: --- Hi [~xiaoheipangzi] Thanks for testing this and pr

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16729048#comment-16729048 ] Weiwei Yang commented on YARN-9038: --- Hi [~sunilg] Could u pls help to review the latest

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2018-12-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16727775#comment-16727775 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu] Thanks for the patch. I am +0 on add

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726662#comment-16726662 ] Weiwei Yang commented on YARN-9038: --- Hi [~sunilg] Thanks for the review. {quote}{{csiDr

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.007.patch > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726548#comment-16726548 ] Weiwei Yang commented on YARN-8925: --- I've committed this to trunk and branch-3.2. Thanks

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726545#comment-16726545 ] Weiwei Yang commented on YARN-8925: --- Looks good, committing now. > Updating distributed

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726514#comment-16726514 ] Weiwei Yang commented on YARN-9038: --- Hi [~sunilg] Could you pls help to review latest p

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-12-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726427#comment-16726427 ] Weiwei Yang commented on YARN-8925: --- Hi [~Tao Yang] I've committed the patch to trunk,

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-12-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726401#comment-16726401 ] Weiwei Yang commented on YARN-8925: --- Hi [~Tao Yang] Yep, I think I forgot to set that c

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.006.patch > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-12-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725717#comment-16725717 ] Weiwei Yang commented on YARN-8925: --- Hi [~Tao Yang] Today I applied the patch to a v3.2

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.005.patch > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.004.patch > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725519#comment-16725519 ] Weiwei Yang commented on YARN-9038: --- Oops, v3 patch includes some unexpected changes. Co

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.003.patch > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

2018-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724689#comment-16724689 ] Weiwei Yang commented on YARN-9075: --- Thanks for confirmation, I closed that one as dupli

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

2018-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724630#comment-16724630 ] Weiwei Yang commented on YARN-9075: --- hi [~billie.rinaldi], is the patch for this one res

[jira] [Commented] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724621#comment-16724621 ] Weiwei Yang commented on YARN-9143: --- The patch no longer applies, rebase it to v3. > Au

[jira] [Commented] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16724623#comment-16724623 ] Weiwei Yang commented on YARN-9143: --- Looks like this is resolved by YARN-9075 and it jus

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723709#comment-16723709 ] Weiwei Yang commented on YARN-9038: --- Hi [~sunilg] I agree with most of your comments, a

[jira] [Updated] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9143: -- Attachment: YARN-9143.002.patch > Aux service system-class is loading from a wrong property > --

[jira] [Commented] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723072#comment-16723072 ] Weiwei Yang commented on YARN-9143: --- Fix checkstyle issues. > Aux service system-class

[jira] [Updated] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9143: -- Description: For example, if we define a aux service with name A, and it's class is pkg.class.A  It sh

[jira] [Commented] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16722914#comment-16722914 ] Weiwei Yang commented on YARN-9143: --- [~sunilg] pls help to review, thanks. > Aux servic

[jira] [Updated] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9143: -- Description: For example, if we define a aux service with name A, and it's class is pkg.class.A  It sh

[jira] [Updated] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9143: -- Attachment: YARN-9143.001.patch > Aux service system-class is loading from a wrong property > --

[jira] [Created] (YARN-9143) Aux service system-class is loading from a wrong property

2018-12-17 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-9143: - Summary: Aux service system-class is loading from a wrong property Key: YARN-9143 URL: https://issues.apache.org/jira/browse/YARN-9143 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2018-12-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721066#comment-16721066 ] Weiwei Yang commented on YARN-9116: --- The logic to inherit should not be a problem. I mea

[jira] [Comment Edited] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2018-12-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16721066#comment-16721066 ] Weiwei Yang edited comment on YARN-9116 at 12/14/18 8:50 AM: -

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2018-12-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720845#comment-16720845 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu] I don't see why this needs 2 options

[jira] [Commented] (YARN-9116) Capacity Scheduler: add the default maximum-allocation-mb and maximum-allocation-vcores for the queues

2018-12-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720289#comment-16720289 ] Weiwei Yang commented on YARN-9116: --- Hi [~aihuaxu] I see why you are proposing this. Bu

[jira] [Commented] (YARN-7746) Fix PlacementProcessor to support app priority

2018-12-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717433#comment-16717433 ] Weiwei Yang commented on YARN-7746: --- Hi [~maniraj...@gmail.com] I was trying to get som

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-12-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16717432#comment-16717432 ] Weiwei Yang commented on YARN-8925: --- Sure thanks [~Tao Yang]. That is correct, they can

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2018-12-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714914#comment-16714914 ] Weiwei Yang commented on YARN-9037: --- Hi [~sunilg] Latest patch looks good to me, I'll d

[jira] [Updated] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-12-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9009: -- Fix Version/s: 3.0.4 > Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs > ---

[jira] [Updated] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-12-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9009: -- Fix Version/s: 3.2.1 > Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs > ---

[jira] [Updated] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-12-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9009: -- Fix Version/s: 3.1.2 > Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs > ---

[jira] [Updated] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-12-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9009: -- Fix Version/s: 3.3.0 > Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs > ---

[jira] [Assigned] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-12-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-9009: - Assignee: OrDTesters > Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs >

[jira] [Commented] (YARN-9009) Fix flaky test TestEntityGroupFSTimelineStore.testCleanLogs

2018-12-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16714272#comment-16714272 ] Weiwei Yang commented on YARN-9009: --- +1. Thanks [~OrDTesters] for the patch, and [~tangz

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713492#comment-16713492 ] Weiwei Yang commented on YARN-9038: --- Upload v2 patch to fix jenkins issues. > [CSI] Add

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.002.patch > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Commented] (YARN-7746) Fix PlacementProcessor to support app priority

2018-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16713480#comment-16713480 ] Weiwei Yang commented on YARN-7746: --- Hi [~maniraj...@gmail.com] YARN-1963 only honors a

[jira] [Updated] (YARN-9038) Add ability to publish/unpublish volumes on node managers

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.001.patch > Add ability to publish/unpublish volumes on node managers > --

[jira] [Updated] (YARN-9057) [CSI] CSI jar file should not bundle third party dependencies

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Summary: [CSI] CSI jar file should not bundle third party dependencies (was: CSI jar file should not bu

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Labels: CSI (was: ) > CSI jar file should not bundle third party dependencies > ---

[jira] [Updated] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9086: -- Labels: CSI (was: ) > [CSI] Run csi-driver-adaptor as aux service > ---

[jira] [Updated] (YARN-8902) [CSI] Add volume manager that manages CSI volume lifecycle

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Labels: CSI (was: ) > [CSI] Add volume manager that manages CSI volume lifecycle >

[jira] [Updated] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9037: -- Labels: CSI (was: ) > [CSI] Ignore volume resource in resource calculators based on tags >

[jira] [Updated] (YARN-8877) [CSI] Extend service spec to allow setting resource attributes

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8877: -- Labels: CSI (was: ) > [CSI] Extend service spec to allow setting resource attributes >

[jira] [Updated] (YARN-8940) [CSI] Add volume as a top-level attribute in service spec

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8940: -- Labels: CSI (was: ) > [CSI] Add volume as a top-level attribute in service spec >

[jira] [Updated] (YARN-9058) [CSI] YARN service fail to launch due to CSI changes

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9058: -- Labels: CSI (was: ) > [CSI] YARN service fail to launch due to CSI changes > --

[jira] [Updated] (YARN-8953) [CSI] CSI driver adaptor module support in NodeManager

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Labels: CSI (was: ) > [CSI] CSI driver adaptor module support in NodeManager >

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Summary: [CSI] Add ability to publish/unpublish volumes on node managers (was: Add ability to publish/u

[jira] [Updated] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8873: -- Labels: CSI (was: ) > [YARN-8811] Add CSI java-based client library > -

[jira] [Updated] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8811: -- Labels: CSI (was: ) > Support Container Storage Interface (CSI) in YARN > -

[jira] [Updated] (YARN-8940) [CSI] Add volume as a top-level attribute in service spec

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8940: -- Summary: [CSI] Add volume as a top-level attribute in service spec (was: Add volume as a top-level att

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Labels: CSI (was: ) > [CSI] Add ability to publish/unpublish volumes on node managers > ---

[jira] [Created] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2018-12-06 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-9086: - Summary: [CSI] Run csi-driver-adaptor as aux service Key: YARN-9086 URL: https://issues.apache.org/jira/browse/YARN-9086 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-9038) Add ability to publish/unpublish volumes on node managers

2018-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Summary: Add ability to publish/unpublish volumes on node managers (was: Add ability to publish volumes

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710904#comment-16710904 ] Weiwei Yang commented on YARN-9057: --- Thanks [~eyang]! > CSI jar file should not bundle

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

2018-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710319#comment-16710319 ] Weiwei Yang commented on YARN-9075: --- Hi [~billie.rinaldi] I like this idea very much, I

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

2018-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710263#comment-16710263 ] Weiwei Yang commented on YARN-9050: --- Hi [~Tao Yang], thanks for creating this, certainly

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709637#comment-16709637 ] Weiwei Yang commented on YARN-9057: --- Hi [~eyang], using provided scope for hadoop-yarn-a

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Attachment: YARN-9057.002.patch > CSI jar file should not bundle third party dependencies >

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709465#comment-16709465 ] Weiwei Yang commented on YARN-9057: --- Thanks [~eyang], indeed that is not expected. Not s

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708581#comment-16708581 ] Weiwei Yang commented on YARN-9057: --- Attached patch to remove the shading code, and yarn

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Attachment: YARN-9057.001.patch > CSI jar file should not bundle third party dependencies >

[jira] [Commented] (YARN-7746) Fix PlacementProcessor to support app priority

2018-12-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708216#comment-16708216 ] Weiwei Yang commented on YARN-7746: --- Hi [~maniraj...@gmail.com] Thanks for working on t

[jira] [Commented] (YARN-9057) CSI jar file should not bundle third party dependencies

2018-12-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708109#comment-16708109 ] Weiwei Yang commented on YARN-9057: --- Thanks [~eyang], [~ste...@apache.org]. Let me revis

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702605#comment-16702605 ] Weiwei Yang commented on YARN-9067: --- Hi [~eyang] I committed the patch to trunk. The pa

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16702595#comment-16702595 ] Weiwei Yang commented on YARN-9067: --- Thanks for fixing this, change LGTM. Committing soo

[jira] [Updated] (YARN-9058) [CSI] YARN service fail to launch due to CSI changes

2018-11-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9058: -- Summary: [CSI] YARN service fail to launch due to CSI changes (was: YARN service fail to launch due to

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

2018-11-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16700031#comment-16700031 ] Weiwei Yang commented on YARN-9037: --- Hi [~sunilg] The patch overall looks good. Somethi

<    1   2   3   4   5   6   7   8   9   10   >