[jira] [Commented] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677917#comment-16677917 ] Weiwei Yang commented on YARN-8984: --- Hi [~fly_in_gis] I suppose you should have set to

[jira] [Updated] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8811: -- Attachment: Support Container Storage Interface(CSI) in YARN_design_doc_v3.pdf > Support Container Stor

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: csi_adaptor_workflow.png > Add CSI driver adaptor module > - > >

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: YARN-8953.002.patch > Add CSI driver adaptor module > - > >

[jira] [Updated] (YARN-8984) AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8984: -- Summary: AMRMClient#OutstandingSchedRequests leaks when AllocationTags is null or empty (was: Outstandi

[jira] [Commented] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677660#comment-16677660 ] Weiwei Yang commented on YARN-8984: --- Thanks [~fly_in_gis] for creating this issue, I hav

[jira] [Updated] (YARN-8984) OutstandingSchedRequests in AMRMClient could not be removed when AllocationTags is null or empty

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8984: -- Priority: Critical (was: Major) > OutstandingSchedRequests in AMRMClient could not be removed when > A

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677579#comment-16677579 ] Weiwei Yang commented on YARN-8233: --- Thanks [~ajisakaa] for the review and commit. Since

[jira] [Commented] (YARN-8976) Remove redundant modifiers in interface "ApplicationConstants"

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677571#comment-16677571 ] Weiwei Yang commented on YARN-8976: --- +1, thanks [~tangzhankun] > Remove redundant modif

[jira] [Commented] (YARN-8977) Remove explicit type when called AbstractYarnScheduler#getSchedulerNode to avoid type casting

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677568#comment-16677568 ] Weiwei Yang commented on YARN-8977: --- Hi [~jiwq] Thanks for the patch, looks good. Two c

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677460#comment-16677460 ] Weiwei Yang commented on YARN-8877: --- Hi [~leftnoteasy] I was thinking to put a more nea

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Attachment: YARN-8953.001.patch > Add CSI driver adaptor module > - > >

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676381#comment-16676381 ] Weiwei Yang commented on YARN-8902: --- Hi [~leftnoteasy] {quote}org.apache.hadoop.yarn.ser

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676284#comment-16676284 ] Weiwei Yang commented on YARN-8877: --- Thanks [~leftnoteasy] for the review, I uploaded th

[jira] [Updated] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8877: -- Attachment: YARN-8877.002.patch > Extend service spec to allow setting resource attributes > ---

[jira] [Commented] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676254#comment-16676254 ] Weiwei Yang commented on YARN-8970: --- Thanks [~tangzhankun] for the contribution, I've pu

[jira] [Updated] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8970: -- Fix Version/s: 3.0.4 > Improve the debug message in CS#allocateContainerOnSingleNode > -

[jira] [Updated] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8970: -- Fix Version/s: 3.1.2 > Improve the debug message in CS#allocateContainerOnSingleNode > -

[jira] [Updated] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8970: -- Fix Version/s: 3.2.1 > Improve the debug message in CS#allocateContainerOnSingleNode > -

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676233#comment-16676233 ] Weiwei Yang commented on YARN-8858: --- Thanks [~ajisakaa] for the help! > CapacitySchedul

[jira] [Commented] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676195#comment-16676195 ] Weiwei Yang commented on YARN-8969: --- Pushed to trunk, branch-3.2, branch-3.1, branch-3.0

[jira] [Updated] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8969: -- Fix Version/s: 2.9.3 > AbstractYarnScheduler#getNodeTracker should return generic type to avoid type >

[jira] [Updated] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8969: -- Fix Version/s: 3.0.4 > AbstractYarnScheduler#getNodeTracker should return generic type to avoid type >

[jira] [Updated] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8969: -- Fix Version/s: 3.1.2 > AbstractYarnScheduler#getNodeTracker should return generic type to avoid type >

[jira] [Updated] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8969: -- Fix Version/s: 3.2.1 > AbstractYarnScheduler#getNodeTracker should return generic type to avoid type >

[jira] [Updated] (YARN-8969) AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8969: -- Summary: AbstractYarnScheduler#getNodeTracker should return generic type to avoid type casting (was: Ch

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676137#comment-16676137 ] Weiwei Yang commented on YARN-8969: --- Thanks [~eepayne], [~yufeigu], I also think this is

[jira] [Commented] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676125#comment-16676125 ] Weiwei Yang commented on YARN-8970: --- LGTM, pending on jenkins. > Improve the debug mess

[jira] [Comment Edited] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676053#comment-16676053 ] Weiwei Yang edited comment on YARN-8902 at 11/6/18 2:37 AM: Hi

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16676053#comment-16676053 ] Weiwei Yang commented on YARN-8902: --- Hi [~leftnoteasy] Thanks for the review comments.

[jira] [Updated] (YARN-7812) Improvements to Rich Placement Constraints in YARN

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7812: -- Release Note: Further functionality and usability improvements over placement constraints, which includ

[jira] [Updated] (YARN-7812) Improvements to Rich Placement Constraints in YARN

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7812: -- Release Note: Continual functionality and usability improvements over placement constraints, which incl

[jira] [Commented] (YARN-8971) Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675394#comment-16675394 ] Weiwei Yang commented on YARN-8971: --- cc [~leftnoteasy], pls take a look. > Improvement

[jira] [Updated] (YARN-8971) Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8971: -- Description: This UT seems not work properly. {code:java} // Ask 4GB succeeded. am1.allocate("*", 4 * GB

[jira] [Created] (YARN-8971) Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax

2018-11-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8971: - Summary: Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax Key: YARN-8971 URL: https://issues.apache.org/jira/browse/YARN-8971 Project: H

[jira] [Updated] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8970: -- Description: When a node is unable to allocate container due to insufficient resource, following DEBUG

[jira] [Created] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8970: - Summary: Improve the debug message in CS#allocateContainerOnSingleNode Key: YARN-8970 URL: https://issues.apache.org/jira/browse/YARN-8970 Project: Hadoop YARN Is

[jira] [Comment Edited] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675306#comment-16675306 ] Weiwei Yang edited comment on YARN-8858 at 11/5/18 3:45 PM: Th

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675306#comment-16675306 ] Weiwei Yang commented on YARN-8858: --- Thanks [~ajisakaa] for the reminder, this one got s

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Attachment: YARN-8858-branch-2.8.002.patch > CapacityScheduler should respect maximum node resource when

[jira] [Assigned] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8969: - Assignee: Wanqiang Ji > Change the return type to generic type of AbstractYarnScheduler#getNodeTr

[jira] [Comment Edited] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675277#comment-16675277 ] Weiwei Yang edited comment on YARN-8969 at 11/5/18 2:55 PM: St

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16675277#comment-16675277 ] Weiwei Yang commented on YARN-8969: --- Straightforward fix, thanks [~jiwq]. +1. I will co

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674909#comment-16674909 ] Weiwei Yang commented on YARN-6257: --- [~sunilg], [~Tao Yang], release notes updated. Let

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate key

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6257: -- Summary: CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplic

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6257: -- Summary: CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplic

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6257: -- Release Note: The response format of resource manager's REST API endpoint "ws/v1/cluster/scheduler" is o

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8233: -- Target Version/s: 2.10.0, 3.2.0, 2.9.2, 3.0.4, 3.1.2, 3.3.0 > NPE in CapacityScheduler#tryCommit when ha

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

2018-11-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674687#comment-16674687 ] Weiwei Yang commented on YARN-2599: --- I agree with [~Tao Yang]'s point, separate metrics

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674682#comment-16674682 ] Weiwei Yang commented on YARN-8233: --- LGTM, pending on jenkins, thanks [~Tao Yang]. > NP

[jira] [Commented] (YARN-8833) compute shares may lock the scheduling process

2018-11-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16674677#comment-16674677 ] Weiwei Yang commented on YARN-8833: --- Assigned this ticket to [~yoelee], thanks for the c

[jira] [Assigned] (YARN-8833) compute shares may lock the scheduling process

2018-11-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8833: - Assignee: liyakun > compute shares may lock the scheduling process > ---

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672853#comment-16672853 ] Weiwei Yang commented on YARN-8233: --- Thanks [~Tao Yang], sounds good.  > NPE in Capacit

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672817#comment-16672817 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang] {quote}This calling can make schedul

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672797#comment-16672797 ] Weiwei Yang commented on YARN-8233: --- [~Tao Yang], [~surmountian], does this issue only h

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-11-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672583#comment-16672583 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang] Can we also only do the resource us

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-01 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16672476#comment-16672476 ] Weiwei Yang commented on YARN-7277: --- Hi [~tangzhankun] TestContainerLaunch#testEnvExpan

[jira] [Created] (YARN-8965) Revisit delay scheduling for cloud environment

2018-10-31 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8965: - Summary: Revisit delay scheduling for cloud environment Key: YARN-8965 URL: https://issues.apache.org/jira/browse/YARN-8965 Project: Hadoop YARN Issue Type: Improv

[jira] [Commented] (YARN-8394) Improve data locality documentation for Capacity Scheduler

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16671119#comment-16671119 ] Weiwei Yang commented on YARN-8394: --- Hi [~yufeigu] Apologies I missed your last comment

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16671044#comment-16671044 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang], No worries. I saw it several times,

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16670258#comment-16670258 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang] Thanks for creating the issue and t

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669692#comment-16669692 ] Weiwei Yang commented on YARN-7277: --- Hi [~tangzhankun] Thanks for creating this issue [

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16669572#comment-16669572 ] Weiwei Yang commented on YARN-8902: --- v7 patch fixed the findbugs and checkstyle issues

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.007.patch > Add volume manager that manages CSI volume lifecycle > ---

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16668389#comment-16668389 ] Weiwei Yang commented on YARN-8902: --- [~leftnoteasy], [~sunilg], please help to review.

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16668387#comment-16668387 ] Weiwei Yang commented on YARN-8902: --- v6 patch uploaded, major change is to remove the as

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.006.patch > Add volume manager that manages CSI volume lifecycle > ---

[jira] [Updated] (YARN-8953) Add CSI driver adaptor module

2018-10-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Summary: Add CSI driver adaptor module (was: Add CSI adaptor module) > Add CSI driver adaptor module >

[jira] [Created] (YARN-8953) Add CSI adaptor module

2018-10-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8953: - Summary: Add CSI adaptor module Key: YARN-8953 URL: https://issues.apache.org/jira/browse/YARN-8953 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Updated] (YARN-8915) Update the doc about the default value of "maximum-container-assignments" for capacity scheduler

2018-10-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8915: -- Labels: docuentation (was: ) > Update the doc about the default value of "maximum-container-assignments

[jira] [Updated] (YARN-8915) Update the doc about the default value of "maximum-container-assignments" for capacity scheduler

2018-10-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8915: -- Summary: Update the doc about the default value of "maximum-container-assignments" for capacity schedule

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1718#comment-1718 ] Weiwei Yang commented on YARN-8944: --- Committed to trunk, cherry-picked to branch-3.1 and

[jira] [Updated] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8944: -- Fix Version/s: 3.2.1 3.1.2 > TestContainerAllocation.testUserLimitAllocationMultipleC

[jira] [Updated] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8944: -- Priority: Minor (was: Major) > TestContainerAllocation.testUserLimitAllocationMultipleContainers failur

[jira] [Commented] (YARN-8944) TestContainerAllocation.testUserLimitAllocationMultipleContainers failure after YARN-8896

2018-10-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1711#comment-1711 ] Weiwei Yang commented on YARN-8944: --- +1, committing now, thanks for fixing this [~wilfre

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.005.patch > Add volume manager that manages CSI volume lifecycle > ---

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16665192#comment-16665192 ] Weiwei Yang commented on YARN-8902: --- Hi [~sunilg] Thanks for the review. # I agree we

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.004.patch > Add volume manager that manages CSI volume lifecycle > ---

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.003.patch > Add volume manager that manages CSI volume lifecycle > ---

[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663141#comment-16663141 ] Weiwei Yang edited comment on YARN-8873 at 10/25/18 3:14 AM: -

[jira] [Commented] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663141#comment-16663141 ] Weiwei Yang commented on YARN-8873: --- The error [~anu] pointed out in the trunk-commit jo

[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663141#comment-16663141 ] Weiwei Yang edited comment on YARN-8873 at 10/25/18 3:12 AM: -

[jira] [Comment Edited] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663111#comment-16663111 ] Weiwei Yang edited comment on YARN-8873 at 10/25/18 2:32 AM: -

[jira] [Commented] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663111#comment-16663111 ] Weiwei Yang commented on YARN-8873: --- Thanks [~anu], [~arpitagarwal]. I tried on both OS

[jira] [Commented] (YARN-8873) [YARN-8811] Add CSI java-based client library

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663048#comment-16663048 ] Weiwei Yang commented on YARN-8873: --- Hi [~arpitagarwal] What is the command you used to

[jira] [Updated] (YARN-8941) Fix findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8941: -- Priority: Minor (was: Major) > Fix findbugs warnings in hadoop-yarn-csi > -

[jira] [Commented] (YARN-8941) Fix findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662259#comment-16662259 ] Weiwei Yang commented on YARN-8941: --- Now findbugs warnings are fixed. |{color:#008000}+1

[jira] [Updated] (YARN-8941) Fix findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8941: -- Description: Warnings are caused by protobuf generated classes. > Fix findbugs warnings in hadoop-yarn-c

[jira] [Updated] (YARN-8941) Fix findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8941: -- Summary: Fix findbugs warnings in hadoop-yarn-csi (was: Findbugs warnings in hadoop-yarn-csi) > Fix fi

[jira] [Updated] (YARN-8941) Findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8941: -- Attachment: YARN-8941.01.patch > Findbugs warnings in hadoop-yarn-csi >

[jira] [Commented] (YARN-8941) Findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662061#comment-16662061 ] Weiwei Yang commented on YARN-8941: --- Indeed, we should exclude protobuf generated classe

[jira] [Commented] (YARN-8939) Javadoc build fails in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662042#comment-16662042 ] Weiwei Yang commented on YARN-8939: --- Thanks [~tasanuma0829]. I am going to commit v2 pat

[jira] [Assigned] (YARN-8941) Findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8941: - Assignee: Weiwei Yang > Findbugs warnings in hadoop-yarn-csi > --

[jira] [Commented] (YARN-8941) Findbugs warnings in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16662037#comment-16662037 ] Weiwei Yang commented on YARN-8941: --- Interesting, in YARN-8873, jenkins reports some fin

[jira] [Commented] (YARN-8939) Javadoc build fails in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661865#comment-16661865 ] Weiwei Yang commented on YARN-8939: --- Sure [~tasanuma0829], let me take care of it, thank

[jira] [Commented] (YARN-8940) Add volume as a top-level attribute in service spec

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661862#comment-16661862 ] Weiwei Yang commented on YARN-8940: --- Hi [~eyang] Here is the list of access modes suppo

[jira] [Commented] (YARN-8939) Javadoc build fails in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661828#comment-16661828 ] Weiwei Yang commented on YARN-8939: --- [~ajisakaa] pls hold on committing this, the fix is

[jira] [Updated] (YARN-8939) Javadoc build fails in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8939: -- Attachment: YARN-8939.2.patch > Javadoc build fails in hadoop-yarn-csi > ---

[jira] [Commented] (YARN-8939) Javadoc build fails in hadoop-yarn-csi

2018-10-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661823#comment-16661823 ] Weiwei Yang commented on YARN-8939: --- Thanks [~tasanuma0829] for filing this issue. I tri

[jira] [Updated] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Attachment: YARN-8902.002.patch > Add volume manager that manages CSI volume lifecycle > ---

<    2   3   4   5   6   7   8   9   10   11   >