[jira] [Updated] (YARN-8152) Add chart in SLS to illustrate the throughput of the scheduler

2018-04-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8152: --- Attachment: commit throughput chart.png > Add chart in SLS to illustrate the throughput of the scheduler >

[jira] [Commented] (YARN-8152) Add chart in SLS to illustrate the throughput of the scheduler

2018-04-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16453749#comment-16453749 ] Tao Yang commented on YARN-8152: Attached v1 patch for review. Related modifications: (1)

[jira] [Updated] (YARN-8152) Add chart in SLS to illustrate the throughput of the scheduler

2018-04-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8152: --- Attachment: timecost chart.png > Add chart in SLS to illustrate the throughput of the scheduler > -

[jira] [Updated] (YARN-8152) Add chart in SLS to illustrate the throughput of the scheduler

2018-04-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8152: --- Attachment: YARN-8152.001.patch > Add chart in SLS to illustrate the throughput of the scheduler >

[jira] [Commented] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2018-04-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433939#comment-16433939 ] Tao Yang commented on YARN-7527: Thanks [~cheersyang] for your reminding!  Attached v2 pat

[jira] [Updated] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2018-04-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7527: --- Attachment: YARN-7527-branch-2.002.patch > Over-allocate node resource in async-scheduling mode of CapacitySche

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.004.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: (was: YARN-8127.003.patch) > Resource leak when async scheduling is enabled > -

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: (was: YARN-8127.003.patch) > Resource leak when async scheduling is enabled > -

[jira] [Comment Edited] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433368#comment-16433368 ] Tao Yang edited comment on YARN-8127 at 4/11/18 4:00 AM: - Thanks [~

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433368#comment-16433368 ] Tao Yang commented on YARN-8127: Attached v3 patch to simplify the check logic. > Resource

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16433317#comment-16433317 ] Tao Yang commented on YARN-8127: Attached v2 patch to fix UT and the check-style error > R

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.002.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.001.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16432214#comment-16432214 ] Tao Yang commented on YARN-8127: Thanks [~cheersyang]. Some additional details: This proble

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431661#comment-16431661 ] Tao Yang commented on YARN-6629: Hi, [~hunanmei...@gmail.com]. Yes, it's the same question.

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.branch-2.001.patch > NPE occurred when container allocation proposal is applied but its r

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420096#comment-16420096 ] Tao Yang commented on YARN-6257: Thanks [~eyang], [~leftnoteasy], [~sunilg] and [~cheersyan

[jira] [Commented] (YARN-8085) ResourceProfilesManager should be set in RMActiveServiceContext

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420094#comment-16420094 ] Tao Yang commented on YARN-8085: Thanks [~sunilg], [~rohithsharma], [~cheersyang] and [~lef

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418575#comment-16418575 ] Tao Yang commented on YARN-8085: Thanks [~leftnoteasy]. Please wait for a moment, [~cheers

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418568#comment-16418568 ] Tao Yang commented on YARN-8085: Thanks [~rohithsharma] for your mention. Attached v4 patch

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.004.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.003.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418519#comment-16418519 ] Tao Yang commented on YARN-8085: Thanks [~rohithsharma], [~sunilg] for your mentions.  I w

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.002.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418461#comment-16418461 ] Tao Yang commented on YARN-8085: Thanks [~cheersyang] for your suggestion. Yes, RMServiceC

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.001.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Created] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-8085: -- Summary: RMContext#resourceProfilesManager is lost after RM went standby then back to active Key: YARN-8085 URL: https://issues.apache.org/jira/browse/YARN-8085 Project: Hadoop Y

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417105#comment-16417105 ] Tao Yang commented on YARN-7734: Thanks [~cheersyang] for review and committing. > YARN-54

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.004.patch > CapacityScheduler REST API produces incorrect JSON - JSON object > operation

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417097#comment-16417097 ] Tao Yang commented on YARN-6257: Thanks [~sunilg] and [~cheersyang] for your suggestions.

[jira] [Assigned] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7734: -- Assignee: Tao Yang (was: Xuan Gong) > YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416898#comment-16416898 ] Tao Yang commented on YARN-7734: This UT failure is still there. Attached patch which adds 

[jira] [Updated] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7734: --- Attachment: YARN-7734.001.patch > YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess > -

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416861#comment-16416861 ] Tao Yang commented on YARN-6257: Thanks [~cheersyang] for your comments. Attached v3 patch

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.003.patch > CapacityScheduler REST API produces incorrect JSON - JSON object > operation

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415152#comment-16415152 ] Tao Yang commented on YARN-6257: [~leftnoteasy], [~sunilg].  Could you please take a look a

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415041#comment-16415041 ] Tao Yang commented on YARN-6629: Thanks [~leftnoteasy] for your mention. Yes, they are re

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.006.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413017#comment-16413017 ] Tao Yang commented on YARN-6629: Attached v5 patch, changed the check as mentioned above. T

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.005.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-23 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.004.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-23 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410935#comment-16410935 ] Tao Yang commented on YARN-6629: Thanks [~leftnoteasy] for your comment. I have checked ot

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-22 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409248#comment-16409248 ] Tao Yang commented on YARN-6629: cc: [~leftnoteasy] & [~cheersyang],  please help to review

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16406047#comment-16406047 ] Tao Yang commented on YARN-7461: Thanks [~sunilg] for your comments. {quote} But my conce

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.004.patch > DominantResourceCalculator#ratio calculation problem when right resource > c

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401711#comment-16401711 ] Tao Yang commented on YARN-7461: Updated v4 patch to run RM test cases through fixing check

[jira] [Commented] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399855#comment-16399855 ] Tao Yang commented on YARN-7636:   Attached v3 patch to fix the compile error (v2 patch fo

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.003.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Commented] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399739#comment-16399739 ] Tao Yang commented on YARN-7636: Thanks [~cheersyang] and [~leftnoteasy] for your reviews.

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398499#comment-16398499 ] Tao Yang commented on YARN-6629: Uploaded v3 patch for trunk, [~sunilg], Please help to rev

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.003.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Affects Version/s: (was: 3.0.0-alpha4) 3.1.0 > Re-reservation count may overflow whe

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.002.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.002.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: (was: YARN-7636.002.patch) > Re-reservation count may overflow when cluster resource exhausted

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Description: Exception stack: {noformat} java.lang.IllegalArgumentException: Overflow adding 1 occurrences to a

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391027#comment-16391027 ] Tao Yang commented on YARN-8011: Thanks [~cheersyang] for reviewing and committing! > Test

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390857#comment-16390857 ] Tao Yang commented on YARN-8011: Thanks Weiwei Yang for your suggestions. Yes, we can fix

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Attachment: YARN-8011.002.patch > TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBef

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Attachment: YARN-8011.001.patch > TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBef

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Description: TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart of

[jira] [Created] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
Tao Yang created YARN-8011: -- Summary: TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk Key: YARN-8011 URL: https://issues.apache.org/jira/browse/YAR

[jira] [Commented] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

2018-03-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16385481#comment-16385481 ] Tao Yang commented on YARN-7511: Thanks [~jlowe] for reviewing and committing this patch!

[jira] [Commented] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

2018-03-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383155#comment-16383155 ] Tao Yang commented on YARN-7511: Hi [~Sammi], It's ok to modify the target version since no

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-01-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16346404#comment-16346404 ] Tao Yang commented on YARN-7494: Thanks [~cheersyang] for your mention. Some thoughts (par

[jira] [Created] (YARN-7751) Decommissioned NM leaves orphaned containers

2018-01-15 Thread Tao Yang (JIRA)
Tao Yang created YARN-7751: -- Summary: Decommissioned NM leaves orphaned containers Key: YARN-7751 URL: https://issues.apache.org/jira/browse/YARN-7751 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2018-01-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: (was: YARN-7005.003.patch) > Skip unnecessary sorting and iterating process for child queues wi

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2018-01-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.003.patch > Skip unnecessary sorting and iterating process for child queues without > pe

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2018-01-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.003.patch Attaching v3 patch. [~leftnoteasy], [~sunilg], please help to review in your f

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

2017-12-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16292621#comment-16292621 ] Tao Yang commented on YARN-7457: Thanks all for your comments. I didn't clarify the true p

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.002.patch > Skip unnecessary sorting and iterating process for child queues without > pe

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: (was: YARN-7005.002.patch) > Skip unnecessary sorting and iterating process for child queues wi

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.002.patch Thanks [~leftnoteasy] for your suggestion. Attaching v2 patch with performance

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

2017-12-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290223#comment-16290223 ] Tao Yang commented on YARN-7457: Hi, [~leftnoteasy], [~templedf] I'm glad to take a crack a

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2017-12-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.001.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Created] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2017-12-11 Thread Tao Yang (JIRA)
Tao Yang created YARN-7636: -- Summary: Re-reservation count may overflow when cluster resource exhausted for a long time Key: YARN-7636 URL: https://issues.apache.org/jira/browse/YARN-7636 Project: Hadoop YA

[jira] [Comment Edited] (YARN-7494) Add muti node lookup support for better placement

2017-12-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang edited comment on YARN-7494 at 12/8/17 11:47 AM: -- Thanks

[jira] [Comment Edited] (YARN-7494) Add muti node lookup support for better placement

2017-12-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang edited comment on YARN-7494 at 12/8/17 11:45 AM: -- Thanks

[jira] [Comment Edited] (YARN-7494) Add muti node lookup support for better placement

2017-12-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang edited comment on YARN-7494 at 12/8/17 11:43 AM: -- Thanks

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2017-12-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283419#comment-16283419 ] Tao Yang commented on YARN-7494: Thanks for the patch. [~sunilg] Some thoughts from my side

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2017-12-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16283265#comment-16283265 ] Tao Yang commented on YARN-5139: Thanks [~leftnoteasy] for detailed introduction above and

[jira] [Assigned] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7621: -- Assignee: Tao Yang > Support submitting apps with queue path for CapacityScheduler > ---

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7621: --- Attachment: YARN-7621.001.patch Attaching init patch for review. > Support submitting apps with queue path for

[jira] [Created] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
Tao Yang created YARN-7621: -- Summary: Support submitting apps with queue path for CapacityScheduler Key: YARN-7621 URL: https://issues.apache.org/jira/browse/YARN-7621 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7591: --- Attachment: YARN-7591.002.patch Thanks [~leftnoteasy] for your suggestion. Attaching v2 patch with comments of

[jira] [Commented] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16276622#comment-16276622 ] Tao Yang commented on YARN-7005: Thanks [~leftnoteasy] for your suggestions. Yes, it's enou

[jira] [Commented] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-03 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16276346#comment-16276346 ] Tao Yang commented on YARN-7591: Thanks [~leftnoteasy] for review. {quote} I'm still not s

[jira] [Updated] (YARN-7593) SessionMovedException in ZKRMStateStore and can't auto recover

2017-12-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7593: --- Summary: SessionMovedException in ZKRMStateStore and can't auto recover (was: SessionMovedException in ZKRMSta

[jira] [Updated] (YARN-7593) SessionMovedException in ZKRMStateStore and can't recover

2017-12-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7593: --- Summary: SessionMovedException in ZKRMStateStore and can't recover (was: SessionMovedException in ZKRMStateSto

[jira] [Created] (YARN-7593) SessionMovedException in ZKRMStateStore and can't auto recover after ZK connection timeout

2017-12-01 Thread Tao Yang (JIRA)
Tao Yang created YARN-7593: -- Summary: SessionMovedException in ZKRMStateStore and can't auto recover after ZK connection timeout Key: YARN-7593 URL: https://issues.apache.org/jira/browse/YARN-7593 Project: H

[jira] [Updated] (YARN-7005) Skip unnecessary sorting and iterating process for child queues without pending resource to optimize schedule performance

2017-12-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7005: --- Attachment: YARN-7005.001.patch Attaching init patch for review. [~leftnoteasy], please help to review in your

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2017-12-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16274131#comment-16274131 ] Tao Yang commented on YARN-5139: Async-scheduling decouples scheduling from nm heartbeats a

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-11-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7591: --- Attachment: YARN-7591.001.patch Attaching init patch without UT for review. [~leftnoteasy], please help to rev

[jira] [Created] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-11-30 Thread Tao Yang (JIRA)
Tao Yang created YARN-7591: -- Summary: NPE in async-scheduling mode of CapacityScheduler Key: YARN-7591 URL: https://issues.apache.org/jira/browse/YARN-7591 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2017-11-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7527: --- Attachment: YARN-7527-branch-2.001.patch Thanks [~leftnoteasy] for review and commit. Attaching patch for branc

[jira] [Commented] (YARN-7004) Add configs cache to optimize refreshQueues performance for large scale of queues

2017-11-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259019#comment-16259019 ] Tao Yang commented on YARN-7004: Thanks [~leftnoteasy] and [~jhung] for your comments. Thi

<    3   4   5   6   7   8   9   10   >