[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Description: TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart of

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Attachment: YARN-8011.001.patch > TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBef

[jira] [Updated] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8011: --- Attachment: YARN-8011.002.patch > TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBef

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390857#comment-16390857 ] Tao Yang commented on YARN-8011: Thanks Weiwei Yang for your suggestions. Yes, we can fix

[jira] [Commented] (YARN-8011) TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk

2018-03-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391027#comment-16391027 ] Tao Yang commented on YARN-8011: Thanks [~cheersyang] for reviewing and committing! > Test

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Description: Exception stack: {noformat} java.lang.IllegalArgumentException: Overflow adding 1 occurrences to a

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: (was: YARN-7636.002.patch) > Re-reservation count may overflow when cluster resource exhausted

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.002.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.002.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Affects Version/s: (was: 3.0.0-alpha4) 3.1.0 > Re-reservation count may overflow whe

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.003.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16398499#comment-16398499 ] Tao Yang commented on YARN-6629: Uploaded v3 patch for trunk, [~sunilg], Please help to rev

[jira] [Commented] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399739#comment-16399739 ] Tao Yang commented on YARN-7636: Thanks [~cheersyang] and [~leftnoteasy] for your reviews.

[jira] [Updated] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7636: --- Attachment: YARN-7636.003.patch > Re-reservation count may overflow when cluster resource exhausted for a long

[jira] [Commented] (YARN-7636) Re-reservation count may overflow when cluster resource exhausted for a long time

2018-03-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16399855#comment-16399855 ] Tao Yang commented on YARN-7636:   Attached v3 patch to fix the compile error (v2 patch fo

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16401711#comment-16401711 ] Tao Yang commented on YARN-7461: Updated v4 patch to run RM test cases through fixing check

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.004.patch > DominantResourceCalculator#ratio calculation problem when right resource > c

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2018-03-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16406047#comment-16406047 ] Tao Yang commented on YARN-7461: Thanks [~sunilg] for your comments. {quote} But my conce

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-22 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16409248#comment-16409248 ] Tao Yang commented on YARN-6629: cc: [~leftnoteasy] & [~cheersyang],  please help to review

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-23 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410935#comment-16410935 ] Tao Yang commented on YARN-6629: Thanks [~leftnoteasy] for your comment. I have checked ot

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-23 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.004.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.005.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16413017#comment-16413017 ] Tao Yang commented on YARN-6629: Attached v5 patch, changed the check as mentioned above. T

[jira] [Updated] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6629: --- Attachment: YARN-6629.006.patch > NPE occurred when container allocation proposal is applied but its resource

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415041#comment-16415041 ] Tao Yang commented on YARN-6629: Thanks [~leftnoteasy] for your mention. Yes, they are re

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16415152#comment-16415152 ] Tao Yang commented on YARN-6257: [~leftnoteasy], [~sunilg].  Could you please take a look a

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.003.patch > CapacityScheduler REST API produces incorrect JSON - JSON object > operation

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416861#comment-16416861 ] Tao Yang commented on YARN-6257: Thanks [~cheersyang] for your comments. Attached v3 patch

[jira] [Updated] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7734: --- Attachment: YARN-7734.001.patch > YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess > -

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416898#comment-16416898 ] Tao Yang commented on YARN-7734: This UT failure is still there. Attached patch which adds 

[jira] [Assigned] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7734: -- Assignee: Tao Yang (was: Xuan Gong) > YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417097#comment-16417097 ] Tao Yang commented on YARN-6257: Thanks [~sunilg] and [~cheersyang] for your suggestions.

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.004.patch > CapacityScheduler REST API produces incorrect JSON - JSON object > operation

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16417105#comment-16417105 ] Tao Yang commented on YARN-7734: Thanks [~cheersyang] for review and committing. > YARN-54

[jira] [Created] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-8085: -- Summary: RMContext#resourceProfilesManager is lost after RM went standby then back to active Key: YARN-8085 URL: https://issues.apache.org/jira/browse/YARN-8085 Project: Hadoop Y

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.001.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418461#comment-16418461 ] Tao Yang commented on YARN-8085: Thanks [~cheersyang] for your suggestion. Yes, RMServiceC

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.002.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418519#comment-16418519 ] Tao Yang commented on YARN-8085: Thanks [~rohithsharma], [~sunilg] for your mentions.  I w

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.003.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.004.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418568#comment-16418568 ] Tao Yang commented on YARN-8085: Thanks [~rohithsharma] for your mention. Attached v4 patch

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16418575#comment-16418575 ] Tao Yang commented on YARN-8085: Thanks [~leftnoteasy]. Please wait for a moment, [~cheers

[jira] [Commented] (YARN-8085) ResourceProfilesManager should be set in RMActiveServiceContext

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420094#comment-16420094 ] Tao Yang commented on YARN-8085: Thanks [~sunilg], [~rohithsharma], [~cheersyang] and [~lef

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420096#comment-16420096 ] Tao Yang commented on YARN-6257: Thanks [~eyang], [~leftnoteasy], [~sunilg] and [~cheersyan

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2017-02-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15855496#comment-15855496 ] Tao Yang commented on YARN-5139: Hi, [~leftnoteasy]. YARN-5716 seems not to be able to look

[jira] [Commented] (YARN-6092) Refreshing CapacityScheduler page throws NPE

2017-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874229#comment-15874229 ] Tao Yang commented on YARN-6092: Hi,[~ajithshetty]. I found this problem when doing test on

[jira] [Created] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-02-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-6257: -- Summary: CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key Key: YARN-6257 URL: https://issues.apache.org/jira/browse/YARN-6257

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-02-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Description: In response string of CapacityScheduler REST API, scheduler/schedulerInfo/health/operationsInfo h

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-02-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.001.patch Attach a patch for review. > CapacityScheduler REST API produces incorrect JSO

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-03-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889796#comment-15889796 ] Tao Yang commented on YARN-6257: Hi, [~sunilg]. Thank you for looking into the issue. {quot

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-03-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Description: In response string of CapacityScheduler REST API, scheduler/schedulerInfo/health/operationsInfo h

[jira] [Created] (YARN-6259) Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-03-01 Thread Tao Yang (JIRA)
Tao Yang created YARN-6259: -- Summary: Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices Key: YARN-6259 URL: https://issues.apache.org/jira/browse/YARN-6259

[jira] [Updated] (YARN-6259) Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-03-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6259: --- Attachment: YARN-6259.001.patch Attach a patch for review > Support pagination and optimize data transfer with

[jira] [Commented] (YARN-6259) Support pagination and optimize data transfer with zero-copy approach for containerlogs REST API in NMWebServices

2017-03-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891423#comment-15891423 ] Tao Yang commented on YARN-6259: Hi, [~rohithsharma]. Thank you for looking into this issue

[jira] [Created] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-6403: -- Summary: Invalid local resource request can raise NPE and make NM exit Key: YARN-6403 URL: https://issues.apache.org/jira/browse/YARN-6403 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Description: Recently we found this problem on our testing environment. The app that caused this problem added

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946419#comment-15946419 ] Tao Yang commented on YARN-6403: [~Naganarasimha] Yes, I would like to work on this and wil

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Attachment: YARN-6403.001.patch Attach a patch for review. * Add local resources check in ContainerImpl$Request

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Attachment: YARN-6403.002.patch [~jlowe] Thanks for correcting me. The last server-side change is not proper a

[jira] [Commented] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950419#comment-15950419 ] Tao Yang commented on YARN-6403: [~jlowe] Thanks for your time! {quote} I believe it's app

[jira] [Updated] (YARN-6403) Invalid local resource request can raise NPE and make NM exit

2017-03-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6403: --- Attachment: YARN-6403.branch-2.8.003.patch Attach new patch for branch-2.8 > Invalid local resource request ca

[jira] [Commented] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611463#comment-16611463 ] Tao Yang commented on YARN-8764: Hi, [~ziqian hu]. I have found this problem and suggested

[jira] [Commented] (YARN-8764) Comparison method violates its general contract in Async Schedule

2018-09-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611604#comment-16611604 ] Tao Yang commented on YARN-8764: Just notice that this issue is about Hadoop2.8, I agree t

[jira] [Created] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-13 Thread Tao Yang (JIRA)
Tao Yang created YARN-8771: -- Summary: CapacityScheduler fails to unreserve when cluster resource contains empty resource type Key: YARN-8771 URL: https://issues.apache.org/jira/browse/YARN-8771 Project: Hado

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.001.patch > CapacityScheduler fails to unreserve when cluster resource contains empty >

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613299#comment-16613299 ] Tao Yang commented on YARN-8771: Attached v1 patch for review. [~cheersyang], can you hel

[jira] [Commented] (YARN-8729) Node status updater thread could be lost after it is restarted

2018-09-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614289#comment-16614289 ] Tao Yang commented on YARN-8729: Thanks [~cheersyang], [~ebadger] ! > Node status updater

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.002.patch > CapacityScheduler fails to unreserve when cluster resource contains empty >

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614300#comment-16614300 ] Tao Yang commented on YARN-8771: Attached v2 patch to fix checkstyle error. UT failure c

[jira] [Created] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-14 Thread Tao Yang (JIRA)
Tao Yang created YARN-8774: -- Summary: Memory leak when CapacityScheduler allocates from reserved container with non-default label Key: YARN-8774 URL: https://issues.apache.org/jira/browse/YARN-8774 Project:

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Description: The cause is that the RMContainerImpl instance of reserved container lost its node label express

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.001.patch > Memory leak when CapacityScheduler allocates from reserved container with >

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614866#comment-16614866 ] Tao Yang commented on YARN-8774: Attached v1 patch for review. > Memory leak when Capacit

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Affects Version/s: 2.8.5 3.2.0 > Memory leak when CapacityScheduler allocates from rese

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Description: We found this problem when cluster is almost but not exhausted (93% used), scheduler kept alloca

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Description: We found this problem when cluster is almost but not exhausted (93% used), scheduler kept alloca

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Description: We found this problem when cluster is almost but not exhausted (93% used), scheduler kept alloca

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619181#comment-16619181 ] Tao Yang commented on YARN-8771: Thanks [~cheersyang] for the review. {quote} Instead of a

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620001#comment-16620001 ] Tao Yang commented on YARN-8771: Thanks [~leftnoteasy] for your review and suggestion. I

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.003.patch > CapacityScheduler fails to unreserve when cluster resource contains empty >

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620042#comment-16620042 ] Tao Yang commented on YARN-8771: Attached v3 patch to improve unit test without adding new

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.004.patch > CapacityScheduler fails to unreserve when cluster resource contains empty >

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620333#comment-16620333 ] Tao Yang commented on YARN-8771: Attached v4 patch to fix check-style error. UT failures

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621414#comment-16621414 ] Tao Yang commented on YARN-8771: Thanks [~cheersyang] and [~leftnoteasy] ! > CapacitySche

[jira] [Created] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
Tao Yang created YARN-8804: -- Summary: resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues Key: YARN-8804 URL: https://issues.apache.org/jira/browse/YARN-8804 P

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Description: This problem is due to YARN-4280, parent queue will deduct child queue's headroom when the child

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.001.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in > cl

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621631#comment-16621631 ] Tao Yang commented on YARN-8804: Attached v1 patch which will add a blockedHeadroom field

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623035#comment-16623035 ] Tao Yang commented on YARN-8804: Thanks [~jlowe],[~leftnoteasy] for your review and reply.

[jira] [Comment Edited] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623035#comment-16623035 ] Tao Yang edited comment on YARN-8804 at 9/21/18 4:05 AM: - Thanks [

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.002.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in > cl

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623037#comment-16623037 ] Tao Yang commented on YARN-8804: Attached v2 patch to remove violate keyword and improve t

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623040#comment-16623040 ] Tao Yang commented on YARN-8513: Hi, [~cyfdecyf] Dose your cluster have empty resource typ

[jira] [Comment Edited] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623035#comment-16623035 ] Tao Yang edited comment on YARN-8804 at 9/21/18 4:17 AM: - Thanks [

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

2018-09-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623315#comment-16623315 ] Tao Yang commented on YARN-2599: Hi, [~Naganarasimha]. Some JVM metrics of standby RM can

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.003.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in > cl

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624281#comment-16624281 ] Tao Yang commented on YARN-8804: Thanks [~jlowe] for the review. Attached v3 patch to reba

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.branch-2.001.patch > Memory leak when CapacityScheduler allocates from reserved containe

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: (was: YARN-8774.branch-2.001.patch) > Memory leak when CapacityScheduler allocates from reserv

<    3   4   5   6   7   8   9   10   >