[jira] [Updated] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8717: -- Labels: cgroups (was: ) > set memory.limit_in_bytes when NodeManager starting > ---

[jira] [Updated] (YARN-8723) Fix a typo in CS init error message when resource calculator is not correctly set

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8723: -- Summary: Fix a typo in CS init error message when resource calculator is not correctly set (was: Typo i

[jira] [Commented] (YARN-8723) Typo in CS init error message when resource calculator is not correctly set

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595867#comment-16595867 ] Weiwei Yang commented on YARN-8723: --- +1, committing now. > Typo in CS init error messag

[jira] [Updated] (YARN-8721) Relax NE node-attribute check when attribute doesn't exist on a node

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8721: -- Summary: Relax NE node-attribute check when attribute doesn't exist on a node (was: Scheduler should ac

[jira] [Commented] (YARN-8721) Scheduler should accept nodes which doesnt have an attribute when NodeAttributeType.NE is used

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594740#comment-16594740 ] Weiwei Yang commented on YARN-8721: --- +1, I will commit this shortly. > Scheduler should

[jira] [Updated] (YARN-8723) Typo in CS init error message when resource calculator is not correctly set

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8723: -- Affects Version/s: 3.2.0 3.1.0 3.1.1 > Typo in CS init err

[jira] [Updated] (YARN-8723) Typo in CS init error message when resource calculator is not correctly set

2018-08-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8723: -- Labels: annotation newbie (was: ) > Typo in CS init error message when resource calculator is not corre

[jira] [Created] (YARN-8723) Typo in CS init error message when resource calculator is not correctly set

2018-08-28 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8723: - Summary: Typo in CS init error message when resource calculator is not correctly set Key: YARN-8723 URL: https://issues.apache.org/jira/browse/YARN-8723 Project: Hadoop YAR

[jira] [Commented] (YARN-8717) set memory.limit_in_bytes when NodeManager starting

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594458#comment-16594458 ] Weiwei Yang commented on YARN-8717: --- Hi [~yangjiandan] Thanks for raising up this, acco

[jira] [Commented] (YARN-8721) Scheduler should accept nodes which doesnt have an attribute when NodeAttributeType.NE is used

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16594411#comment-16594411 ] Weiwei Yang commented on YARN-8721: --- Hi [~sunilg] {quote}When we add next node attribute

[jira] [Comment Edited] (YARN-8719) Typo correction for yarn configuration in OpportunisticContainers(federation) docs

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593953#comment-16593953 ] Weiwei Yang edited comment on YARN-8719 at 8/27/18 5:14 PM: Ju

[jira] [Updated] (YARN-8719) Typo correction for yarn configuration in OpportunisticContainers(federation) docs

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8719: -- Fix Version/s: (was: 3.0.3) 3.0.4 > Typo correction for yarn configuration in Opp

[jira] [Updated] (YARN-8719) Typo correction for yarn configuration in OpportunisticContainers(federation) docs

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8719: -- Fix Version/s: 3.0.3 > Typo correction for yarn configuration in OpportunisticContainers(federation) >

[jira] [Assigned] (YARN-8719) Typo correction for yarn configuration in OpportunisticContainers(federation) docs

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8719: - Assignee: Y. SREENIVASULU REDDY > Typo correction for yarn configuration in OpportunisticContaine

[jira] [Commented] (YARN-8719) Typo correction for yarn configuration in OpportunisticContainers(federation) docs

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593939#comment-16593939 ] Weiwei Yang commented on YARN-8719: --- +1, will commit this shortly. Thanks [~sreenivasulu

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

2018-08-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593499#comment-16593499 ] Weiwei Yang commented on YARN-1013: --- Hi [~asuresh], pls go ahead.. I am busy with someth

[jira] [Updated] (YARN-7812) Improvements to Rich Placement Constraints in YARN

2018-08-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7812: -- Issue Type: Improvement (was: Bug) > Improvements to Rich Placement Constraints in YARN > -

[jira] [Comment Edited] (YARN-8555) Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options

2018-08-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593149#comment-16593149 ] Weiwei Yang edited comment on YARN-8555 at 8/27/18 3:15 AM: Lo

[jira] [Comment Edited] (YARN-8555) Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options

2018-08-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593149#comment-16593149 ] Weiwei Yang edited comment on YARN-8555 at 8/27/18 3:09 AM: Lo

[jira] [Commented] (YARN-8555) Parameterize TestSchedulingRequestContainerAllocation(Async) to cover both PC handler options

2018-08-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593149#comment-16593149 ] Weiwei Yang commented on YARN-8555: --- Looks like processor handler still has some limitat

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593113#comment-16593113 ] Weiwei Yang commented on YARN-7863: --- Sounds good to me, +1. Lets get this one in. Thanks

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593099#comment-16593099 ] Weiwei Yang commented on YARN-7863: --- Hi [~sunilg] Latest patch seems good to me, except

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592740#comment-16592740 ] Weiwei Yang commented on YARN-7863: --- Thanks [~sunilg], the patch looks good. To make cod

[jira] [Created] (YARN-8715) Make allocation tags in the placement spec optional for node-attributes

2018-08-25 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8715: - Summary: Make allocation tags in the placement spec optional for node-attributes Key: YARN-8715 URL: https://issues.apache.org/jira/browse/YARN-8715 Project: Hadoop YARN

[jira] [Closed] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang closed YARN-8704. - > Improve the error message for an invalid docker rw mount to be more > informative > ---

[jira] [Resolved] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-8704. --- Resolution: Invalid > Improve the error message for an invalid docker rw mount to be more > informati

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591039#comment-16591039 ] Weiwei Yang commented on YARN-8704: --- Hi [~eyang], [~shaneku...@gmail.com] Thanks for th

[jira] [Commented] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16590528#comment-16590528 ] Weiwei Yang commented on YARN-8704: --- cc [~shaneku...@gmail.com], [~eyang] > Improve the

[jira] [Updated] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8704: -- Description: Seeing following error message while starting a privileged docker container {noformat} Erro

[jira] [Updated] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8704: -- Description: Seeing following error message while starting a privileged docker container {noformat} Erro

[jira] [Created] (YARN-8704) Improve the error message for an invalid docker rw mount to be more informative

2018-08-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8704: - Summary: Improve the error message for an invalid docker rw mount to be more informative Key: YARN-8704 URL: https://issues.apache.org/jira/browse/YARN-8704 Project: Hadoop

[jira] [Commented] (YARN-8015) Support all types of placement constraint support for Capacity Scheduler

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589704#comment-16589704 ] Weiwei Yang commented on YARN-8015: --- Thanks [~sunilg]! > Support all types of placement

[jira] [Commented] (YARN-8692) Support node utilization metrics for SLS

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589680#comment-16589680 ] Weiwei Yang commented on YARN-8692: --- +1 for the idea, it will be very helpful for testin

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589605#comment-16589605 ] Weiwei Yang commented on YARN-7863: --- Hi [~Naganarasimha] Unlike partitions, PC is not a

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589116#comment-16589116 ] Weiwei Yang commented on YARN-7863: --- Hi [~Naganarasimha] Regarding some of your comment

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588996#comment-16588996 ] Weiwei Yang commented on YARN-7863: --- Hi [~sunilg] Thanks for the updates. I think v8 pa

[jira] [Comment Edited] (YARN-8670) Support scheduling request for SLS input and attributes for Node in SLS

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588925#comment-16588925 ] Weiwei Yang edited comment on YARN-8670 at 8/22/18 2:36 PM: Hi

[jira] [Commented] (YARN-8670) Support scheduling request for SLS input and attributes for Node in SLS

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588925#comment-16588925 ] Weiwei Yang commented on YARN-8670: --- Hi [~Sichen Zhao] {quote}it seems all the improveme

[jira] [Updated] (YARN-8670) Support scheduling request for SLS input and attributes for Node in SLS

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8670: -- Target Version/s: (was: YARN-3409) > Support scheduling request for SLS input and attributes for Node

[jira] [Commented] (YARN-8685) Add containers query support for nodes/node REST API in RMWebServices

2018-08-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588896#comment-16588896 ] Weiwei Yang commented on YARN-8685: --- Hi [~Tao Yang] {quote}There is a ContainerInfo clas

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588279#comment-16588279 ] Weiwei Yang commented on YARN-8015: --- Hi [~sunilg], thanks {quote}I think we can commit t

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587564#comment-16587564 ] Weiwei Yang commented on YARN-7494: --- I just pushed the patch to trunk, thanks for all th

[jira] [Updated] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7863: -- Fix Version/s: (was: 3.2.0) > Modify placement constraints to support node attributes >

[jira] [Issue Comment Deleted] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7863: -- Comment: was deleted (was: I just pushed this to trunk. Thanks for getting it done [~sunilg]! And thank

[jira] [Reopened] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-7863: --- > Modify placement constraints to support node attributes > --

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587535#comment-16587535 ] Weiwei Yang commented on YARN-7494: --- LGTM, +1 to v20 patch. I will commit this to trunk

[jira] [Updated] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7494: -- Summary: Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decis

[jira] [Commented] (YARN-8685) Add containers query support for nodes/node REST API in RMWebServices

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587317#comment-16587317 ] Weiwei Yang commented on YARN-8685: --- Hi [~Tao Yang] Can we add a new endpoint in RM som

[jira] [Commented] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587295#comment-16587295 ] Weiwei Yang commented on YARN-8683: --- Thanks [~Tao Yang] for the contribution, I have com

[jira] [Updated] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Issue Type: Improvement (was: Bug) > Support to display pending scheduling requests in RM app attempt p

[jira] [Updated] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Summary: Support to display pending scheduling requests in RM app attempt page (was: Display pending s

[jira] [Updated] (YARN-8683) Display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Summary: Display pending scheduling requests in RM app attempt page (was: Display outstanding pending

[jira] [Updated] (YARN-8683) Display outstanding pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Summary: Display outstanding pending scheduling requests in RM app attempt page (was: Support scheduli

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587287#comment-16587287 ] Weiwei Yang commented on YARN-8683: --- +1, committing now > Support scheduling request fo

[jira] [Commented] (YARN-8681) Wrong error message in RM placement constraints check

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587140#comment-16587140 ] Weiwei Yang commented on YARN-8681: --- Hi [~snemeth] lets close it as won't fix as this co

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587137#comment-16587137 ] Weiwei Yang commented on YARN-8683: --- Hi [~Tao Yang], yep, that looks better, could you p

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587131#comment-16587131 ] Weiwei Yang commented on YARN-8683: --- Thanks [~Tao Yang], LGTM, pending on jenkins. > Su

[jira] [Comment Edited] (YARN-8686) Queue Management API - not returning JSON or XML response data when passing Accept header

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587029#comment-16587029 ] Weiwei Yang edited comment on YARN-8686 at 8/21/18 6:48 AM: OK

[jira] [Commented] (YARN-8686) Queue Management API - not returning JSON or XML response data when passing Accept header

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587029#comment-16587029 ] Weiwei Yang commented on YARN-8686: --- OK, these are not wrapped as DAO objects so they ar

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586811#comment-16586811 ] Weiwei Yang commented on YARN-8513: --- Discussed with [~cyfdecyf] in the slack channel, it

[jira] [Commented] (YARN-8685) Add containers query support for nodes/node REST API in RMWebServices

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585910#comment-16585910 ] Weiwei Yang commented on YARN-8685: --- Hi [~Tao Yang] Does it make more sense to extend N

[jira] [Updated] (YARN-8685) Add containers query support for nodes/node REST API in RMWebServices

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8685: -- Issue Type: Improvement (was: Bug) > Add containers query support for nodes/node REST API in RMWebServi

[jira] [Commented] (YARN-8686) Queue Management API - not returning JSON or XML response data when passing Accept header

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585898#comment-16585898 ] Weiwei Yang commented on YARN-8686: --- Hmm, it is not? I thought I used this before. Have

[jira] [Updated] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8664: -- Attachment: YARN-8664-branch-2.8.01.patch > ApplicationMasterProtocolPBServiceImpl#allocate throw NPE wh

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585870#comment-16585870 ] Weiwei Yang commented on YARN-8683: --- Hi [~Tao Yang] Thanks for the patch, it looks good

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-20 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585857#comment-16585857 ] Weiwei Yang commented on YARN-7494: ---  Hi [~sunilg], looks good, +1 once the checkstyle i

[jira] [Commented] (YARN-8681) Wrong error message in RM placement constraints check

2018-08-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585368#comment-16585368 ] Weiwei Yang commented on YARN-8681: --- Hi [~snemeth] I am going to completely redo  \{{Si

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-08-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585359#comment-16585359 ] Weiwei Yang commented on YARN-8513: --- Thanks for the info [~cyfdecyf]. To work more effic

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585338#comment-16585338 ] Weiwei Yang commented on YARN-8015: --- Hi [~sunilg] To answer your questions: # Current p

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584825#comment-16584825 ] Weiwei Yang commented on YARN-8513: --- Hi [~cyfdecyf] >From the RM log you uploaded, in 1

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-18 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16584798#comment-16584798 ] Weiwei Yang commented on YARN-7863: --- Hi [~sunilg] Thanks for the update, but I am afrai

[jira] [Commented] (YARN-8670) Support scheduling request for SLS input and attributes for Node in SLS

2018-08-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16583309#comment-16583309 ] Weiwei Yang commented on YARN-8670: --- Hi [~Sichen Zhao] Looks like #2 is depending on YA

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580902#comment-16580902 ] Weiwei Yang commented on YARN-8664: --- Hi [~yangjiandan] Yeah, seems like the jenkins env

[jira] [Commented] (YARN-8614) Fix few annotation typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580745#comment-16580745 ] Weiwei Yang commented on YARN-8614: --- Pushed to trunk, branch-3.1, branch-3.0. > Fix few

[jira] [Updated] (YARN-8614) Fix few annotation typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8614: -- Fix Version/s: 3.0.4 > Fix few annotation typos in YarnConfiguration > -

[jira] [Updated] (YARN-8614) Fix few annotation typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8614: -- Summary: Fix few annotation typos in YarnConfiguration (was: Fix few typos in YarnConfiguration) > Fix

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580698#comment-16580698 ] Weiwei Yang commented on YARN-8015: --- Hi [~sunilg], please help to review, thanks. > Com

[jira] [Commented] (YARN-8614) Fix few typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580697#comment-16580697 ] Weiwei Yang commented on YARN-8614: --- +1, will commit tonight, thanks [~Sen Zhao]. > Fix

[jira] [Updated] (YARN-8614) Fix few typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8614: -- Summary: Fix few typos in YarnConfiguration (was: Some typos in YarnConfiguration) > Fix few typos in

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580645#comment-16580645 ] Weiwei Yang commented on YARN-8664: --- Hi [~yangjiandan] I just noticed the patch was for

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580641#comment-16580641 ] Weiwei Yang commented on YARN-8664: --- There was a build issue just fixed half a hour ago,

[jira] [Commented] (YARN-8614) Some typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580619#comment-16580619 ] Weiwei Yang commented on YARN-8614: --- Thanks, +1 to v2 patch. I'll commit this once Jenki

[jira] [Updated] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8015: -- Attachment: YARN-8015.004.patch > Complete placement constraint support for Capacity Scheduler > ---

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580618#comment-16580618 ] Weiwei Yang commented on YARN-8015: --- Fix findbugs warning in v4 patch. > Complete place

[jira] [Commented] (YARN-8614) Some typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580585#comment-16580585 ] Weiwei Yang commented on YARN-8614: --- Hi [~Sen Zhao], thanks for fixing this, patch looks

[jira] [Updated] (YARN-8614) Some typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8614: -- Priority: Trivial (was: Minor) > Some typos in YarnConfiguration > --- > >

[jira] [Commented] (YARN-8645) Yarn NM fail to start when remount cpu control group

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16580564#comment-16580564 ] Weiwei Yang commented on YARN-8645: --- Hi [~yangjiandan] Any updates on this issue? Is th

[jira] [Updated] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8015: -- Summary: Complete placement constraint support for Capacity Scheduler (was: Support inter-app placement

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579917#comment-16579917 ] Weiwei Yang commented on YARN-8015: --- Rebase to latest trunk, [~sunil.gov...@gmail.com] p

[jira] [Updated] (YARN-8015) Support inter-app placement constraints in AppPlacementAllocator

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8015: -- Attachment: YARN-8015.003.patch > Support inter-app placement constraints in AppPlacementAllocator > ---

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579468#comment-16579468 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] {\{TestAppSchedulingInfo}} failure wa

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579330#comment-16579330 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] I just pull the patch to local and it

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577797#comment-16577797 ] Weiwei Yang commented on YARN-8559: --- Thank you [~jhung] for taking care of those branche

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-12 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1652#comment-1652 ] Weiwei Yang commented on YARN-7494: --- Thanks [~sunilg] for the updates, please see my fol

[jira] [Updated] (YARN-8575) Avoid committing allocation proposal to unavailable nodes in async scheduling

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8575: -- Summary: Avoid committing allocation proposal to unavailable nodes in async scheduling (was: CapacitySc

[jira] [Commented] (YARN-8575) CapacityScheduler should check node state before committing reserve/allocate proposals

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575817#comment-16575817 ] Weiwei Yang commented on YARN-8575: --- LGTM, will commit shortly. > CapacityScheduler sho

[jira] [Commented] (YARN-8575) CapacityScheduler should check node state before committing reserve/allocate proposals

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575678#comment-16575678 ] Weiwei Yang commented on YARN-8575: --- Thanks [~Tao Yang] for the patch, the patch looks g

[jira] [Commented] (YARN-8521) NPE in AllocationTagsManager when a container is removed more than once

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575620#comment-16575620 ] Weiwei Yang commented on YARN-8521: --- Just committed this to trunk and branch-3.1, thanks

[jira] [Commented] (YARN-8521) NPE in AllocationTagsManager when a container is removed more than once

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575604#comment-16575604 ] Weiwei Yang commented on YARN-8521: --- Hi [~suma.shivaprasad] Thanks for helping review t

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16575594#comment-16575594 ] Weiwei Yang commented on YARN-8559: --- It looks good to me, thanks [~jhung] for taking car

<    5   6   7   8   9   10   11   12   13   14   >