[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-02-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351991#comment-16351991 ] Weiwei Yang commented on YARN-7757: --- Thanks [~Naganarasimha], [~sunilg] for all the reviews and comments!

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Attachment: YARN-7838.001.patch > Support AND/OR constraints in Distributed Shell >

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353324#comment-16353324 ] Weiwei Yang commented on YARN-7838: --- Hi [~asuresh] I just submitted a formal v1 patch, this patch adds a

[jira] [Commented] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-02-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356522#comment-16356522 ] Weiwei Yang commented on YARN-6858: --- Hi [~Naganarasimha] Thanks for the patch. I am focusing on the

[jira] [Commented] (YARN-7892) NodeAttributePBImpl does not implement hashcode and Equals properly

2018-02-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357876#comment-16357876 ] Weiwei Yang commented on YARN-7892: --- Hi [~Naganarasimha], [~sunilg] I think we should check both

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-02-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356732#comment-16356732 ] Weiwei Yang commented on YARN-7875: --- Hi [~bibinchundatt] In {{FileSystemNodeLabelsStore}} and

[jira] [Comment Edited] (YARN-7858) Support special Node Attribute scopes in addition to NODE and RACK

2018-02-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358050#comment-16358050 ] Weiwei Yang edited comment on YARN-7858 at 2/9/18 7:53 AM: --- Hi [~asuresh] Could

[jira] [Commented] (YARN-7860) Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353742#comment-16353742 ] Weiwei Yang commented on YARN-7860: --- +1, I will commit this shortly. > Fix UT failure

[jira] [Updated] (YARN-7871) Node attributes reporting from NM to RM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7871: -- Attachment: YARN-7871-YARN-3409.001.patch > Node attributes reporting from NM to RM >

[jira] [Commented] (YARN-7871) Node attributes reporting from NM to RM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353758#comment-16353758 ] Weiwei Yang commented on YARN-7871: --- Patch attached, some notes to help to review # Added a simple

[jira] [Comment Edited] (YARN-7871) Node attributes reporting from NM to RM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353758#comment-16353758 ] Weiwei Yang edited comment on YARN-7871 at 2/6/18 11:40 AM: Patch attached,

[jira] [Comment Edited] (YARN-7871) Node attributes reporting from NM to RM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353758#comment-16353758 ] Weiwei Yang edited comment on YARN-7871 at 2/6/18 11:40 AM: Patch attached,

[jira] [Commented] (YARN-7860) Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353667#comment-16353667 ] Weiwei Yang commented on YARN-7860: --- Hi [~sunilg] Looks good to me, pending on jenkins.  > Fix UT

[jira] [Commented] (YARN-7875) AttributeStore for store and recover attributes

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353787#comment-16353787 ] Weiwei Yang commented on YARN-7875: --- Hi [~bibinchundatt] Thanks for working on this JIRA, apologies that

[jira] [Comment Edited] (YARN-7875) AttributeStore for store and recover attributes

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353787#comment-16353787 ] Weiwei Yang edited comment on YARN-7875 at 2/6/18 12:13 PM: Hi [~bibinchundatt]

[jira] [Comment Edited] (YARN-7875) AttributeStore for store and recover attributes

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353787#comment-16353787 ] Weiwei Yang edited comment on YARN-7875 at 2/6/18 12:14 PM: Hi [~bibinchundatt]

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Description: NM needs to do proper validation about the attributes before sending them to RM, this

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Attachment: YARN-7838.003.patch > Support AND/OR constraints in Distributed Shell >

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Attachment: YARN-7856-YRAN-3409.001.patch > Validation node attributes in NM >

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Attachment: YARN-7856-YARN-3409.001.patch > Validation node attributes in NM >

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Attachment: (was: YARN-7856-YRAN-3409.001.patch) > Validation node attributes in NM >

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Priority: Critical (was: Major) > Support AND/OR constraints in Distributed Shell >

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359832#comment-16359832 ] Weiwei Yang commented on YARN-7838: --- Confirmed with [~leftnoteasy], branch was correct. Resolving this

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Labels: constraints (was: ) > Support AND/OR constraints in Distributed Shell >

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359816#comment-16359816 ] Weiwei Yang commented on YARN-7838: --- I think misunderstood [~leftnoteasy]'s email about 3.1.0 cut

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359804#comment-16359804 ] Weiwei Yang commented on YARN-7838: --- Thanks [~asuresh], I will commit this soon to trunk and branch 3.1.

[jira] [Created] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-11 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7921: - Summary: Transform a PlacementConstraint to a string expression Key: YARN-7921 URL: https://issues.apache.org/jira/browse/YARN-7921 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359871#comment-16359871 ] Weiwei Yang commented on YARN-7921: --- [~asuresh], [~kkaranasos], please let me know your thoughts on this

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7929: -- Priority: Major (was: Minor) > SLS supports setting container execution >

[jira] [Updated] (YARN-7929) SLS supports setting container execution

2018-02-13 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7929: -- Description: SLS currently support three tracetype, SYNTH, SLS and RUMEN, but trace file can not set

[jira] [Comment Edited] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360222#comment-16360222 ] Weiwei Yang edited comment on YARN-6858 at 2/12/18 2:43 AM: Hi [~Naganarasimha]

[jira] [Comment Edited] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360222#comment-16360222 ] Weiwei Yang edited comment on YARN-6858 at 2/12/18 2:47 AM: Hi [~Naganarasimha]

[jira] [Commented] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360283#comment-16360283 ] Weiwei Yang commented on YARN-7921: --- Thanks [~kkaranasos] for the quick feedback. I agree that to follow

[jira] [Comment Edited] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360283#comment-16360283 ] Weiwei Yang edited comment on YARN-7921 at 2/12/18 3:56 AM: Thanks

[jira] [Commented] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360222#comment-16360222 ] Weiwei Yang commented on YARN-6858: --- Hi [~Naganarasimha] Except Jenkins warnings, the patch mostly looks

[jira] [Comment Edited] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360283#comment-16360283 ] Weiwei Yang edited comment on YARN-7921 at 2/12/18 3:57 AM: Thanks

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364087#comment-16364087 ] Weiwei Yang commented on YARN-7838: --- Hi [~asuresh], [~leftnoteasy], this was already committed to

[jira] [Commented] (YARN-7858) Support special Node Attribute scopes in addition to NODE and RACK

2018-02-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358050#comment-16358050 ] Weiwei Yang commented on YARN-7858: --- Hi [~asuresh] Could you please elaborate what do you mean by "to

[jira] [Commented] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-02-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358359#comment-16358359 ] Weiwei Yang commented on YARN-6858: --- [~Naganarasimha], any updates on this? Thanks > Attribute Manager

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353819#comment-16353819 ] Weiwei Yang commented on YARN-7838: --- Fixed jenkins issues... > Support AND/OR constraints in Distributed

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Attachment: YARN-7838.002.patch > Support AND/OR constraints in Distributed Shell >

[jira] [Commented] (YARN-7871) Node attributes reporting from NM to RM

2018-02-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355282#comment-16355282 ] Weiwei Yang commented on YARN-7871: --- Hi [~sunilg] Thanks for reviewing this patch. bq. It could be

[jira] [Commented] (YARN-7856) Validation node attributes in NM

2018-02-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355296#comment-16355296 ] Weiwei Yang commented on YARN-7856: --- Sure, thanks [~sunilg] for the quick response! > Validation node

[jira] [Commented] (YARN-7920) Simplify configuration for PlacementConstraints

2018-02-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372281#comment-16372281 ] Weiwei Yang commented on YARN-7920: --- Hi [~leftnoteasy],[~kkaranasos] Sorry for the late response, I was

[jira] [Commented] (YARN-7920) Simplify configuration for PlacementConstraints

2018-02-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372529#comment-16372529 ] Weiwei Yang commented on YARN-7920: --- Hi [~leftnoteasy] I think we should have consistent docs, if you

[jira] [Commented] (YARN-7871) Node attributes reporting from NM to RM

2018-02-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372455#comment-16372455 ] Weiwei Yang commented on YARN-7871: --- Hi [~sunilg] RMNodeAttributesManager is a place holder, but since 

[jira] [Commented] (YARN-7856) Validation node attributes in NM

2018-02-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372450#comment-16372450 ] Weiwei Yang commented on YARN-7856: --- Hi [~sunilg] Thanks for looking into the patch, this one seems to

[jira] [Updated] (YARN-7959) Add .vm extension to PlacementConstraints.md to ensure proper filtering

2018-02-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7959: -- Attachment: YARN-7959.001.patch > Add .vm extension to PlacementConstraints.md to ensure proper

[jira] [Updated] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7921: -- Attachment: YARN-7921.001.patch > Transform a PlacementConstraint to a string expression >

[jira] [Created] (YARN-7959) Add .vm extension to PlacementConstraints.md to ensure proper filtering

2018-02-22 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7959: - Summary: Add .vm extension to PlacementConstraints.md to ensure proper filtering Key: YARN-7959 URL: https://issues.apache.org/jira/browse/YARN-7959 Project: Hadoop YARN

[jira] [Commented] (YARN-7959) Add .vm extension to PlacementConstraints.md to ensure proper filtering

2018-02-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372718#comment-16372718 ] Weiwei Yang commented on YARN-7959: --- +[~leftnoteasy] This can be verified by {{mvn clean site

[jira] [Updated] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7921: -- Attachment: Placement Constraint Expression Syntax Specification.pdf > Transform a PlacementConstraint

[jira] [Commented] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375319#comment-16375319 ] Weiwei Yang commented on YARN-7921: --- Attached placement constraint expression syntax specification,

[jira] [Commented] (YARN-7929) SLS supports setting container execution

2018-02-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375491#comment-16375491 ] Weiwei Yang commented on YARN-7929: --- Hi [~yangjiandan] Thanks for working on this, this is very helpful

[jira] [Commented] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375787#comment-16375787 ] Weiwei Yang commented on YARN-7921: --- Hi [~kkaranasos] Yes, the spec is same as the document, we are

[jira] [Created] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-23 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7965: - Summary: NodeAttributeManager add/get API is not working properly Key: YARN-7965 URL: https://issues.apache.org/jira/browse/YARN-7965 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375901#comment-16375901 ] Weiwei Yang commented on YARN-7921: --- Sure, thanks [~kkaranasos]. > Transform a PlacementConstraint to a

[jira] [Updated] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7965: -- Attachment: YARN-7965-YARN-3409.002.patch > NodeAttributeManager add/get API is not working properly >

[jira] [Comment Edited] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376445#comment-16376445 ] Weiwei Yang edited comment on YARN-7965 at 2/26/18 6:46 AM: Thanks

[jira] [Commented] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376445#comment-16376445 ] Weiwei Yang commented on YARN-7965: --- Thanks [~naganarasimha...@apache.org], [~sunilg]. Please help to

[jira] [Commented] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376564#comment-16376564 ] Weiwei Yang commented on YARN-7965: --- Hi [~Naganarasimha] could you please take a look. >

[jira] [Updated] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7965: -- Priority: Critical (was: Major) > NodeAttributeManager add/get API is not working properly >

[jira] [Comment Edited] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376564#comment-16376564 ] Weiwei Yang edited comment on YARN-7965 at 2/26/18 9:09 AM: Hi [~Naganarasimha]

[jira] [Commented] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373841#comment-16373841 ] Weiwei Yang commented on YARN-7921: --- Hi [~kkaranasos], could you please help to review this patch? Thanks

[jira] [Updated] (YARN-7921) Transform a PlacementConstraint to a string expression

2018-02-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7921: -- Attachment: YARN-7921.002.patch > Transform a PlacementConstraint to a string expression >

[jira] [Updated] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7965: -- Description: Fix following issues, # After add node attributes to the manager, could not retrieve newly

[jira] [Updated] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7965: -- Attachment: YARN-7965-YARN-3409.001.patch > NodeAttributeManager add/get API is not working properly >

[jira] [Commented] (YARN-7965) NodeAttributeManager add/get API is not working properly

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374106#comment-16374106 ] Weiwei Yang commented on YARN-7965: --- Hi [~naganarasimha...@apache.org] Please help to review, thanks. >

[jira] [Updated] (YARN-7856) Validation node attributes in NM

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7856: -- Attachment: YARN-7856-YARN-3409.002.patch > Validation node attributes in NM >

[jira] [Commented] (YARN-7856) Validation node attributes in NM

2018-02-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374184#comment-16374184 ] Weiwei Yang commented on YARN-7856: --- Hi [~sunilg] A new patch updated, regarding to your comments

[jira] [Updated] (YARN-7679) Application blacklist to drop misbehave AM requests

2017-12-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7679: -- Labels: admin command-line (was: admin) > Application blacklist to drop misbehave AM requests >

[jira] [Comment Edited] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299714#comment-16299714 ] Weiwei Yang edited comment on YARN-6596 at 12/21/17 1:45 PM: - Hi [~kkaranasos]

[jira] [Commented] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299988#comment-16299988 ] Weiwei Yang commented on YARN-6858: --- Hi [~sunilg]/[~asuresh] This one is necessarily related to

[jira] [Comment Edited] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299714#comment-16299714 ] Weiwei Yang edited comment on YARN-6596 at 12/21/17 1:05 PM: - Hi [~kkaranasos],

[jira] [Commented] (YARN-6597) Store and update allocation tags in the Placement Constraint Manager

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300043#comment-16300043 ] Weiwei Yang commented on YARN-6597: --- Is this JIRA still valid since YARN-7522 has already done? > Store

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300126#comment-16300126 ] Weiwei Yang commented on YARN-6596: --- Thanks [~asuresh] for the quick response bq. As per the RM failover

[jira] [Comment Edited] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299988#comment-16299988 ] Weiwei Yang edited comment on YARN-6858 at 12/21/17 1:03 PM: - Hi

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300178#comment-16300178 ] Weiwei Yang commented on YARN-6596: --- bq. if only the AM restarts, the mapping will be there in the RM

[jira] [Commented] (YARN-7612) Add Placement Processor Framework

2017-12-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300192#comment-16300192 ] Weiwei Yang commented on YARN-7612: --- Thanks [~asuresh], I see, please also add the "remove constraints"

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561858#comment-16561858 ] Weiwei Yang commented on YARN-7863: --- {quote} For DS, I think its better we correlate with placement_spec

[jira] [Comment Edited] (YARN-7863) Modify placement constraints to support node attributes

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561858#comment-16561858 ] Weiwei Yang edited comment on YARN-7863 at 7/30/18 12:33 PM: - {quote} For DS,

[jira] [Commented] (YARN-8528) Final states in ContainerAllocation might be modified externally causing unexpected allocation results

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562983#comment-16562983 ] Weiwei Yang commented on YARN-8528: --- Thanks [~leftnoteasy], that sounds good to me. > Final states in

[jira] [Updated] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8559: -- Attachment: YARN-8559.003.patch > Expose mutable-conf scheduler's configuration in RM /scheduler-conf

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562982#comment-16562982 ] Weiwei Yang commented on YARN-8546: --- Hi [~leftnoteasy] that sounds good to me, thanks. > Resource leak

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562990#comment-16562990 ] Weiwei Yang commented on YARN-8559: --- Ah [~suma.shivaprasad], I got it. Of course lets do this, I have

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561338#comment-16561338 ] Weiwei Yang commented on YARN-8559: --- Hi [~suma.shivaprasad] Sorry for late response, I was on vacation.

[jira] [Updated] (YARN-8577) Fix the broken anchor in SLS site-doc

2018-07-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8577: -- Fix Version/s: 2.9.2 > Fix the broken anchor in SLS site-doc > - >

[jira] [Updated] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2018-07-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8546: -- Fix Version/s: (was: 3.1.1) 3.1.2 > Resource leak caused by a reserved container

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2018-07-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556921#comment-16556921 ] Weiwei Yang commented on YARN-8546: --- Thanks [~bibinchundatt], I have corrected the fix version to 3.1.2.

[jira] [Commented] (YARN-8577) Fix the broken anchor in SLS site-doc

2018-07-25 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556926#comment-16556926 ] Weiwei Yang commented on YARN-8577: --- Thanks [~bibinchundatt] for the review and commit, I have

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564705#comment-16564705 ] Weiwei Yang commented on YARN-8559: --- Attached v4 patch, 1) added document; 2) added ACL check; I have

[jira] [Updated] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8559: -- Attachment: YARN-8559.004.patch > Expose mutable-conf scheduler's configuration in RM /scheduler-conf

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-07-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16564662#comment-16564662 ] Weiwei Yang commented on YARN-8559: --- Hi [~suma.shivaprasad]/[~leftnoteasy] Thanks for the comments.

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-07-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561665#comment-16561665 ] Weiwei Yang commented on YARN-7494: --- Hello [~sunilg] Thanks for the updates, it looks almost good to

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-08 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574238#comment-16574238 ] Weiwei Yang commented on YARN-8559: --- Thanks [~leftnoteasy], [~jhung], [~suma.shivaprasad], [~sunilg] to

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-09 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575020#comment-16575020 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] I think to get this not a CS only feature was from

[jira] [Commented] (YARN-8664) ApplicationMasterProtocolPBServiceImpl#allocate throw NPE when NM losting

2018-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580902#comment-16580902 ] Weiwei Yang commented on YARN-8664: --- Hi [~yangjiandan] Yeah, seems like the jenkins env is broken on

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579330#comment-16579330 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] I just pull the patch to local and it seems good to

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579468#comment-16579468 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] {\{TestAppSchedulingInfo}} failure was related to the

[jira] [Commented] (YARN-8614) Some typos in YarnConfiguration

2018-08-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580585#comment-16580585 ] Weiwei Yang commented on YARN-8614: --- Hi [~Sen Zhao], thanks for fixing this, patch looks good except it

<    3   4   5   6   7   8   9   10   11   12   >