[jira] [Updated] (YARN-8222) Fix potential NPE when gets RMApp from RM context

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8222: -- Summary: Fix potential NPE when gets RMApp from RM context (was: NPE when calling

[jira] [Assigned] (YARN-8212) Pending backlog for async allocation threads should be configurable

[ https://issues.apache.org/jira/browse/YARN-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8212: - Assignee: Tao Yang > Pending backlog for async allocation threads should be configurable >

[jira] [Updated] (YARN-8213) Add Capacity Scheduler metrics

[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8213: -- Attachment: YARN-8213.001.patch > Add Capacity Scheduler metrics > -- > >

[jira] [Created] (YARN-8213) Add Capacity Scheduler metrics

Weiwei Yang created YARN-8213: - Summary: Add Capacity Scheduler metrics Key: YARN-8213 URL: https://issues.apache.org/jira/browse/YARN-8213 Project: Hadoop YARN Issue Type: Improvement

[jira] [Created] (YARN-8212) Pending backlog for async allocation threads should be configurable

Weiwei Yang created YARN-8212: - Summary: Pending backlog for async allocation threads should be configurable Key: YARN-8212 URL: https://issues.apache.org/jira/browse/YARN-8212 Project: Hadoop YARN

[jira] [Updated] (YARN-8213) Add Capacity Scheduler metrics

[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8213: -- Attachment: YARN-8213.002.patch > Add Capacity Scheduler metrics > -- > >

[jira] [Commented] (YARN-8195) Fix constraint cardinality check in the presence of multiple target allocation tags

[ https://issues.apache.org/jira/browse/YARN-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459381#comment-16459381 ] Weiwei Yang commented on YARN-8195: --- Thanks [~kkaranasos]! > Fix constraint cardinality check in the

[jira] [Commented] (YARN-8212) Pending backlog for async allocation threads should be configurable

[ https://issues.apache.org/jira/browse/YARN-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459385#comment-16459385 ] Weiwei Yang commented on YARN-8212: --- LGTM, +1. Committing shortly. > Pending backlog for async

[jira] [Updated] (YARN-8113) Update placement constraints doc with application namespace and inter-app constraints

[ https://issues.apache.org/jira/browse/YARN-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8113: -- Attachment: (was: YARN-8213.002.patch) > Update placement constraints doc with application namespace

[jira] [Updated] (YARN-8113) Update placement constraints doc with application namespace and inter-app constraints

[ https://issues.apache.org/jira/browse/YARN-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8113: -- Attachment: YARN-8213.002.patch > Update placement constraints doc with application namespace and

[jira] [Commented] (YARN-8113) Update placement constraints doc with application namespace and inter-app constraints

[ https://issues.apache.org/jira/browse/YARN-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459396#comment-16459396 ] Weiwei Yang commented on YARN-8113: --- Hi [~kkaranasos] {quote}I thought we still do not have support

[jira] [Updated] (YARN-8113) Update placement constraints doc with application namespace and inter-app constraints

[ https://issues.apache.org/jira/browse/YARN-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8113: -- Attachment: YARN-8113.002.patch > Update placement constraints doc with application namespace and

[jira] [Updated] (YARN-8212) Pending backlog for async allocation threads should be configurable

[ https://issues.apache.org/jira/browse/YARN-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8212: -- Fix Version/s: 3.0.3 > Pending backlog for async allocation threads should be configurable >

[jira] [Commented] (YARN-8222) NPE when calling rmContext.getRMApps().get(...).getCurrentAppAttempt()

[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459397#comment-16459397 ] Weiwei Yang commented on YARN-8222: --- Hi [~Tao Yang] Thanks for the patch. Generally, it is always good

[jira] [Commented] (YARN-8113) Update placement constraints doc with application namespaces and inter-app constraints

[ https://issues.apache.org/jira/browse/YARN-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463288#comment-16463288 ] Weiwei Yang commented on YARN-8113: --- Thank you [~kkaranasos] for helping the review and polishing the

[jira] [Commented] (YARN-8152) Add chart in SLS to illustrate the throughput of the scheduler

[ https://issues.apache.org/jira/browse/YARN-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16453804#comment-16453804 ] Weiwei Yang commented on YARN-8152: --- Hi [~Tao Yang] Thanks for the patch, looks pretty good. I just

[jira] [Commented] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314340#comment-16314340 ] Weiwei Yang commented on YARN-7681: --- Hi [~asuresh], [~leftnoteasy] I think [~leftnoteasy] has done the

[jira] [Created] (YARN-7679) Application blacklist to drop misbehave AM requests

Weiwei Yang created YARN-7679: - Summary: Application blacklist to drop misbehave AM requests Key: YARN-7679 URL: https://issues.apache.org/jira/browse/YARN-7679 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300867#comment-16300867 ] Weiwei Yang commented on YARN-3409: --- Hi [~Naganarasimha], [~leftnoteasy] I went through the design doc,

[jira] [Comment Edited] (YARN-3409) Support Node Attribute functionality

[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300867#comment-16300867 ] Weiwei Yang edited comment on YARN-3409 at 12/22/17 2:03 AM: - Hi

[jira] [Commented] (YARN-6597) Store and update allocation tags in the Placement Constraint Manager

[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303008#comment-16303008 ] Weiwei Yang commented on YARN-6597: --- It makes sense, thanks [~pgaref]. > Store and update allocation

[jira] [Commented] (YARN-7679) Application blacklist to drop misbehave AM requests

[ https://issues.apache.org/jira/browse/YARN-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302811#comment-16302811 ] Weiwei Yang commented on YARN-7679: --- Hi [~asuresh] Thanks for the comments, they are really helpful. I

[jira] [Commented] (YARN-7612) Add Processor Framework for Rich Placement Constraints

[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303051#comment-16303051 ] Weiwei Yang commented on YARN-7612: --- Hi [~asuresh] I know this is already committed, but I have one

[jira] [Commented] (YARN-7612) Add Processor Framework for Rich Placement Constraints

[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303099#comment-16303099 ] Weiwei Yang commented on YARN-7612: --- Hi [~asuresh] Thanks for the quick response and all the details.

[jira] [Commented] (YARN-7612) Add Processor Framework for Rich Placement Constraints

[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303265#comment-16303265 ] Weiwei Yang commented on YARN-7612: --- Thanks [~asuresh], I have created YARN-7681 to followup on this.

[jira] [Created] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

Weiwei Yang created YARN-7681: - Summary: Scheduler should double-check placement constraint before actual allocation is made Key: YARN-7681 URL: https://issues.apache.org/jira/browse/YARN-7681 Project:

[jira] [Updated] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7681: -- Attachment: YARN-7681-YARN-6592.002.patch > Scheduler should double-check placement constraint before

[jira] [Commented] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319470#comment-16319470 ] Weiwei Yang commented on YARN-7681: --- Thanks [~asuresh] and [~pgaref], uploaded v2 patch to fix the

[jira] [Updated] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7681: -- Attachment: YARN-7681-YARN-6592.003.patch > Scheduler should double-check placement constraint before

[jira] [Commented] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311672#comment-16311672 ] Weiwei Yang commented on YARN-7681: --- Hi [~asuresh] thanks for the reminder, I will work on this shortly.

[jira] [Commented] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319966#comment-16319966 ] Weiwei Yang commented on YARN-7681: --- Hi [~asuresh] I have moved the check before tryCommit, this

[jira] [Updated] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7681: -- Attachment: YARN-7681.001.patch > Scheduler should double-check placement constraint before actual

[jira] [Commented] (YARN-7681) Scheduler should double-check placement constraint before actual allocation is made

[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318577#comment-16318577 ] Weiwei Yang commented on YARN-7681: --- Hi [~asuresh] bq. When the processor is turned on, the

[jira] [Commented] (YARN-7763) Refactoring PlacementConstraintUtils APIs so PlacementProcessor/Scheduler can use the same API and implementation

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328037#comment-16328037 ] Weiwei Yang commented on YARN-7763: --- Thanks [~leftnoteasy], [~asuresh], happy to help. I will look into

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: YARN-7757-YARN-3409.001.patch > Refactor NodeLabelsProvider to be more generic and reusable

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: (was: YARN-7757-YARN-3409.001.patch) > Refactor NodeLabelsProvider to be more generic

[jira] [Created] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

Weiwei Yang created YARN-7757: - Summary: Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers Key: YARN-7757 URL: https://issues.apache.org/jira/browse/YARN-7757

[jira] [Commented] (YARN-6856) Support CLI for Node Attributes Mapping

[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326787#comment-16326787 ] Weiwei Yang commented on YARN-6856: --- Hi [~Naganarasimha], [~sunilg] I took a look at the patch, looks

[jira] [Comment Edited] (YARN-6856) Support CLI for Node Attributes Mapping

[ https://issues.apache.org/jira/browse/YARN-6856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326787#comment-16326787 ] Weiwei Yang edited comment on YARN-6856 at 1/16/18 5:57 AM: Hi

[jira] [Commented] (YARN-7031) Support distributed node attributes

[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326781#comment-16326781 ] Weiwei Yang commented on YARN-7031: --- Uploaded an initial patch, class \{{RMNodeAttributesManager}} can be

[jira] [Commented] (YARN-7031) Support distributed node attributes

[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326779#comment-16326779 ] Weiwei Yang commented on YARN-7031: --- Hi [~bibinchundatt] Thanks for the comments. I have a patch that

[jira] [Updated] (YARN-7031) Support distributed node attributes

[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7031: -- Attachment: YARN-7031-YARN-3409.001.patch > Support distributed node attributes >

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Description: Propose to do refactor on NodeLabelsProvider, AbstractNodeLabelsProvider to be more

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Environment: (was: Propose to do refactor on {{NodeLabelsProvider}}, {{AbstractNodeLabelsProvider}}

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Description: Propose to do refactor on {{NodeLabelsProvider}}, {{AbstractNodeLabelsProvider}} to be more

[jira] [Assigned] (YARN-3409) Support Node Attribute functionality

[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-3409: - Assignee: Naganarasimha G R (was: Weiwei Yang) > Support Node Attribute functionality >

[jira] [Commented] (YARN-7031) Support distributed node attributes

[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326679#comment-16326679 ] Weiwei Yang commented on YARN-7031: --- I got some thoughts on how to implement distributed node attributes,

[jira] [Assigned] (YARN-3409) Support Node Attribute functionality

[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-3409: - Assignee: Weiwei Yang (was: Naganarasimha G R) > Support Node Attribute functionality >

[jira] [Updated] (YARN-7031) Support distributed node attributes

[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7031: -- Attachment: Distributed node attributes v1.pdf > Support distributed node attributes >

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: nodeLabelsProvider_refactor_class_hierarchy.pdf > Refactor NodeLabelsProvider to be more

[jira] [Updated] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7757: -- Attachment: YARN-7757-YARN-3409.001.patch > Refactor NodeLabelsProvider to be more generic and reusable

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327046#comment-16327046 ] Weiwei Yang commented on YARN-7757: --- Proposed to refactor current classes to be more reusable by node

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333090#comment-16333090 ] Weiwei Yang commented on YARN-7763: --- Hi [~sunilg] {quote} i think *constraint* could be updated in *pcm* 

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333091#comment-16333091 ] Weiwei Yang commented on YARN-7778: --- I volunteer to help on this task, [~kkaranasos] can I take over? I

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331834#comment-16331834 ] Weiwei Yang commented on YARN-7763: --- Hi [~kkaranasos] Thanks for the comments, here is my thoughts

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331841#comment-16331841 ] Weiwei Yang commented on YARN-7763: --- Hi [~kkaranasos] Thanks for the clarification, +1 for the idea that

[jira] [Updated] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7763: -- Attachment: YARN-7763-YARN-6592.006.patch > Allow Constraints specified in the SchedulingRequest to

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332018#comment-16332018 ] Weiwei Yang commented on YARN-7763: --- Thanks [~kkaranasos], uploaded v6 patch that fixed the position of

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331868#comment-16331868 ] Weiwei Yang commented on YARN-7774: --- Hi [~asuresh] In \{{DefaultPlacementAlgorithm}}, for each

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331941#comment-16331941 ] Weiwei Yang commented on YARN-7763: --- Thanks [~kkaranasos], I just uploaded v4 patch to address your

[jira] [Created] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

Weiwei Yang created YARN-7779: - Summary: Display allocation tags in RM web UI and expose via REST API Key: YARN-7779 URL: https://issues.apache.org/jira/browse/YARN-7779 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331834#comment-16331834 ] Weiwei Yang edited comment on YARN-7763 at 1/19/18 7:08 AM: Hi [~kkaranasos]

[jira] [Updated] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7763: -- Attachment: YARN-7763-YARN-6592.004.patch > Allow Constraints specified in the SchedulingRequest to

[jira] [Updated] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7763: -- Attachment: YARN-7763-YARN-6592.005.patch > Allow Constraints specified in the SchedulingRequest to

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332033#comment-16332033 ] Weiwei Yang commented on YARN-7779: --- Hi [~kkaranasos], [~asuresh] If this makes sense to you, I can help

[jira] [Assigned] (YARN-7778) Merging of constraints defined at different levels

[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7778: - Assignee: Weiwei Yang > Merging of constraints defined at different levels >

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333795#comment-16333795 ] Weiwei Yang commented on YARN-7763: --- Hi [~asuresh] Sure, I will investigate some more details how to

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.002.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333978#comment-16333978 ] Weiwei Yang commented on YARN-7779: --- v2 patch uploaded, added a test case in \{{TestRMWebServices}}, also

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333747#comment-16333747 ] Weiwei Yang commented on YARN-7763: --- Hi [~asuresh], [~kkaranasos], [~sunilg], [~leftnoteasy], do you have

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.001.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: allocationTags_nodesPage.png > Display allocation tags in RM web UI and expose via REST API

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: allocationTags_nodesREST.png > Display allocation tags in RM web UI and expose via REST API

[jira] [Comment Edited] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333840#comment-16333840 ] Weiwei Yang edited comment on YARN-7779 at 1/22/18 3:44 AM: Thanks [~asuresh],

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333840#comment-16333840 ] Weiwei Yang commented on YARN-7779: --- Thanks [~asuresh], I just uploaded the patch, I used this patch to

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334181#comment-16334181 ] Weiwei Yang commented on YARN-7783: --- Hi [~asuresh] I am wondering why you decided to instantiate one

[jira] [Created] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

Weiwei Yang created YARN-7784: - Summary: Cluster metrics is inaccurate when placement constraint is enabled Key: YARN-7784 URL: https://issues.apache.org/jira/browse/YARN-7784 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334145#comment-16334145 ] Weiwei Yang edited comment on YARN-7779 at 1/22/18 10:57 AM: - Uploaded v3

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.003.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334145#comment-16334145 ] Weiwei Yang commented on YARN-7779: --- Uploaded v3 patch, # Moved test case from \{{TestRMWebServices}} to

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335491#comment-16335491 ] Weiwei Yang commented on YARN-7779: --- Hi [~sunilg], sure thing. I just rebased the patch as v6, pending on

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335507#comment-16335507 ] Weiwei Yang commented on YARN-7783: --- [~asuresh] yeah, that addressed my concern, thanks for getting it

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335381#comment-16335381 ] Weiwei Yang commented on YARN-7783: --- Thanks [~asuresh], as this is not going to fix inter-app issues, I

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335434#comment-16335434 ] Weiwei Yang commented on YARN-7791: --- + [~leftnoteasy], [~sunilg] > Support submit intra-app placement

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335404#comment-16335404 ] Weiwei Yang commented on YARN-7779: --- Hi [~sunilg] If you are busy, I can help to commit this. Thank you.

[jira] [Commented] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335430#comment-16335430 ] Weiwei Yang commented on YARN-7784: --- Note, this issue only exists in processor patch, when

[jira] [Created] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

Weiwei Yang created YARN-7791: - Summary: Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator Key: YARN-7791 URL: https://issues.apache.org/jira/browse/YARN-7791

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7791: -- Description: Set {{yarn.resourcemanager.placement-constraints.enabled}} to {{false}} Submit a job with

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.005.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Comment Edited] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335434#comment-16335434 ] Weiwei Yang edited comment on YARN-7791 at 1/23/18 7:30 AM: + [~leftnoteasy],

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335653#comment-16335653 ] Weiwei Yang commented on YARN-7791: --- Hi [~sunilg] As an end user, do I have to specify {{intra_app}} or

[jira] [Commented] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340454#comment-16340454 ] Weiwei Yang commented on YARN-7784: --- Hi [~asuresh] Since YARN-7670, FiCaSchedulerApp#accept starts to

[jira] [Commented] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340476#comment-16340476 ] Weiwei Yang commented on YARN-7784: --- Hi [~asuresh] I think you can split that fix from YARN-7819 and

[jira] [Commented] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340589#comment-16340589 ] Weiwei Yang commented on YARN-7784: --- Sure, looks good. +1. Please remove the unused import while

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340867#comment-16340867 ] Weiwei Yang commented on YARN-7780: --- Hi [~kkaranasos] All look good to me, once checkstyle and

[jira] [Assigned] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7822: - Assignee: Weiwei Yang > Constraint satisfaction checker support for composite OR and AND

[jira] [Commented] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340512#comment-16340512 ] Weiwei Yang commented on YARN-7784: --- Thanks [~asuresh]. Looks good to me, one minor thing that

[jira] [Assigned] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7784: - Assignee: Arun Suresh > Cluster metrics is inaccurate when placement constraint is enabled >

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340439#comment-16340439 ] Weiwei Yang commented on YARN-7780: --- Hi [~kkaranasos] The doc looks pretty illustrative, just two minor

[jira] [Comment Edited] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341068#comment-16341068 ] Weiwei Yang edited comment on YARN-7822 at 1/26/18 1:41 PM: Submitted v1 patch

<    1   2   3   4   5   6   7   8   9   10   >