[jira] [Updated] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7617: -- Attachment: promote_containers.jpg > Add a flag in distributed shell to automatically PROMOTE

[jira] [Commented] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290729#comment-16290729 ] Weiwei Yang commented on YARN-7617: --- Since the patch is only adding a flag to distributed shell, no UT

[jira] [Updated] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7617: -- Description: Per discussion in YARN-7610, it would be good to add such a flag, e.g

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290752#comment-16290752 ] Weiwei Yang commented on YARN-7457: --- Hi [~Tao Yang] Thanks for working on this. I agree with

[jira] [Commented] (YARN-6592) Rich placement constraints in YARN

[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297761#comment-16297761 ] Weiwei Yang commented on YARN-6592: --- Hi [~kkaranasos], [~asuresh], [~leftnoteasy] What's the

[jira] [Commented] (YARN-7669) [API] Introduce interfaces for placement constraint processing

[ https://issues.apache.org/jira/browse/YARN-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297904#comment-16297904 ] Weiwei Yang commented on YARN-7669: --- Hi [~asuresh] I've read the design doc of this umbrella and some

[jira] [Comment Edited] (YARN-6592) Rich placement constraints in YARN

[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297925#comment-16297925 ] Weiwei Yang edited comment on YARN-6592 at 12/20/17 9:43 AM: - Thanks

[jira] [Commented] (YARN-6592) Rich placement constraints in YARN

[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297925#comment-16297925 ] Weiwei Yang commented on YARN-6592: --- Thanks [~kkaranasos], is this umbrella depending on YARN-3409 (that

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Fix Version/s: 3.1.0 > Extend Distributed Shell to support launching job with opportunistic >

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Fix Version/s: 2.8.2 > NM print inappropriate error log when node-labels is enabled >

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Priority: Minor (was: Major) > NM print inappropriate error log when node-labels is enabled >

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Target Version/s: 2.8.2, 3.1.0, 2.9.1, 3.0.1 (was: 2.8.2, 3.1.0, 3.0.1) > NM print inappropriate error

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Fix Version/s: 3.1.0 > NM print inappropriate error log when node-labels is enabled >

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Fix Version/s: 2.9.1 > NM print inappropriate error log when node-labels is enabled >

[jira] [Commented] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288732#comment-16288732 ] Weiwei Yang commented on YARN-7647: --- Committed the patch to branch-2.9, branch-3.0 and trunk. Thanks

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Fix Version/s: 3.0.1 > NM print inappropriate error log when node-labels is enabled >

[jira] [Comment Edited] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16288732#comment-16288732 ] Weiwei Yang edited comment on YARN-7647 at 12/13/17 5:29 AM: - Committed the

[jira] [Updated] (YARN-7647) NM print inappropriate error log when node-labels is enabled

[ https://issues.apache.org/jira/browse/YARN-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7647: -- Fix Version/s: 2.10.0 > NM print inappropriate error log when node-labels is enabled >

[jira] [Commented] (YARN-5542) Scheduling of opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256544#comment-16256544 ] Weiwei Yang commented on YARN-5542: --- Hi [~kkaranasos], is this work still on-going? It seems there is no

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283019#comment-16283019 ] Weiwei Yang commented on YARN-7624: --- Hi [~templedf], yes I believe so. Let me update the affected

[jira] [Updated] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7624: -- Affects Version/s: 3.0.0-alpha3 > RM gives YARNFeatureNotEnabledException even when resource profile

[jira] [Updated] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7624: -- Affects Version/s: (was: 3.0.0-alpha3) 3.1.0 > RM gives

[jira] [Commented] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282942#comment-16282942 ] Weiwei Yang commented on YARN-7608: --- I just tried, it has the same issue when I click {{Reserved CPU

[jira] [Commented] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282938#comment-16282938 ] Weiwei Yang commented on YARN-7608: --- Thanks for the patch [~GergelyNovak]. One question, in

[jira] [Updated] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7608: -- Target Version/s: 3.0.0, 3.1.0, 2.9.1 > Incorrect sTarget column causing DataTable warning on RM

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283095#comment-16283095 ] Weiwei Yang commented on YARN-7607: --- Sure [~ajisakaa], I just cherry picked the patch to branch-2 too.

[jira] [Updated] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7607: -- Fix Version/s: 2.10.0 > Remove the trailing duplicated timestamp in container diagnostics message >

[jira] [Created] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

Weiwei Yang created YARN-7624: - Summary: RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled Key: YARN-7624 URL: https://issues.apache.org/jira/browse/YARN-7624

[jira] [Updated] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7608: -- Summary: Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Description: YARN-4055 adds node resource utilization to NM, we should expose these info in NM metrics,

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Attachment: YARN-7625.001.patch > Expose NM node/containers resource utilization in JVM metrics >

[jira] [Created] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

Weiwei Yang created YARN-7625: - Summary: Expose NM node/containers resource utilization in JVM metrics Key: YARN-7625 URL: https://issues.apache.org/jira/browse/YARN-7625 Project: Hadoop YARN

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Description: YARN-4055 adds node resource utilization to NM, we should expose these info in NM metrics,

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Description: YARN-4055 adds node resource utilization to NM, we should expose these info in NM metrics,

[jira] [Commented] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283232#comment-16283232 ] Weiwei Yang commented on YARN-7608: --- Thanks [~GergelyNovak] for the update, the change looks good to me,

[jira] [Commented] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283900#comment-16283900 ] Weiwei Yang commented on YARN-7625: --- Hi [~jlowe] I agree. To ensure the metrics be accurate, it should

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Attachment: YARN-7625.002.patch > Expose NM node/containers resource utilization in JVM metrics >

[jira] [Commented] (YARN-7587) Skip dispatching opportunistic containers to nodes whose queue is already full

[ https://issues.apache.org/jira/browse/YARN-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276333#comment-16276333 ] Weiwei Yang commented on YARN-7587: --- Hi [~asuresh] Thanks for the review. Jenkins already returns,

[jira] [Commented] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276522#comment-16276522 ] Weiwei Yang commented on YARN-6355: --- Hi [~asuresh] One question, if user specifies several processors in

[jira] [Updated] (YARN-7587) Skip dispatching opportunistic containers to nodes whose queue is already full

[ https://issues.apache.org/jira/browse/YARN-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7587: -- Attachment: YARN-7587.003.patch > Skip dispatching opportunistic containers to nodes whose queue is

[jira] [Commented] (YARN-7587) Skip dispatching opportunistic containers to nodes whose queue is already full

[ https://issues.apache.org/jira/browse/YARN-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276271#comment-16276271 ] Weiwei Yang commented on YARN-7587: --- Uploaded v3 patch to fix checkstyle issues, the UT failures were not

[jira] [Comment Edited] (YARN-7604) Fix some minor typos in the opportunistic container logging

[ https://issues.apache.org/jira/browse/YARN-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276626#comment-16276626 ] Weiwei Yang edited comment on YARN-7604 at 12/4/17 11:08 AM: - Following text

[jira] [Updated] (YARN-7604) Fix some minor typos in the opportunistic container logging

[ https://issues.apache.org/jira/browse/YARN-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7604: -- Attachment: YARN-7604.01.patch > Fix some minor typos in the opportunistic container logging >

[jira] [Created] (YARN-7604) Fix some minor typos in the opportunistic container logging

Weiwei Yang created YARN-7604: - Summary: Fix some minor typos in the opportunistic container logging Key: YARN-7604 URL: https://issues.apache.org/jira/browse/YARN-7604 Project: Hadoop YARN

[jira] [Updated] (YARN-7604) Fix some minor typos in the opportunistic container logging

[ https://issues.apache.org/jira/browse/YARN-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7604: -- Affects Version/s: 2.9.0 Target Version/s: 3.1.0 > Fix some minor typos in the opportunistic

[jira] [Commented] (YARN-7604) Fix some minor typos in the opportunistic container logging

[ https://issues.apache.org/jira/browse/YARN-7604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276626#comment-16276626 ] Weiwei Yang commented on YARN-7604: --- Following text issues are fixed *(1) Typo* Adding

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281515#comment-16281515 ] Weiwei Yang commented on YARN-7607: --- Thanks [~ajisakaa] for the review, I will commit this to branch-2.9,

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279564#comment-16279564 ] Weiwei Yang commented on YARN-7607: --- Hi [~ajisakaa], could you help to review this patch? Thanks >

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279710#comment-16279710 ] Weiwei Yang commented on YARN-7610: --- I found {{OpportunisticContainers.md}} was using hardcoded version

[jira] [Updated] (YARN-7611) Node manager web UI should display container type in containers page

[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7611: -- Attachment: YARN-7611.002.patch Thanks [~asuresh] for the review, somehow the jenkins job was not

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.002.patch > Extend Distributed Shell to support launching job with opportunistic

[jira] [Commented] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279758#comment-16279758 ] Weiwei Yang commented on YARN-7617: --- Thanks for fixing the words [~asuresh]. > Add a flag in distributed

[jira] [Commented] (YARN-7611) Node manager web UI should display container type in containers page

[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279636#comment-16279636 ] Weiwei Yang commented on YARN-7611: --- Result seems good, the UT failure was not related as this is pure

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: added_doc.png outline_compare.png v2 patch contains following updates #

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279585#comment-16279585 ] Weiwei Yang commented on YARN-7610: --- Hi [~asuresh] bq. Can you also update the doc as well ? Sure, I

[jira] [Created] (YARN-7617) Add a flag in distributed shell to automatically prompt opportunistic containers to guaranteed once they are started

Weiwei Yang created YARN-7617: - Summary: Add a flag in distributed shell to automatically prompt opportunistic containers to guaranteed once they are started Key: YARN-7617 URL:

[jira] [Updated] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7617: -- Description: Per discussion in YARN-7610, it would be good to add such a flag, e.g

[jira] [Comment Edited] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281515#comment-16281515 ] Weiwei Yang edited comment on YARN-7607 at 12/7/17 9:46 AM: Thanks [~ajisakaa]

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281574#comment-16281574 ] Weiwei Yang commented on YARN-7607: --- I've committed the patch to branch-2.9, branch-3.0, branch-3.0.0 and

[jira] [Commented] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285524#comment-16285524 ] Weiwei Yang commented on YARN-7608: --- This affects branch-2 as well (tested), cherry picked to branch-2

[jira] [Commented] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285497#comment-16285497 ] Weiwei Yang commented on YARN-7625: --- V3 patch resolved the checkstyle issue and fixed the UT failure. Hi

[jira] [Updated] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7608: -- Fix Version/s: 2.10.0 > Incorrect sTarget column causing DataTable warning on RM application and >

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Attachment: YARN-7625.003.patch > Expose NM node/containers resource utilization in JVM metrics >

[jira] [Commented] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285461#comment-16285461 ] Weiwei Yang commented on YARN-7608: --- Thanks [~GergelyNovak] for the contribution, I have just committed

[jira] [Updated] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7608: -- Target Version/s: 3.1.0, 2.9.1 (was: 3.0.0, 3.1.0, 2.9.1) > Incorrect sTarget column causing DataTable

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.005.patch > Extend Distributed Shell to support launching job with opportunistic

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279771#comment-16279771 ] Weiwei Yang commented on YARN-7610: --- Hi [~asuresh] bq. Since you are updating the documentation, can you

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.003.patch v3 patch attached which includes the minor doc changes to the

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279796#comment-16279796 ] Weiwei Yang commented on YARN-7610: --- Thanks for the +1 [~asuresh], the patch has whitespace issue, I will

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.004.patch > Extend Distributed Shell to support launching job with opportunistic

[jira] [Comment Edited] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279780#comment-16279780 ] Weiwei Yang edited comment on YARN-7610 at 12/6/17 7:26 AM: v3 patch attached

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279938#comment-16279938 ] Weiwei Yang commented on YARN-7610: --- There are still 4 line(s) that end in whitespace in v5 patch, but

[jira] [Created] (YARN-7611) Node manager web UI should display container type in containers page

Weiwei Yang created YARN-7611: - Summary: Node manager web UI should display container type in containers page Key: YARN-7611 URL: https://issues.apache.org/jira/browse/YARN-7611 Project: Hadoop YARN

[jira] [Updated] (YARN-7611) Node manager web UI should display container type in containers page

[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7611: -- Attachment: after_patch.png before_patch.png > Node manager web UI should display

[jira] [Updated] (YARN-7611) Node manager web UI should display container type in containers page

[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7611: -- Attachment: YARN-7611.001.patch > Node manager web UI should display container type in containers page >

[jira] [Commented] (YARN-7611) Node manager web UI should display container type in containers page

[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278450#comment-16278450 ] Weiwei Yang commented on YARN-7611: --- cc [~asuresh] and [~kkaranasos] Please help to review. Proposed to

[jira] [Updated] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7625: -- Attachment: YARN-7625.004.patch > Expose NM node/containers resource utilization in JVM metrics >

[jira] [Commented] (YARN-7625) Expose NM node/containers resource utilization in JVM metrics

[ https://issues.apache.org/jira/browse/YARN-7625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286953#comment-16286953 ] Weiwei Yang commented on YARN-7625: --- Thanks [~jlowe], that makes sense to me. V4 patch updated. > Expose

[jira] [Commented] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287276#comment-16287276 ] Weiwei Yang commented on YARN-5402: --- HI [~lars_francke] Can you please share the steps to reproduce

[jira] [Commented] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287348#comment-16287348 ] Weiwei Yang commented on YARN-5402: --- Thanks a lot for the confirmation, [~lars_francke] (y) > Fix

[jira] [Comment Edited] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287289#comment-16287289 ] Weiwei Yang edited comment on YARN-5402 at 12/12/17 9:04 AM: - Thanks

[jira] [Commented] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287289#comment-16287289 ] Weiwei Yang commented on YARN-5402: --- Thanks [~lars_francke], I will try with your steps in a few hours.

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287457#comment-16287457 ] Weiwei Yang commented on YARN-7624: --- Hi [~sunilg] I was simply running a distributed shell job, with a

[jira] [Created] (YARN-7642) Container execution type is not updated after promotion/demotion in NMContext

Weiwei Yang created YARN-7642: - Summary: Container execution type is not updated after promotion/demotion in NMContext Key: YARN-7642 URL: https://issues.apache.org/jira/browse/YARN-7642 Project: Hadoop

[jira] [Commented] (YARN-7642) Container execution type is not updated after promotion/demotion in NMContext

[ https://issues.apache.org/jira/browse/YARN-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287616#comment-16287616 ] Weiwei Yang commented on YARN-7642: --- Dig a bit more into the code, it looks like the problem can be

[jira] [Commented] (YARN-7642) Container execution type is not updated after promotion/demotion in NMContext

[ https://issues.apache.org/jira/browse/YARN-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287617#comment-16287617 ] Weiwei Yang commented on YARN-7642: --- +[~asuresh], [~kartheek], please share your thoughts, thanks. >

[jira] [Commented] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16287301#comment-16287301 ] Weiwei Yang commented on YARN-5402: --- That's nice [~lars_francke] :). If this happens in 2.7.5, then I

[jira] [Commented] (YARN-6592) Rich placement constraints in YARN

[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299705#comment-16299705 ] Weiwei Yang commented on YARN-6592: --- Thanks for the clarification [~kkaranasos] :) > Rich placement

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299659#comment-16299659 ] Weiwei Yang commented on YARN-6596: --- Hi [~kkaranasos] I have some general comments. I thought the main

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299714#comment-16299714 ] Weiwei Yang commented on YARN-6596: --- Hi [~kkaranasos], thanks, since current implementation is a

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16299699#comment-16299699 ] Weiwei Yang commented on YARN-6596: --- Figured allocation tags to nodes mapping is managed by

[jira] [Commented] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465396#comment-16465396 ] Weiwei Yang commented on YARN-8025: --- +1, committing shortly. >

[jira] [Updated] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8025: -- Fix Version/s: 3.0.3 > UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to >

[jira] [Commented] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465467#comment-16465467 ] Weiwei Yang commented on YARN-8025: --- I've committed this to trunk, cherry picked to branch-3.0 and

[jira] [Commented] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463640#comment-16463640 ] Weiwei Yang commented on YARN-8025: --- Hi [~Tao Yang] A couple comments 1. Can we move code  

[jira] [Comment Edited] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463640#comment-16463640 ] Weiwei Yang edited comment on YARN-8025 at 5/4/18 9:53 AM: --- Hi [~Tao Yang] A

[jira] [Commented] (YARN-8288) Fix wrong number of table columns in Resource Model doc

[ https://issues.apache.org/jira/browse/YARN-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474079#comment-16474079 ] Weiwei Yang commented on YARN-8288: --- Uploaded the patch to fix this, targeting to 3.1.1. Please see

[jira] [Commented] (YARN-8288) Fix wrong number of table columns in Resource Model doc

[ https://issues.apache.org/jira/browse/YARN-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16474105#comment-16474105 ] Weiwei Yang commented on YARN-8288: --- Hi [~Naganarasimha] Those are user-defined properties, there are no

[jira] [Created] (YARN-8288) Fix wrong number of table columns in Resource Model doc

Weiwei Yang created YARN-8288: - Summary: Fix wrong number of table columns in Resource Model doc Key: YARN-8288 URL: https://issues.apache.org/jira/browse/YARN-8288 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8288) Fix wrong number of table columns in Resource Model doc

[ https://issues.apache.org/jira/browse/YARN-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8288: -- Attachment: YARN-8288.001.patch > Fix wrong number of table columns in Resource Model doc >

<    1   2   3   4   5   6   7   8   9   10   >