[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148261#comment-15148261 ] Arun Suresh commented on YARN-4412: --- Many thanks for the detailed review [~curino]. # I totally agree

[jira] [Updated] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Attachment: YARN-4412-yarn-2877.v3.patch Uploading patch to rebase with the latest YARN-2877 as well as

[jira] [Reopened] (YARN-2225) Turn the virtual memory check to be off by default

[ https://issues.apache.org/jira/browse/YARN-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA reopened YARN-2225: - I'd like to reopen this. The issue was previously closed because this change is incompatible, but the

[jira] [Commented] (YARN-2225) Turn the virtual memory check to be off by default

[ https://issues.apache.org/jira/browse/YARN-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148306#comment-15148306 ] Akira AJISAKA commented on YARN-2225: - I'm thinking the default value should be changed in branch-2 as

[jira] [Commented] (YARN-2225) Turn the virtual memory check to be off by default

[ https://issues.apache.org/jira/browse/YARN-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148329#comment-15148329 ] Tsuyoshi Ozawa commented on YARN-2225: -- Why not making vmem-pmem ratio larger to address the problem?

[jira] [Commented] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148405#comment-15148405 ] Marco Rabozzi commented on YARN-4692: - Thanks [~vinodkv] for starting the discussion and [~asuresh] for

[jira] [Commented] (YARN-2225) Turn the virtual memory check to be off by default

[ https://issues.apache.org/jira/browse/YARN-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148449#comment-15148449 ] Akira AJISAKA commented on YARN-2225: - bq. Why not making vmem-pmem ratio larger to address the

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148532#comment-15148532 ] Hadoop QA commented on YARN-4412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4648) Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption

[ https://issues.apache.org/jira/browse/YARN-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148619#comment-15148619 ] Kai Sasaki commented on YARN-4648: -- [~ozawa] It's reasonable. I'll update. Thanks! > Move preemption

[jira] [Created] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

Steve Loughran created YARN-4695: Summary: EntityGroupFSTimelineStore to not log errors during shutdown Key: YARN-4695 URL: https://issues.apache.org/jira/browse/YARN-4695 Project: Hadoop YARN

[jira] [Commented] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148624#comment-15148624 ] Steve Loughran commented on YARN-4695: -- stack. Note how the interrupted exception happened during RPC

[jira] [Commented] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148643#comment-15148643 ] Steve Loughran commented on YARN-4695: -- Fuller stack. What's happening is the RM has been shut down

[jira] [Commented] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148644#comment-15148644 ] Steve Loughran commented on YARN-4695: -- ..hostname of www.bbc.co.uk/0.0.0.0:8032. is just 127.0.0.1

[jira] [Updated] (YARN-4648) Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption

[ https://issues.apache.org/jira/browse/YARN-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-4648: - Attachment: YARN-4648.02.patch > Move preemption related tests from TestFairScheduler to >

[jira] [Created] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

Steve Loughran created YARN-4696: Summary: EntityGroupFSTimelineStore to work in the absence of an RM Key: YARN-4696 URL: https://issues.apache.org/jira/browse/YARN-4696 Project: Hadoop YARN

[jira] [Updated] (YARN-4678) Cluster used capacity is > 100 when container reserved

[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4678: -- Attachment: 0001-YARN-4678.patch Hi [~brahmareddy] Sharing an initial version of patch based on above

[jira] [Commented] (YARN-4648) Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption

[ https://issues.apache.org/jira/browse/YARN-4648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148917#comment-15148917 ] Hadoop QA commented on YARN-4648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-4696: - Attachment: YARN-4696-001.patch Patch -001; thing I had to to do to get my (external, spark

[jira] [Assigned] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-4695: --- Assignee: Li Lu > EntityGroupFSTimelineStore to not log errors during shutdown >

[jira] [Commented] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148961#comment-15148961 ] Steve Loughran commented on YARN-4695: -- [~gtCarrera9] -I've fixed this in YARN-4696; if you could

[jira] [Updated] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Attachment: YARN-4412-yarn-2877.v4.patch Updating patch to fix testcases. With regard to the findbugs

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148995#comment-15148995 ] Hadoop QA commented on YARN-4696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: YARN-4117.v0.patch > End to end unit test with mini YARN cluster

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149006#comment-15149006 ] Giovanni Matteo Fumarola commented on YARN-4117: Hi [~jianhe] Can you please review this

[jira] [Commented] (YARN-4695) EntityGroupFSTimelineStore to not log errors during shutdown

[ https://issues.apache.org/jira/browse/YARN-4695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149041#comment-15149041 ] Li Lu commented on YARN-4695: - Sure. I'll take a look. Thanks for the work! > EntityGroupFSTimelineStore to

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149085#comment-15149085 ] Giovanni Matteo Fumarola commented on YARN-1547: Thanks for raising this [~vinodkv]. I was

[jira] [Updated] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4676: -- Fix Version/s: (was: 2.8.0) Removing fix-version as the patch isn't

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149193#comment-15149193 ] Vinod Kumar Vavilapalli commented on YARN-3637: --- [~ctrezzo], are you planning to working on

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149342#comment-15149342 ] Hadoop QA commented on YARN-4117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3945) maxApplicationsPerUser is wrongly calculated

[ https://issues.apache.org/jira/browse/YARN-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149365#comment-15149365 ] Wangda Tan commented on YARN-3945: -- [~Naganarasimha], bq. so based on this there will be no elasticity

[jira] [Commented] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149383#comment-15149383 ] Hadoop QA commented on YARN-4412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149414#comment-15149414 ] Wangda Tan commented on YARN-4484: -- Thanks [~sunilg]/[~bibinchundatt], bq. In new patch we can also take

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149431#comment-15149431 ] Giovanni Matteo Fumarola commented on YARN-4117: I just ran all the tests that failed or

[jira] [Commented] (YARN-4690) Skip object allocation in FSAppAttempt#getResourceUsage when possible

[ https://issues.apache.org/jira/browse/YARN-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149463#comment-15149463 ] Sangjin Lee commented on YARN-4690: --- It looks good to me for the most part. I have only one minor

[jira] [Commented] (YARN-3637) Handle localization sym-linking correctly at the YARN level

[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149512#comment-15149512 ] Chris Trezzo commented on YARN-3637: [~vinodkv] I don't think I will have time to work on this before

[jira] [Updated] (YARN-3637) Handle localization sym-linking correctly at the YARN level

[ https://issues.apache.org/jira/browse/YARN-3637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-3637: --- Target Version/s: 2.9.0 (was: 2.8.0) > Handle localization sym-linking correctly at the YARN level >

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-1492: --- Target Version/s: 2.9.0 (was: 2.8.0) > truly shared cache for jars (jobjar/libjar) >

[jira] [Created] (YARN-4697) NM aggregation thread pool is not bound by limits

Haibo Chen created YARN-4697: Summary: NM aggregation thread pool is not bound by limits Key: YARN-4697 URL: https://issues.apache.org/jira/browse/YARN-4697 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4696) EntityGroupFSTimelineStore to work in the absence of an RM

[ https://issues.apache.org/jira/browse/YARN-4696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149562#comment-15149562 ] Li Lu commented on YARN-4696: - Thanks for the work [~ste...@apache.org]! My main question is that what is the

[jira] [Updated] (YARN-4697) NM aggregation thread pool is not bound by limits

[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4697: - Attachment: yarn4697.001.patch > NM aggregation thread pool is not bound by limits >

[jira] [Commented] (YARN-4697) NM aggregation thread pool is not bound by limits

[ https://issues.apache.org/jira/browse/YARN-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149568#comment-15149568 ] Haibo Chen commented on YARN-4697: -- Default value is 100 as defined in YarnConfiguration > NM aggregation

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149654#comment-15149654 ] Jun Gong commented on YARN-3998: Sorry for late reply, I was on holiday. Thanks [~vinodkv] and [~vvasudev]

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149811#comment-15149811 ] Junping Du commented on YARN-3223: -- Sorry for reply late as on vacation recently. Will take a look at it

[jira] [Resolved] (YARN-4547) LeafQueue#getApplications() is read-only interface, but it provides reference to caller

[ https://issues.apache.org/jira/browse/YARN-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-4547. - Resolution: Done This change is handled along with YARN-4617. Closing it as Done >

[jira] [Commented] (YARN-4547) LeafQueue#getApplications() is read-only interface, but it provides reference to caller

[ https://issues.apache.org/jira/browse/YARN-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150015#comment-15150015 ] Devaraj K commented on YARN-4547: - shouldn't it be duplicate instead of Done? >