[jira] [Commented] (YARN-4685) AM blacklisting result in application to get hanged

[ https://issues.apache.org/jira/browse/YARN-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282415#comment-15282415 ] Rohith Sharma K S commented on YARN-4685: - Since this issue is introduced by YARN-2005 and

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282381#comment-15282381 ] Rohith Sharma K S commented on YARN-4002: - I agree this wont solve 100%, but it reduces lock time

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282354#comment-15282354 ] Rohith Sharma K S commented on YARN-4002: - For the second suggestion, IIRC I was suggested to

[jira] [Commented] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282349#comment-15282349 ] Gour Saha commented on YARN-5079: - [~vinodkv], there was a discussion thread in the Slider dev list on this

[jira] [Updated] (YARN-3426) Add jdiff support to YARN

[ https://issues.apache.org/jira/browse/YARN-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3426: -- Attachment: YARN-3426-05-12-2016.txt bq. The problem for the current solution is

[jira] [Created] (YARN-5081) Replace RPC calls with WebService calls in LogsCLI

Xuan Gong created YARN-5081: --- Summary: Replace RPC calls with WebService calls in LogsCLI Key: YARN-5081 URL: https://issues.apache.org/jira/browse/YARN-5081 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5041) application master log can not be available when clicking jobhistory's am logs link

[ https://issues.apache.org/jira/browse/YARN-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5041: - Attachment: yarn5041.001.patch The patch is tested locally. IMO, the unit test is too difficult to create

[jira] [Updated] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2888: -- Attachment: YARN-2888.009.patch [~curino], Thought I had addressed that.. sorry.. I guess using round()

[jira] [Updated] (YARN-5076) YARN web interfaces lack XFS protection

[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Maron updated YARN-5076: - Attachment: YARN-5076.002.patch Fix for NPE discovered through wider testing > YARN web

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282276#comment-15282276 ] Carlo Curino commented on YARN-2888: Thanks [~asuresh] for addressing the comments. Generally +1, with

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282250#comment-15282250 ] Jian He commented on YARN-4837: --- so, I think we should mark the public APIs to be private/unstable till we

[jira] [Updated] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5080: Attachment: YARN-5080.1.patch > Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM >

[jira] [Commented] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282240#comment-15282240 ] Xuan Gong commented on YARN-5080: - The issue is that we use the wrong way to get RM web address. In

[jira] [Commented] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282241#comment-15282241 ] Xuan Gong commented on YARN-5080: - trivial patch without testcase > Cannot obtain logs using YARN CLI -am

[jira] [Updated] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5080: Affects Version/s: 2.8.0 > Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM >

[jira] [Created] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

Sumana Sathish created YARN-5080: Summary: Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM Key: YARN-5080 URL: https://issues.apache.org/jira/browse/YARN-5080 Project: Hadoop

[jira] [Updated] (YARN-4969) Fix more loggings in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4969: - Target Version/s: 2.9.0 (was: 2.8.0) > Fix more loggings in CapacityScheduler >

[jira] [Commented] (YARN-4685) AM blacklisting result in application to get hanged

[ https://issues.apache.org/jira/browse/YARN-4685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282145#comment-15282145 ] Wangda Tan commented on YARN-4685: -- [~rohithsharma], it seems to me that there's no consensus about how to

[jira] [Commented] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282120#comment-15282120 ] Vinod Kumar Vavilapalli commented on YARN-5079: --- Now thinking of solutions I laid down in the

[jira] [Created] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

Vinod Kumar Vavilapalli created YARN-5079: - Summary: [Umbrella] Native YARN framework layer for services and beyond Key: YARN-5079 URL: https://issues.apache.org/jira/browse/YARN-5079

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282095#comment-15282095 ] Hadoop QA commented on YARN-4958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Description: 1) When a queue's weight is set to 0.0, FSLeafQueue#getFairShare() returns

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Description: 1) When a queue's weight is set to 0.0, FSLeafQueue#getFairShare() returns

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Description: 1) When a queue's weight is set to 0.0, FSLeafQueue#getFairShare() returns

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282082#comment-15282082 ] Yufei Gu commented on YARN-5024: [~bibinchundatt], Thanks for the new patch. Look pretty good. Since this

[jira] [Updated] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4325: - Target Version/s: 2.8.0 > Purge app state from NM state-store should cover more LOG_HANDLING cases >

[jira] [Updated] (YARN-4635) Add global blacklist tracking for AM container failure.

[ https://issues.apache.org/jira/browse/YARN-4635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4635: - Target Version/s: (was: 2.8.0) > Add global blacklist tracking for AM container failure. >

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Description: 1) When a queue's weight is set to 0.0, FSLeafQueue#getFairShare() returns

[jira] [Updated] (YARN-4301) NM disk health checker should have a timeout

[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4301: - Issue Type: Sub-task (was: Bug) Parent: YARN-5078 > NM disk health checker should have a timeout

[jira] [Updated] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4325: - Attachment: YARN-4325-v3.1.patch Fix checkstyle and whitespace issue in v3.1 patch. > Purge app state

[jira] [Updated] (YARN-3321) "Health-Report" column of NodePage should display more information.

[ https://issues.apache.org/jira/browse/YARN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3321: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5078 > "Health-Report" column of NodePage

[jira] [Updated] (YARN-1072) Need a default NodeManager health check script

[ https://issues.apache.org/jira/browse/YARN-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-1072: - Issue Type: Sub-task (was: Task) Parent: YARN-5078 > Need a default NodeManager health check

[jira] [Updated] (YARN-1072) Need a default NodeManager health check script

[ https://issues.apache.org/jira/browse/YARN-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-1072: - Assignee: Yufei Gu > Need a default NodeManager health check script >

[jira] [Updated] (YARN-3531) Make "good" local directories available to ContainerExecutors at initialization time

[ https://issues.apache.org/jira/browse/YARN-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3531: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5078 > Make "good" local directories

[jira] [Updated] (YARN-3321) "Health-Report" column of NodePage should display more information.

[ https://issues.apache.org/jira/browse/YARN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3321: - Assignee: Yufei Gu > "Health-Report" column of NodePage should display more information. >

[jira] [Updated] (YARN-3531) Make "good" local directories available to ContainerExecutors at initialization time

[ https://issues.apache.org/jira/browse/YARN-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3531: - Assignee: Yufei Gu > Make "good" local directories available to ContainerExecutors at > initialization

[jira] [Updated] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3797: - Issue Type: Sub-task (was: Bug) Parent: YARN-5078 > NodeManager not blacklisting the disk

[jira] [Updated] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3797: - Assignee: Yufei Gu > NodeManager not blacklisting the disk (shuffle) with errors >

[jira] [Updated] (YARN-4271) Make the NodeManager's health checker service pluggable

[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4271: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5078 > Make the NodeManager's health checker

[jira] [Created] (YARN-5078) [Umbrella] NodeManager health checker improvements

Ray Chiang created YARN-5078: Summary: [Umbrella] NodeManager health checker improvements Key: YARN-5078 URL: https://issues.apache.org/jira/browse/YARN-5078 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5076) YARN web interfaces lack XFS protection

[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282032#comment-15282032 ] Hadoop QA commented on YARN-5076: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4913) Yarn logs should take a -out option to write to a directory

[ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282009#comment-15282009 ] Xuan Gong commented on YARN-4913: - Thanks for the review. [~vvasudev] The checkstyle warning is spurious. I

[jira] [Commented] (YARN-4913) Yarn logs should take a -out option to write to a directory

[ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282008#comment-15282008 ] Xuan Gong commented on YARN-4913: - Thanks for the review. [~vvasudev] The checkstyle warning is spurious. I

[jira] [Updated] (YARN-4977) Fix javadocs warnings in yarn-api for jdk 1.8

[ https://issues.apache.org/jira/browse/YARN-4977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4977: Priority: Critical (was: Major) > Fix javadocs warnings in yarn-api for jdk 1.8 >

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281960#comment-15281960 ] Hadoop QA commented on YARN-4325: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281923#comment-15281923 ] Allen Wittenauer commented on YARN-4757: Have we looked at using Consul? > [Umbrella] Simplified

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281922#comment-15281922 ] Hadoop QA commented on YARN-5024: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281917#comment-15281917 ] Wangda Tan commented on YARN-4515: -- Thanks [~sunilg]! Refresh/back works perfectly for me! Few issues: -

[jira] [Updated] (YARN-5047) Refactor nodeUpdate() from FairScheduler, CapacityScheduler, and FifoScheduler

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5047: - Summary: Refactor nodeUpdate() from FairScheduler, CapacityScheduler, and FifoScheduler (was: Refactor

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281911#comment-15281911 ] Hudson commented on YARN-4577: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9753 (See

[jira] [Resolved] (YARN-4513) [YARN-3368] Upgrade to Ember 2.2.0

[ https://issues.apache.org/jira/browse/YARN-4513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-4513. --- Resolution: Duplicate With YARN-4514, we are already in ember 2.2.0. Snippet from *bower.json* {{"ember":

[jira] [Assigned] (YARN-4513) [YARN-3368] Upgrade to Ember 2.2.0

[ https://issues.apache.org/jira/browse/YARN-4513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-4513: - Assignee: Sunil G > [YARN-3368] Upgrade to Ember 2.2.0 > -- > >

[jira] [Updated] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4515: -- Attachment: YARN-4515-YARN-3368.4.patch Issues mentioned in YARN-5038 is also handled in this latest patch. This

[jira] [Created] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

Yufei Gu created YARN-5077: -- Summary: Fix FSLeafQueue#getFairShare() for queues with weight 0.0 Key: YARN-5077 URL: https://issues.apache.org/jira/browse/YARN-5077 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5038) [YARN-3368] Application and Container pages shows wrong values when RM is stopped

[ https://issues.apache.org/jira/browse/YARN-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281886#comment-15281886 ] Wangda Tan commented on YARN-5038: -- [~sunilg], showing empty or something like "-" for finish time of

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281883#comment-15281883 ] Jian He commented on YARN-4002: --- [~rohithsharma], the patch may not work because hostsReader.refresh() tries

[jira] [Commented] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281874#comment-15281874 ] Wangda Tan commented on YARN-4484: -- Looks good, thanks [~sunilg]. Will commit tomorrow if opposite

[jira] [Updated] (YARN-4811) Generate histograms in ContainerMetrics for actual container resource usage

[ https://issues.apache.org/jira/browse/YARN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4811: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-2141 > Generate

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281866#comment-15281866 ] Wangda Tan commented on YARN-4963: -- Latest patch looks good, thanks [~nroberts]! > capacity scheduler:

[jira] [Updated] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1942: - Attachment: YARN-1942.3.patch Rebased to latest trunk (ver.3) > Many of ConverterUtils methods need to

[jira] [Updated] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-4963: - Attachment: YARN-4963.003.patch Thank you [~leftnoteasy] for the comments! I have addressed them

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281856#comment-15281856 ] Vinod Kumar Vavilapalli commented on YARN-1547: --- [~giovanni.fumarola] any update? > Prevent

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.004.patch Fixed the style issue. > FairScheduler: AMs can consume all vcores leading to

[jira] [Updated] (YARN-5041) application master log can not be available when clicking jobhistory's am logs link

[ https://issues.apache.org/jira/browse/YARN-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5041: Priority: Critical (was: Major) > application master log can not be available when clicking

[jira] [Commented] (YARN-4484) Available Resource calculation for a queue is not correct when used with labels

[ https://issues.apache.org/jira/browse/YARN-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281844#comment-15281844 ] Sunil G commented on YARN-4484: --- Thanks [~leftnoteasy]. Test case failures are know. YARN-5024, YARN-5057 and

[jira] [Assigned] (YARN-5041) application master log can not be available when clicking jobhistory's am logs link

[ https://issues.apache.org/jira/browse/YARN-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-5041: --- Assignee: Haibo Chen You're right, the AM logs link in the JHS has the wrong port in the URL,

[jira] [Commented] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281831#comment-15281831 ] Sunil G commented on YARN-5024: --- As mentioned by [~templedf], we dont need a big timeout here. 10seconds

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281827#comment-15281827 ] Wangda Tan commented on YARN-4844: -- [~ozawa], could you please share your thoughts? > Add

[jira] [Resolved] (YARN-3126) FairScheduler: queue's usedResource is always more than the maxResource limit

[ https://issues.apache.org/jira/browse/YARN-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-3126. Resolution: Duplicate Fix Version/s: 2.8.0 > FairScheduler: queue's usedResource is always more than

[jira] [Commented] (YARN-3126) FairScheduler: queue's usedResource is always more than the maxResource limit

[ https://issues.apache.org/jira/browse/YARN-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281812#comment-15281812 ] Yufei Gu commented on YARN-3126: It is fixed by YARN-3655. So I just close it. > FairScheduler: queue's

[jira] [Updated] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4325: - Attachment: YARN-4325-v3.patch Thanks [~jlowe] for review and comments. v3 patch fix the unit test failure

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281771#comment-15281771 ] Xuan Gong commented on YARN-4577: - [~sjlee0] Please commit into trunk and branch-2. Thanks > Enable aux

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281768#comment-15281768 ] Wangda Tan commented on YARN-4002: -- Thanks [~rohithsharma], Few suggestions: 1) hostsWrite/ReadLock ->

[jira] [Updated] (YARN-5072) Support comma separated list of includes and excludes files

[ https://issues.apache.org/jira/browse/YARN-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated YARN-5072: -- Attachment: YARN-5072.patch Here is the draft path. YARN and HDFS use HostsFileReader differently. The patch

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281757#comment-15281757 ] Sangjin Lee commented on YARN-4577: --- +1. Committing shortly. I'm going to commit to trunk and branch-2

[jira] [Commented] (YARN-5026) Container fail to launch for mapred application

[ https://issues.apache.org/jira/browse/YARN-5026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281756#comment-15281756 ] Sunil G commented on YARN-5026: --- [~bibinchundatt] / [~rkanter] Is it possible that we can set default value

[jira] [Commented] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281754#comment-15281754 ] Wangda Tan commented on YARN-3997: -- Thanks [~asuresh] > An Application requesting multiple core

[jira] [Updated] (YARN-3997) An Application requesting multiple core containers can't preempt running application made of single core containers

[ https://issues.apache.org/jira/browse/YARN-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3997: - Target Version/s: 2.9.0 (was: 2.8.0) > An Application requesting multiple core containers can't preempt

[jira] [Commented] (YARN-5038) [YARN-3368] Application and Container pages shows wrong values when RM is stopped

[ https://issues.apache.org/jira/browse/YARN-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281747#comment-15281747 ] Sunil G commented on YARN-5038: --- Sorry. My bad, this scenario is handled already in {{timeline-view.js}}.

[jira] [Commented] (YARN-3344) procfs stat file is not in the expected format warning

[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281741#comment-15281741 ] Daniel Templeton commented on YARN-3344: [~ajisakaa], I'm pretty sure you can get away with just

[jira] [Commented] (YARN-5038) [YARN-3368] Application and Container pages shows wrong values when RM is stopped

[ https://issues.apache.org/jira/browse/YARN-5038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281740#comment-15281740 ] Sunil G commented on YARN-5038: --- For container finished time, we are getting a value called year 1970 from

[jira] [Updated] (YARN-4515) [YARN-3368] Support hosting web UI framework inside YARN RM

[ https://issues.apache.org/jira/browse/YARN-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4515: -- Attachment: YARN-4515-YARN-3368.3.patch Uploading a cleaner patch. [~leftnoteasy], could you please help to

[jira] [Commented] (YARN-4913) Yarn logs should take a -out option to write to a directory

[ https://issues.apache.org/jira/browse/YARN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281710#comment-15281710 ] Varun Vasudev commented on YARN-4913: - My apologies Xuan. I was looking at the wrong patch. The latest

[jira] [Updated] (YARN-5041) application master log can not be available when clicking jobhistory's am logs link

[ https://issues.apache.org/jira/browse/YARN-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5041: - Target Version/s: 2.9.0 Fix Version/s: (was: 3.0.0) It would be a significant regression if

[jira] [Updated] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5007: --- Description: MiniYarnCluster has a deprecated constructor which is called by the other constructors

[jira] [Commented] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281617#comment-15281617 ] Arun Suresh commented on YARN-2888: --- Thanks for the reviews [~kkaranasos].. [~curino], can you please

[jira] [Updated] (YARN-5024) TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure

[ https://issues.apache.org/jira/browse/YARN-5024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5024: --- Attachment: 0004-YARN-5024.patch [~templedf] Thank you for review comments. Yes need to only

[jira] [Updated] (YARN-5076) YARN web interfaces lack XFS protection

[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Maron updated YARN-5076: - Attachment: YARN-5076.001.patch This patch integrated the XFrame Options Filter from Hadoop

[jira] [Updated] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4958: --- Attachment: YARN-4958.002.patch This patch should address most of the concerns. It adds

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281551#comment-15281551 ] Varun Vasudev commented on YARN-4577: - Latest patch looks good to me. [~sjlee0] what do you think? >

[jira] [Created] (YARN-5076) YARN web interfaces lack XFS protection

Jonathan Maron created YARN-5076: Summary: YARN web interfaces lack XFS protection Key: YARN-5076 URL: https://issues.apache.org/jira/browse/YARN-5076 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281388#comment-15281388 ] Hudson commented on YARN-5068: -- FAILURE: Integrated in Hadoop-trunk-Commit #9750 (See

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281384#comment-15281384 ] Rohith Sharma K S commented on YARN-5068: - committed to trunk!! Patch does not apply for branch-2,

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281341#comment-15281341 ] Rohith Sharma K S commented on YARN-5068: - +1lgtm > Expose scheduler queue to application master >

[jira] [Commented] (YARN-5068) Expose scheduler queue to application master

[ https://issues.apache.org/jira/browse/YARN-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281334#comment-15281334 ] Varun Vasudev commented on YARN-5068: - Latest patch looks good to me. [~rohithsharma] - is it fine by

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281264#comment-15281264 ] Hadoop QA commented on YARN-4002: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281239#comment-15281239 ] Hadoop QA commented on YARN-4577: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||