[jira] [Commented] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607600#comment-14607600 ] Ray Chiang commented on YARN-3823: -- I see this for YARN-193, using "git blame bc6777dd5bd

[jira] [Updated] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3768: Attachment: YARN-3768.004.patch > Index out of range exception with environment variables without values > --

[jira] [Updated] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3768: Attachment: (was: YARN-3768.004.patch) > Index out of range exception with environment variables without

[jira] [Commented] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607506#comment-14607506 ] Hadoop QA commented on YARN-3768: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607201#comment-14607201 ] Devaraj K commented on YARN-3823: - [~rchiang], Your change makes sense to me. YARN-193 add

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607196#comment-14607196 ] Masatake Iwasaki commented on YARN-3860: bq. I wonder if this affects the latency o

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14607191#comment-14607191 ] Masatake Iwasaki commented on YARN-3860: bq. Today, if both RMs become active, one

[jira] [Updated] (YARN-3489) RMServerUtils.validateResourceRequests should only obtain queue info once

[ https://issues.apache.org/jira/browse/YARN-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3489: -- Fix Version/s: (was: 2.7.1.) 2.7.1 > RMServerUtils.validat

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1480: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1767) Windows: Allow a way for users to augment classpath of YARN daemons

[ https://issues.apache.org/jira/browse/YARN-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1767: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-313: - Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the alr

[jira] [Updated] (YARN-2076) Minor error in TestLeafQueue files

[ https://issues.apache.org/jira/browse/YARN-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2076: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2162) Fair Scheduler :ability to optionally configure minResources and maxResources in terms of percentage

[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2162: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1844) yarn.log.server.url should have a default value

[ https://issues.apache.org/jira/browse/YARN-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1844: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2746) YARNDelegationTokenID misses serializing version from the common abstract ID

[ https://issues.apache.org/jira/browse/YARN-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2746: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1681) When "banned.users" is not set in LCE's container-executor.cfg, submit job with user in DEFAULT_BANNED_USERS will receive unclear error message

[ https://issues.apache.org/jira/browse/YARN-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1681: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2055: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2154: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2657: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1747) Better physical memory monitoring for containers

[ https://issues.apache.org/jira/browse/YARN-1747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1747: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1856: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2457) FairScheduler: Handle preemption to help starved parent queues

[ https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2457: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1874) Cleanup: Move RMActiveServices out of ResourceManager into its own file

[ https://issues.apache.org/jira/browse/YARN-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1874: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2037: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2599) Standby RM should also expose some jmx and metrics

[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2599: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2127: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2038) Revisit how AMs learn of containers from previous attempts

[ https://issues.apache.org/jira/browse/YARN-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2038: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2014: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-3478) FairScheduler page not performed because different enum of YarnApplicationState and RMAppState

[ https://issues.apache.org/jira/browse/YARN-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3478: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-1848) Persist ClusterMetrics across RM HA transitions

[ https://issues.apache.org/jira/browse/YARN-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1848: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2353) FairScheduler: Update demand asynchronously instead of in the Update Thread

[ https://issues.apache.org/jira/browse/YARN-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2353: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2506: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Updated] (YARN-2532) Track pending resources at the application level

[ https://issues.apache.org/jira/browse/YARN-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2532: -- Target Version/s: 2.6.1, 2.7.2 (was: 2.6.0) Moving all tickets targeted for the

[jira] [Commented] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606960#comment-14606960 ] Gera Shegalov commented on YARN-3768: - Good catch, [~zxu]. I rushed on the way home and

[jira] [Commented] (YARN-3861) Add fav icon to YARN & MR daemons web UI

[ https://issues.apache.org/jira/browse/YARN-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606937#comment-14606937 ] Devaraj K commented on YARN-3861: - HDFS and YARN/MR use different web frameworks for their

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606934#comment-14606934 ] chong chen commented on YARN-1042: -- A few comments and thoughts: 1) YARN Application Mod

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606906#comment-14606906 ] Hadoop QA commented on YARN-3116: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606886#comment-14606886 ] Ray Chiang commented on YARN-3823: -- RE: No new tests The unit test is in a different JIRA

[jira] [Commented] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606872#comment-14606872 ] zhihai xu commented on YARN-3768: - thanks for the new patch [~jira.shegalov]! I uploaded a

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606870#comment-14606870 ] Junping Du commented on YARN-3860: -- bq. The only reason we don't want both RMs to be activ

[jira] [Updated] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3768: Attachment: YARN-3768.004.patch > Index out of range exception with environment variables without values > --

the finalStatus is KILLED, but the state is still running?

Hi, I found a issue of yarn. I run a hive job in my environment, but the yarn heap is too small, so I got log: Diagnostic Messages for this Task: Error: Java heap space Container killed by the ApplicationMaster. e89d1295acf347ec8dfd85834531a111 but the hive job is still running and hanged. Then I

[jira] [Commented] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606806#comment-14606806 ] Hadoop QA commented on YARN-3768: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606766#comment-14606766 ] Ming Ma commented on YARN-3445: --- Thanks [~djp]. Quick questions: * Regarding the extra memor

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606734#comment-14606734 ] Wangda Tan commented on YARN-2004: -- Thanks [~sunilg]'s update, some comments from my side:

[jira] [Updated] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-3116: --- Attachment: YARN-3116.v2.patch > [Collector wireup] We need an assured way to d

[jira] [Commented] (YARN-3116) [Collector wireup] We need an assured way to determine if a container is an AM container on NM

[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606723#comment-14606723 ] Giovanni Matteo Fumarola commented on YARN-3116: Thanks [~subru] and [~zjsh

[jira] [Updated] (YARN-3768) Index out of range exception with environment variables without values

[ https://issues.apache.org/jira/browse/YARN-3768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated YARN-3768: Attachment: YARN-3768.003.patch Thanks for reviewing the patch, [~zxu]! bq. If the input is "a=b=c"

[jira] [Commented] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606712#comment-14606712 ] Hadoop QA commented on YARN-3823: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606697#comment-14606697 ] Jian He commented on YARN-2004: --- thanks Sunil ! some comments on the patch: - The app prior

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868.1.patch Attach patch for ContainerManager recovery logic > ContainerManager recovery f

[jira] [Updated] (YARN-3867) ContainerImpl changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3867: Attachment: YARN-3867.1.patch Attach patch for containerImpl changes > ContainerImpl changes to support cont

[jira] [Commented] (YARN-3846) RM Web UI queue filter is not working

[ https://issues.apache.org/jira/browse/YARN-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606673#comment-14606673 ] Wangda Tan commented on YARN-3846: -- [~mohdshahidkhan], I tried to reproduce this in 2.7, i

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.2.patch > RM-NM protocol changes and NodeStatusUpdater implementation to support > con

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.1.patch Attach patch for RM-NM protocol changes and NodeStatusUpdater Implementation.

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Attachment: YARN-1645.1.patch Attach patch of ContainerManager changes > ContainerManager implementation to

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.1.patch Attach patch for AM-NM protocol changes > AM-NM protocol changes to support co

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606653#comment-14606653 ] Hadoop QA commented on YARN-3508: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (YARN-3868) ContainerManager recovery for container resizing

MENG DING created YARN-3868: --- Summary: ContainerManager recovery for container resizing Key: YARN-3868 URL: https://issues.apache.org/jira/browse/YARN-3868 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-3867) ContainerImpl changes to support container resizing

MENG DING created YARN-3867: --- Summary: ContainerImpl changes to support container resizing Key: YARN-3867 URL: https://issues.apache.org/jira/browse/YARN-3867 Project: Hadoop YARN Issue Type: Sub-t

[jira] [Commented] (YARN-3793) Several NPEs when deleting local files on NM recovery

[ https://issues.apache.org/jira/browse/YARN-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606648#comment-14606648 ] Hadoop QA commented on YARN-3793: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Summary: ContainerManager implementation to support container resizing (was: Add increaseContainersResource

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Description: Implementation of ContainerManager for container resize, including: 1) ContainerManager resize

[jira] [Commented] (YARN-3841) [Storage implementation] Create HDFS backing storage implementation for ATS writes

[ https://issues.apache.org/jira/browse/YARN-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606645#comment-14606645 ] Zhijie Shen commented on YARN-3841: --- We have FS implementation, but it uses java File api

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Summary: RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing (was: [YA

[jira] [Reopened] (YARN-1644) [YARN-1197] Add newly decreased container to NodeStatus in NM side

[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reopened YARN-1644: - Assignee: MENG DING Reopen this issue to track RM-NM protocol and NodeStatusUpdater implementation > [YA

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606619#comment-14606619 ] Varun Saxena commented on YARN-3508: I mean, We can open an interface for posting event

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606618#comment-14606618 ] Varun Saxena commented on YARN-3508: [~leftnoteasy], the test failures seem unrelated.

[jira] [Comment Edited] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606611#comment-14606611 ] Zhijie Shen edited comment on YARN-3047 at 6/29/15 11:01 PM: - 1

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606611#comment-14606611 ] Zhijie Shen commented on YARN-3047: --- 1. We should be able to reuse "TimelineAbout". 2. I

[jira] [Updated] (YARN-1645) Add increaseContainersResource interface and implementations to ContainerManager

[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Description: Implementation of ContainerManager for container resize, including: 1) Container resize logic

[jira] [Updated] (YARN-1645) Add increaseContainersResource interface and implementations to ContainerManager

[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Summary: Add increaseContainersResource interface and implementations to ContainerManager (was: [YARN-1197]

[jira] [Reopened] (YARN-1645) [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol

[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reopened YARN-1645: - Assignee: MENG DING Reopen this issue as a subtask of YARN-1197. This issue tracks the ContainerManager

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606588#comment-14606588 ] Karthik Kambatla commented on YARN-3860: Also, I wonder if this affects the latency

[jira] [Commented] (YARN-3860) rmadmin -transitionToActive should check the state of non-target node

[ https://issues.apache.org/jira/browse/YARN-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606586#comment-14606586 ] Karthik Kambatla commented on YARN-3860: I am not convinced we need this. The only

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606577#comment-14606577 ] Varun Saxena commented on YARN-3051: [~zjshen], thanks for looking at the patch. bq. I

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606576#comment-14606576 ] Wangda Tan commented on YARN-3508: -- [~varun_saxena], It seems to me this patch doesn't wor

[jira] [Updated] (YARN-3823) Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property

[ https://issues.apache.org/jira/browse/YARN-3823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3823: - Attachment: YARN-3823.001.patch Initial version. Assume YarnConfiguration.DEFAULT_RM_SCHEDULER_MAXIMUM_AL

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606549#comment-14606549 ] Anubhav Dhoot commented on YARN-2005: - The getNumActiveNMs gets number of unique NodeId

[jira] [Commented] (YARN-3848) TestNodeLabelContainerAllocation is timing out

[ https://issues.apache.org/jira/browse/YARN-3848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606543#comment-14606543 ] Wangda Tan commented on YARN-3848: -- Hi [~varun_saxena], Thanks for working on this patch.

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606542#comment-14606542 ] Zhijie Shen commented on YARN-3051: --- Varun, thanks for take over the reader interface pat

[jira] [Updated] (YARN-3793) Several NPEs when deleting local files on NM recovery

[ https://issues.apache.org/jira/browse/YARN-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3793: --- Attachment: YARN-3793.02.patch > Several NPEs when deleting local files on NM recovery > --

[jira] [Updated] (YARN-3793) Several NPEs when deleting local files on NM recovery

[ https://issues.apache.org/jira/browse/YARN-3793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3793: --- Priority: Major (was: Critical) Changing the priority back to original. Was bumped up to Critical beca

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Description: AM-NM protocol changes to support container resizing 1) "IncreaseContainersResourceRequest" and

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: (was: YARN-1449.2.patch) > AM-NM protocol changes to support container resizing > ---

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Summary: AM-NM protocol changes to support container resizing (was: Protocol changes in NM side to support c

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Component/s: (was: nodemanager) api > AM-NM protocol changes to support container resizi

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: (was: YARN-1449.1.patch) > AM-NM protocol changes to support container resizing > ---

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606510#comment-14606510 ] Li Lu commented on YARN-3051: - OK, linked all related JIRAs to this one. Feel free to add more.

[jira] [Commented] (YARN-3770) SerializedException should also handle java.lang.Error

[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606498#comment-14606498 ] Hudson commented on YARN-3770: -- FAILURE: Integrated in Hadoop-trunk-Commit #8089 (See [https:

[jira] [Commented] (YARN-2005) Blacklisting support for scheduling AMs

[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606491#comment-14606491 ] Jason Lowe commented on YARN-2005: -- Thanks for posting a patch, Anubhav! I haven't done a

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606469#comment-14606469 ] Varun Saxena commented on YARN-3051: To be precise, YARN-3863 is meant for that. To mak

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606466#comment-14606466 ] Varun Saxena commented on YARN-3051: [~gtCarrera9], I included the relational operators

[jira] [Updated] (YARN-1370) Fair scheduler to re-populate container allocation state

[ https://issues.apache.org/jira/browse/YARN-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1370: --- Component/s: (was: resourcemanager) fairscheduler > Fair scheduler to re-p

[jira] [Updated] (YARN-1923) Make FairScheduler resource ratio calculations terminate faster

[ https://issues.apache.org/jira/browse/YARN-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1923: --- Component/s: (was: scheduler) fairscheduler > Make FairScheduler resource

[jira] [Updated] (YARN-1550) NPE in FairSchedulerAppsBlock#render

[ https://issues.apache.org/jira/browse/YARN-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1550: --- Component/s: (was: scheduler) fairscheduler > NPE in FairSchedulerAppsBloc

[jira] [Updated] (YARN-1774) FS: Submitting to non-leaf queue throws NPE

[ https://issues.apache.org/jira/browse/YARN-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1774: --- Component/s: (was: resourcemanager) fairscheduler > FS: Submitting to non-

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606459#comment-14606459 ] MENG DING commented on YARN-1197: - Released containers which are in RUNNING state are put i

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606458#comment-14606458 ] Li Lu commented on YARN-3051: - Hi [~varun_saxena], thanks for the patch! I think this version i

[jira] [Commented] (YARN-3770) SerializedException should also handle java.lang.Error

[ https://issues.apache.org/jira/browse/YARN-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606441#comment-14606441 ] Jian He commented on YARN-3770: --- +1 > SerializedException should also handle java.lang.Error

  1   2   >