[jira] [Updated] (YARN-7327) Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7327: -- Summary: Allocate containers asynchronously by default (was: Launch containers asynchronously by default

[jira] [Comment Edited] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202047#comment-16202047 ] Arun Suresh edited comment on YARN-7275 at 10/12/17 2:51 PM: - T

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16202047#comment-16202047 ] Arun Suresh commented on YARN-7275: --- Thanks for the updated patch [~kartheek] Couple of

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200609#comment-16200609 ] Arun Suresh commented on YARN-6940: --- [~haibochen] / [~templedf], Can one of you take a qu

[jira] [Comment Edited] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198077#comment-16198077 ] Arun Suresh edited comment on YARN-4511 at 10/10/17 3:08 AM: - [

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198077#comment-16198077 ] Arun Suresh commented on YARN-4511: --- [~haibochen], took a quick look at the patch. With r

[jira] [Comment Edited] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16198077#comment-16198077 ] Arun Suresh edited comment on YARN-4511 at 10/10/17 3:07 AM: - [

[jira] [Commented] (YARN-7299) TestDistributedScheduler is failing

2017-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16197260#comment-16197260 ] Arun Suresh commented on YARN-7299: --- Thanks for raising this [~jlowe] Yeah... we changed

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16196102#comment-16196102 ] Arun Suresh commented on YARN-7275: --- Thanks for the patch [~kartheek] Couple of comments

[jira] [Commented] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193838#comment-16193838 ] Arun Suresh commented on YARN-7258: --- Committed this to branch-3.0 and branch-2 as well >

[jira] [Updated] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7258: -- Fix Version/s: 2.9.0 > Add Node and Rack Hints to Opportunistic Scheduler > -

[jira] [Commented] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193200#comment-16193200 ] Arun Suresh commented on YARN-7258: --- +1 for the latest patch. Committed this to trunk. Th

[jira] [Commented] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16191701#comment-16191701 ] Arun Suresh commented on YARN-7258: --- Thanks for the patch [~kartheek] Some comments: * It

[jira] [Commented] (YARN-5978) ContainerScheduler and ContainerManager changes to support ExecType update

2017-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190934#comment-16190934 ] Arun Suresh commented on YARN-5978: --- Thanks for following up [~ajisakaa].. I had ignored

[jira] [Commented] (YARN-7044) TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails on trunk

2017-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190932#comment-16190932 ] Arun Suresh commented on YARN-7044: --- Nice catch [~ajisakaa] !! The patch looks good. +1 p

[jira] [Commented] (YARN-7219) Fix AllocateRequestProto difference between branch-2/branch-2.8 and trunk

2017-10-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190357#comment-16190357 ] Arun Suresh commented on YARN-7219: --- +1 > Fix AllocateRequestProto difference between br

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16186878#comment-16186878 ] Arun Suresh commented on YARN-7275: --- [~andrew.wang], yup.. i would consider this a blocke

[jira] [Updated] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4858: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > start-yar

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2037: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Add resta

[jira] [Updated] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5762: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Summarize

[jira] [Updated] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7226: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Whitelist

[jira] [Updated] (YARN-4721) RM to try to auth with HDFS on startup, retry with max diagnostics on failure

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4721: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > RM to try

[jira] [Updated] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5329: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Reservati

[jira] [Updated] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7262: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Add a hie

[jira] [Updated] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2919: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Potential

[jira] [Updated] (YARN-3861) Add fav icon to YARN & MR daemons web UI

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3861: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Add fav i

[jira] [Updated] (YARN-3514) Active directory usernames like domain\login cause YARN failures

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3514: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Active di

[jira] [Updated] (YARN-3625) RollingLevelDBTimelineStore Incorrectly Forbids Related Entity in Same Put

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3625: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > RollingLe

[jira] [Updated] (YARN-574) PrivateLocalizer does not support parallel resource download via ContainerLocalizer

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-574: - Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > PrivateLocal

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2681: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Support b

[jira] [Updated] (YARN-1564) add workflow YARN services

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-1564: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > add workf

[jira] [Updated] (YARN-2031) YARN Proxy model doesn't support REST APIs in AMs

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2031: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > YARN Prox

[jira] [Updated] (YARN-2748) Upload logs in the sub-folders under the local log dir when aggregating logs

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2748: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Upload lo

[jira] [Updated] (YARN-5926) clean up registry code for java 7/8

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5926: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > clean up

[jira] [Updated] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6916: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Moving lo

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6623: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Add suppo

[jira] [Updated] (YARN-6426) Compress ZK YARN keys to scale up (especially AppStateData

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6426: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Compress

[jira] [Updated] (YARN-4988) Limit filter in ApplicationBaseProtocol#getApplications should return latest applications

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4988: -- Is this still on target for 2.9.0 ? If not, can we we push this out to the next major release ? > Limit fil

[jira] [Updated] (YARN-7086) Release all containers aynchronously

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7086: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Release all containers aynchronously > ---

[jira] [Updated] (YARN-1426) YARN Components need to unregister their beans upon shutdown

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-1426: -- Target Version/s: 3.1.0 (was: 2.9.0) > YARN Components need to unregister their beans upon shutdown > --

[jira] [Updated] (YARN-4971) RM fails to re-bind to wildcard IP after failover in multi homed clusters

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4971: -- Target Version/s: 3.1.0 (was: 2.9.0) > RM fails to re-bind to wildcard IP after failover in multi homed

[jira] [Updated] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6712: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Moving logging APIs over to slf4j in hadoop-yarn > ---

[jira] [Updated] (YARN-2442) ResourceManager JMX UI does not give HA State

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2442: -- Target Version/s: 3.1.0 (was: 2.9.0) > ResourceManager JMX UI does not give HA State > -

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-1492: -- Target Version/s: 3.1.0 (was: 2.9.0) > truly shared cache for jars (jobjar/libjar) > ---

[jira] [Updated] (YARN-4953) Delete completed container log folder when rolling log aggregation is enabled

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4953: -- Target Version/s: 3.1.0 (was: 2.9.0) > Delete completed container log folder when rolling log aggregatio

[jira] [Updated] (YARN-6963) Prevent other containers from staring when a container is re-initializing

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6963: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Prevent other containers from staring when a container is

[jira] [Updated] (YARN-4485) [Umbrella] Capture per-application and per-queue container allocation latency

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4485: -- Target Version/s: 3.1.0 (was: 2.9.0) > [Umbrella] Capture per-application and per-queue container alloca

[jira] [Updated] (YARN-5852) Consolidate CSAssignment, ContainerAllocation, ContainerAllocationContext class in CapacityScheduler

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5852: -- Target Version/s: 3.1.0 (was: 2.9.0) > Consolidate CSAssignment, ContainerAllocation, ContainerAllocatio

[jira] [Updated] (YARN-5625) FairScheduler should use FSContext more aggressively to avoid constructors with many parameters

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5625: -- Target Version/s: 3.1.0 (was: 2.9.0) > FairScheduler should use FSContext more aggressively to avoid con

[jira] [Updated] (YARN-4638) Node whitelist support for AM launching

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4638: -- Target Version/s: 3.1.0 (was: 2.9.0) > Node whitelist support for AM launching > --

[jira] [Updated] (YARN-4495) add a way to tell AM container increase/decrease request is invalid

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4495: -- Target Version/s: 3.1.0 (was: 2.9.0) > add a way to tell AM container increase/decrease request is inval

[jira] [Updated] (YARN-4944) Handle lack of ResourceCalculatorPlugin gracefully

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4944: -- Target Version/s: 3.1.0 (was: 2.9.0) > Handle lack of ResourceCalculatorPlugin gracefully >

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5028: -- Target Version/s: 3.1.0 (was: 2.9.0) > RMStateStore should trim down app state for completed application

[jira] [Updated] (YARN-6429) Revisit implementation of LocalitySchedulingPlacementSet to avoid invoke methods of AppSchedulingInfo

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6429: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Revisit implementation of LocalitySchedulingPlacementSet t

[jira] [Updated] (YARN-4636) Make blacklist tracking policy pluggable for more extensions.

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4636: -- Target Version/s: 3.1.0 (was: 2.9.0) > Make blacklist tracking policy pluggable for more extensions. > -

[jira] [Updated] (YARN-2684) FairScheduler: When failing an application due to changes in queue config or placement policy, indicate the cause.

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2684: -- Target Version/s: 3.1.0 (was: 2.9.0) > FairScheduler: When failing an application due to changes in queu

[jira] [Updated] (YARN-6606) The implementation of LocalizationStatus in ContainerStatusProto

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6606: -- Target Version/s: 3.1.0 (was: 2.9.0) > The implementation of LocalizationStatus in ContainerStatusProto

[jira] [Updated] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2014: -- Target Version/s: 3.1.0 (was: 2.9.0) > Performance: AM scaleability is 10% slower in 2.4 compared to 0.2

[jira] [Updated] (YARN-5902) yarn.scheduler.increment-allocation-mb and yarn.scheduler.increment-allocation-vcores are undocumented in yarn-default.xml

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5902: -- Target Version/s: 3.1.0 (was: 2.9.0) > yarn.scheduler.increment-allocation-mb and > yarn.scheduler.incr

[jira] [Updated] (YARN-3813) Support Application timeout feature in YARN.

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3813: -- Target Version/s: 3.1.0 (was: 2.9.0) > Support Application timeout feature in YARN. > -

[jira] [Updated] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5193: -- Target Version/s: 3.1.0 (was: 2.9.0) > For long running services, aggregate logs when a container comple

[jira] [Updated] (YARN-5465) Server-Side NM Graceful Decommissioning subsequent call behavior

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5465: -- Target Version/s: 3.1.0 (was: 2.9.0) > Server-Side NM Graceful Decommissioning subsequent call behavior

[jira] [Updated] (YARN-2836) RM behaviour on token renewal failures is broken

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2836: -- Target Version/s: 3.1.0 (was: 2.9.0) > RM behaviour on token renewal failures is broken > --

[jira] [Updated] (YARN-5205) yarn logs for live applications does not provide log files which may have already been aggregated

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5205: -- Target Version/s: 3.1.0 (was: 2.9.0) > yarn logs for live applications does not provide log files which

[jira] [Updated] (YARN-4969) Fix more loggings in CapacityScheduler

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4969: -- Target Version/s: 3.1.0 (was: 2.9.0) > Fix more loggings in CapacityScheduler >

[jira] [Updated] (YARN-1946) need Public interface for WebAppUtils.getProxyHostAndPort

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-1946: -- Target Version/s: 3.1.0 (was: 2.9.0) > need Public interface for WebAppUtils.getProxyHostAndPort > -

[jira] [Updated] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2657: -- Target Version/s: 3.1.0 (was: 2.9.0) > MiniYARNCluster to (optionally) add MicroZookeeper service >

[jira] [Updated] (YARN-5516) Add REST API for periodicity

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5516: -- Target Version/s: 3.1.0 (was: 2.9.0) > Add REST API for periodicity > > >

[jira] [Updated] (YARN-4637) AM launching blacklist purge mechanism (time based)

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4637: -- Target Version/s: 3.1.0 (was: 2.9.0) > AM launching blacklist purge mechanism (time based) > ---

[jira] [Updated] (YARN-6088) RM UI has to redirect to AHS for completed applications logs

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6088: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > RM UI has to redirect to AHS for completed applications lo

[jira] [Updated] (YARN-5414) Integrate NodeQueueLoadMonitor with ClusterNodeTracker

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5414: -- Target Version/s: 3.1.0 (was: 2.9.0) > Integrate NodeQueueLoadMonitor with ClusterNodeTracker >

[jira] [Updated] (YARN-4758) Enable discovery of AMs by containers

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4758: -- Target Version/s: 3.1.0 (was: 2.9.0, MAPREDUCE-6608) > Enable discovery of AMs by containers > -

[jira] [Updated] (YARN-4946) RM should write out Aggregated Log Completion file flag next to logs

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4946: -- Target Version/s: 3.1.0 (was: 2.9.0) > RM should write out Aggregated Log Completion file flag next to l

[jira] [Updated] (YARN-867) Isolation of failures in aux services

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-867: - Target Version/s: 3.1.0 (was: 2.9.0) > Isolation of failures in aux services > ---

[jira] [Updated] (YARN-5536) Multiple format support (JSON, etc.) for exclude node file in NM graceful decommission with timeout

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5536: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Multiple format support (JSON, etc.) for exclude node file

[jira] [Updated] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5464: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Server-Side NM Graceful Decommissioning with RM HA > -

[jira] [Updated] (YARN-6486) FairScheduler: Deprecate continuous scheduling in 2.9

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6486: -- Target Version/s: 3.1.0 (was: 2.9.0) > FairScheduler: Deprecate continuous scheduling in 2.9 > -

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4599: -- Target Version/s: 3.1.0 (was: 2.9.0) > Set OOM control for memory cgroups >

[jira] [Updated] (YARN-6147) Blacklisting nodes not happening for AM containers

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6147: -- Target Version/s: 3.1.0 (was: 2.9.0) > Blacklisting nodes not happening for AM containers >

[jira] [Updated] (YARN-4713) Warning by unchecked conversion in TestTimelineWebServices

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4713: -- Target Version/s: 3.1.0 (was: 2.9.0) > Warning by unchecked conversion in TestTimelineWebServices > ---

[jira] [Updated] (YARN-6098) Add documentation for Delete Queue

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6098: -- Target Version/s: 3.1.0 (was: 2.9.0, 3.0.0) > Add documentation for Delete Queue > -

[jira] [Updated] (YARN-4808) SchedulerNode can use a few more cosmetic changes

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4808: -- Target Version/s: 3.1.0 (was: 2.9.0) > SchedulerNode can use a few more cosmetic changes > -

[jira] [Updated] (YARN-2024) IOException in AppLogAggregatorImpl does not give stacktrace and leaves aggregated TFile in a bad state.

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2024: -- Target Version/s: 3.1.0 (was: 2.9.0) > IOException in AppLogAggregatorImpl does not give stacktrace and

[jira] [Updated] (YARN-4804) [Umbrella] Improve test run duration

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4804: -- Target Version/s: 3.1.0 (was: 2.9.0) > [Umbrella] Improve test run duration > --

[jira] [Resolved] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5447. --- Resolution: Won't Fix Today, this is a problem even when a user does not specify an allocate required

[jira] [Updated] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5329: -- Priority: Blocker (was: Major) > ReservationAgent enhancements required to support recurring reservation

[jira] [Updated] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4827: -- Target Version/s: 2.9.0, 3.0.0 > Document configuration of ReservationSystem for FairScheduler >

[jira] [Updated] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4827: -- Priority: Blocker (was: Minor) > Document configuration of ReservationSystem for FairScheduler > ---

[jira] [Updated] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4859: -- Target Version/s: 2.9.0, 3.0.0 > [Bug] Unable to submit a job to a reservation when using FairScheduler >

[jira] [Updated] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4859: -- Priority: Blocker (was: Major) > [Bug] Unable to submit a job to a reservation when using FairScheduler

[jira] [Updated] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5329: -- Target Version/s: 2.9.0, 3.1.0 (was: 2.9.0) > ReservationAgent enhancements required to support recurrin

[jira] [Resolved] (YARN-5861) Add support for recovery of queued opportunistic containers in the NM.

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5861. --- Resolution: Duplicate > Add support for recovery of queued opportunistic containers in the NM. > --

[jira] [Resolved] (YARN-5860) Add support for increase and decrease of container resources to NM Container Queuing

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5860. --- Resolution: Implemented Fix Version/s: 3.0.0 2.9.0 > Add support for increase

[jira] [Created] (YARN-7275) NM Statestore cleanup for Container updates

2017-09-29 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7275: - Summary: NM Statestore cleanup for Container updates Key: YARN-7275 URL: https://issues.apache.org/jira/browse/YARN-7275 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7178) Add documentation for Container Update API

2017-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7178: -- Target Version/s: 2.9.0, 3.0.0 Priority: Blocker (was: Major) > Add documentation for Contai

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185250#comment-16185250 ] Arun Suresh commented on YARN-7248: --- Thanks for the review and commit [~jlowe]. > NM ret

[jira] [Commented] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-09-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184631#comment-16184631 ] Arun Suresh commented on YARN-6691: --- committed to branch-2. Thanks [~giovanni.fumarola]

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184618#comment-16184618 ] Arun Suresh commented on YARN-7248: --- [~jlowe], do you think the latest patch is fine ? Th

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184617#comment-16184617 ] Arun Suresh commented on YARN-7248: --- Ok, pushed to the required patches to branch-3.0, gi

[jira] [Assigned] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-09-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7258: - Assignee: Arun Suresh (was: kartheek muthyala) > Add Node and Rack Hints to Opportunistic Schedul

<    2   3   4   5   6   7   8   9   10   11   >