[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531869#comment-14531869 ] Vinod Kumar Vavilapalli commented on YARN-1983: --- Whatever the approach, we ne

[jira] [Assigned] (YARN-3587) Fix the javadoc of DelegationTokenSecretManager in yarn project

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-3587: - Assignee: Gabor Liptak Assigning to [~gliptak] who put up a patch.. > Fix

[jira] [Updated] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3469: -- Fix Version/s: (was: 2.8.0) 2.7.1 Pulled this into 2.7 and

[jira] [Commented] (YARN-3385) Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion.

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531799#comment-14531799 ] Vinod Kumar Vavilapalli commented on YARN-3385: --- yup, +1, checking this in..

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531614#comment-14531614 ] Vinod Kumar Vavilapalli commented on YARN-3362: --- Can you please post the late

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531602#comment-14531602 ] Vinod Kumar Vavilapalli commented on YARN-3539: --- We use the phrase Timeline S

[jira] [Commented] (YARN-3549) use JNI-based FileStatus implementation from io.nativeio.NativeIO.POSIX#getFstat instead of shell-based implementation from RawLocalFileSystem in checkLocalDir.

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531590#comment-14531590 ] Vinod Kumar Vavilapalli commented on YARN-3549: --- Can we not get RawLocalFileS

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531557#comment-14531557 ] Vinod Kumar Vavilapalli commented on YARN-3491: --- [~zxu], interesting JIRA and

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531390#comment-14531390 ] Vinod Kumar Vavilapalli commented on YARN-3051: --- bq. Queries based on relatio

[jira] [Updated] (YARN-745) Move UnmanagedAMLauncher to yarn client package

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-745: - Component/s: applications/unmanaged-AM-launcher > Move UnmanagedAMLauncher to yarn c

[jira] [Updated] (YARN-2892) Unable to get AMRMToken in unmanaged AM when using a secure cluster

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2892: -- Component/s: applications/unmanaged-AM-launcher Target Version/s: 2.8.0

[jira] [Updated] (YARN-252) Unmanaged AMs should not have to set the AM's ContainerLaunchContext

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-252: - Component/s: (was: applications) applications/unmanaged-AM-launc

[jira] [Updated] (YARN-937) Fix unmanaged AM in non-secure/secure setup post YARN-701

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-937: - Component/s: applications/unmanaged-AM-launcher > Fix unmanaged AM in non-secure/sec

[jira] [Resolved] (YARN-255) Support secure AM launch for unmanaged AM's

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-255. -- Resolution: Duplicate The only tokens needed by the AM from the RM via the launch

[jira] [Updated] (YARN-255) Support secure AM launch for unmanaged AM's

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-255: - Component/s: applications/unmanaged-AM-launcher > Support secure AM launch for unman

[jira] [Updated] (YARN-419) Add client side for Unmanaged-AMs

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-419: - Component/s: applications/unmanaged-AM-launcher Fix Version/s: 2.0.2-alpha Set

[jira] [Updated] (YARN-420) Enable the RM to work with AM's that are not managed by it

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-420: - Component/s: applications/unmanaged-AM-launcher > Enable the RM to work with AM's th

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531225#comment-14531225 ] Vinod Kumar Vavilapalli commented on YARN-3547: --- [~leftnoteasy] / [~xinxianyi

[jira] [Commented] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531213#comment-14531213 ] Vinod Kumar Vavilapalli commented on YARN-3554: --- I am good with either. I thi

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531177#comment-14531177 ] Vinod Kumar Vavilapalli commented on YARN-2619: --- I pinged Wei [above|https:/

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531043#comment-14531043 ] Vinod Kumar Vavilapalli commented on YARN-3051: --- Can we please fork the uniqu

[jira] [Commented] (YARN-3521) Support return structured NodeLabel objects in REST API when call getClusterNodeLabels

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530999#comment-14530999 ] Vinod Kumar Vavilapalli commented on YARN-3521: --- bq. I'm fine with dropping N

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530915#comment-14530915 ] Vinod Kumar Vavilapalli commented on YARN-1680: --- bq. Further, it seems to me

[jira] [Commented] (YARN-2139) [Umbrella] Support for Disk as a Resource in YARN

2015-05-06 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14530887#comment-14530887 ] Vinod Kumar Vavilapalli commented on YARN-2139: --- YARN-2619 already covered so

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529655#comment-14529655 ] Vinod Kumar Vavilapalli commented on YARN-1680: --- YARN-3215 is the JIRA tracki

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529616#comment-14529616 ] Vinod Kumar Vavilapalli commented on YARN-2618: --- Okay, makes sense. Let's get

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529603#comment-14529603 ] Vinod Kumar Vavilapalli commented on YARN-1680: --- When I said node-labels abov

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529600#comment-14529600 ] Vinod Kumar Vavilapalli commented on YARN-1680: --- Please leave out the head-ro

[jira] [Commented] (YARN-2369) Environment variable handling assumes values should be appended

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529217#comment-14529217 ] Vinod Kumar Vavilapalli commented on YARN-2369: --- Yes, we can simply have a co

[jira] [Commented] (YARN-3385) Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion.

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529155#comment-14529155 ] Vinod Kumar Vavilapalli commented on YARN-3385: --- Actually, there is a checkst

[jira] [Commented] (YARN-3385) Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion.

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529127#comment-14529127 ] Vinod Kumar Vavilapalli commented on YARN-3385: --- This looks good, +1. Checkin

[jira] [Assigned] (YARN-3526) ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-3526: - Assignee: Yang Weiwei [~cheersyang], assigning this to you. Please conside

[jira] [Commented] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529030#comment-14529030 ] Vinod Kumar Vavilapalli commented on YARN-3561: --- bq. Could this be OS specifi

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2015-05-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529019#comment-14529019 ] Vinod Kumar Vavilapalli commented on YARN-2681: --- Totally missed this, YARN-33

[jira] [Commented] (YARN-3523) Cleanup ResourceManagerAdministrationProtocol interface audience

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527705#comment-14527705 ] Vinod Kumar Vavilapalli commented on YARN-3523: --- Makes sense. > Cleanup Reso

[jira] [Commented] (YARN-3514) Active directory usernames like domain\login cause YARN failures

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527702#comment-14527702 ] Vinod Kumar Vavilapalli commented on YARN-3514: --- I also doubt if this (the fi

[jira] [Commented] (YARN-3523) Cleanup ResourceManagerAdministrationProtocol interface audience

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527483#comment-14527483 ] Vinod Kumar Vavilapalli commented on YARN-3523: --- Doesn't matter much for priv

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527480#comment-14527480 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- With those comments out of t

[jira] [Commented] (YARN-3513) Remove unused variables in ContainersMonitorImpl

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527317#comment-14527317 ] Vinod Kumar Vavilapalli commented on YARN-3513: --- bq. This may be fine in trun

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527299#comment-14527299 ] Vinod Kumar Vavilapalli commented on YARN-2962: --- Thinking more, the new RM mo

[jira] [Commented] (YARN-964) Give a parameter that can set AM retry interval

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527157#comment-14527157 ] Vinod Kumar Vavilapalli commented on YARN-964: -- bq. The right solution is not a

[jira] [Commented] (YARN-3518) default rm/am expire interval should not less than default resourcemanager connect wait time

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527100#comment-14527100 ] Vinod Kumar Vavilapalli commented on YARN-3518: --- We need to be careful here.

[jira] [Updated] (YARN-3518) default rm/am expire interval should not less than default resourcemanager connect wait time

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3518: -- Assignee: sandflee > default rm/am expire interval should not less than default r

[jira] [Commented] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527087#comment-14527087 ] Vinod Kumar Vavilapalli commented on YARN-3554: --- bq. Are there still objectio

[jira] [Commented] (YARN-3554) Default value for maximum nodemanager connect wait time is too high

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527072#comment-14527072 ] Vinod Kumar Vavilapalli commented on YARN-3554: --- HADOOP-11398 and YARN-3238 r

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527035#comment-14527035 ] Vinod Kumar Vavilapalli commented on YARN-2618: --- Okay, quickly scanned. Seems

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2015-05-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527020#comment-14527020 ] Vinod Kumar Vavilapalli commented on YARN-2618: --- Haven't looked at this so fa

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-05-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526130#comment-14526130 ] Vinod Kumar Vavilapalli commented on YARN-2962: --- bq. it will indeed be backwa

[jira] [Commented] (YARN-3375) NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner

2015-05-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526125#comment-14526125 ] Vinod Kumar Vavilapalli commented on YARN-3375: --- [~leftnoteasy], please do th

[jira] [Commented] (YARN-3565) NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String

2015-05-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526092#comment-14526092 ] Vinod Kumar Vavilapalli commented on YARN-3565: --- You can leave the REST APIs

[jira] [Commented] (YARN-3523) Cleanup ResourceManagerAdministrationProtocol interface audience

2015-05-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526015#comment-14526015 ] Vinod Kumar Vavilapalli commented on YARN-3523: --- bq. Actually I'm not sure ab

[jira] [Updated] (YARN-3523) Cleanup ResourceManagerAdministrationProtocol interface audience

2015-05-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3523: -- Target Version/s: 2.8.0 Fix Version/s: (was: 2.8.0) [~Naganarasimha],

[jira] [Resolved] (YARN-128) [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-128. -- Resolution: Fixed Resolving this umbrella JIRA. RM recovery has largely been nearl

[jira] [Updated] (YARN-128) [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recovery

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-128: - Summary: [Umbrella] RM Restart Phase 1: State storage and non-work-preserving recove

[jira] [Resolved] (YARN-543) [Umbrella] NodeManager localization related issues

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-543. -- Resolution: Fixed Resolving this very old umbrella JIRA. Most of the originally id

[jira] [Commented] (YARN-526) [Umbrella] Improve test coverage in YARN

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525607#comment-14525607 ] Vinod Kumar Vavilapalli commented on YARN-526: -- And no fix-versions as sub-task

[jira] [Resolved] (YARN-526) [Umbrella] Improve test coverage in YARN

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-526. -- Resolution: Fixed Assignee: Andrey Klochkov Assigning the umbrella also to [

[jira] [Resolved] (YARN-501) Application Master getting killed randomly reporting excess usage of memory

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-501. -- Resolution: Not A Problem Haven't gotten a response on my last comment in a while.

[jira] [Resolved] (YARN-492) Too many open files error to launch a container

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-492. -- Resolution: Won't Fix Agree with analysis from [~hitesh] and [~revans2]. Resolving

[jira] [Resolved] (YARN-156) WebAppProxyServlet does not support http methods other than GET

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-156. -- Resolution: Duplicate Seems like there is more movement on this issue at YARN-2031

[jira] [Commented] (YARN-149) [Umbrella] ResourceManager (RM) Fail-over

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14525595#comment-14525595 ] Vinod Kumar Vavilapalli commented on YARN-149: -- And tx to [~kasha] and [~xgong]

[jira] [Resolved] (YARN-149) [Umbrella] ResourceManager (RM) Fail-over

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-149. -- Resolution: Fixed Resolving this umbrella JIRA. RM failover has largely been compl

[jira] [Updated] (YARN-149) [Umbrella] ResourceManager (RM) Fail-over

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-149: - Summary: [Umbrella] ResourceManager (RM) Fail-over (was: ResourceManager (RM) High-

[jira] [Resolved] (YARN-148) CapacityScheduler shouldn't explicitly need YarnConfiguration

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-148. -- Resolution: Invalid I don't see this issue anymore, seems like it got resolved alo

[jira] [Resolved] (YARN-100) container-executor should deal with stdout, stderr better

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-100. -- Resolution: Later LOGFILE and ERRORFILE were always this way, and it has worked ou

[jira] [Updated] (YARN-3513) Remove unused variables in ContainersMonitorImpl

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3513: -- Fix Version/s: (was: 2.8.0) Removing fix-version, use the target-version fiel

[jira] [Resolved] (YARN-47) [Umbrella] Security issues in YARN

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
ARN > -- > > Key: YARN-47 > URL: https://issues.apache.org/jira/browse/YARN-47 > Project: Hadoop YARN > Issue Type: Bug > Reporter: Vinod Kumar Vavilapalli > > JIRA tracking YARN related security issues.

[jira] [Updated] (YARN-47) [Umbrella] Security issues in YARN

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
/browse/YARN-47 > Project: Hadoop YARN > Issue Type: Bug > Reporter: Vinod Kumar Vavilapalli > > JIRA tracking YARN related security issues. > Moving over YARN only stuff from MAPREDUCE-3101. -- This message was sent by Atlassian JIRA (v6.3.4#6332)

[jira] [Resolved] (YARN-59) "Text File Busy" errors launching MR tasks

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-59. - Resolution: Duplicate >From what I know, this is fixed via YARN-1271 + YARN-1295. Res

[jira] [Resolved] (YARN-556) [Umbrella] RM Restart phase 2 - Work preserving restart

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-556. -- Resolution: Fixed Assignee: (was: Bikas Saha) Makes sense. Resolved as f

[jira] [Updated] (YARN-556) [Umbrella] RM Restart phase 2 - Work preserving restart

2015-05-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-556: - Summary: [Umbrella] RM Restart phase 2 - Work preserving restart (was: RM Restart p

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2015-05-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523921#comment-14523921 ] Vinod Kumar Vavilapalli commented on YARN-160: -- bq. Junping felt we should add

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522790#comment-14522790 ] Vinod Kumar Vavilapalli commented on YARN-3044: --- Apologies for dropping off t

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522779#comment-14522779 ] Vinod Kumar Vavilapalli commented on YARN-2942: --- That will definitely simplif

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522774#comment-14522774 ] Vinod Kumar Vavilapalli commented on YARN-3332: --- Unfortunately, other pieces

[jira] [Commented] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522768#comment-14522768 ] Vinod Kumar Vavilapalli commented on YARN-3534: --- Converting this to be a sub-

[jira] [Updated] (YARN-3534) Collect node resource utilization

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3534: -- Issue Type: Sub-task (was: New Feature) Parent: YARN-1011 > Collect node

[jira] [Updated] (YARN-1012) NM should report resource utilization of running containers to RM in heartbeat

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1012: -- Assignee: Inigo Goiri (was: Vinod Kumar Vavilapalli) YARN-3481 is closed as dup

[jira] [Resolved] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-3481. --- Resolution: Duplicate > Report NM aggregated container resource utilization in

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522766#comment-14522766 ] Vinod Kumar Vavilapalli commented on YARN-3481: --- bq. Vinod Kumar Vavilapalli,

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522754#comment-14522754 ] Vinod Kumar Vavilapalli commented on YARN-2619: --- Looks good to me too, +1. Ch

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522060#comment-14522060 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- bq. Jian He, can you file a

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522058#comment-14522058 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- bq. I agree. This shouldn't

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-04-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522008#comment-14522008 ] Vinod Kumar Vavilapalli commented on YARN-3243: --- bq. Wangda Tan Can we pull t

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520929#comment-14520929 ] Vinod Kumar Vavilapalli commented on YARN-3045: --- bq. IIUC from discussions in

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520843#comment-14520843 ] Vinod Kumar Vavilapalli commented on YARN-3045: --- The allocated memory/vcore/h

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520829#comment-14520829 ] Vinod Kumar Vavilapalli commented on YARN-3534: --- Please see my comment [on Y

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520825#comment-14520825 ] Vinod Kumar Vavilapalli commented on YARN-3481: --- Sorry, didn't realize before

[jira] [Commented] (YARN-3445) Cache runningApps in RMNode for getting running apps on given NodeId

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520396#comment-14520396 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- There is a too much of dupli

[jira] [Assigned] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-3517: - Assignee: Varun Vasudev (was: Thomas Graves) Seems like the JIRA assignee

[jira] [Commented] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520328#comment-14520328 ] Vinod Kumar Vavilapalli commented on YARN-3477: --- This looks good to me. [~zjs

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520319#comment-14520319 ] Vinod Kumar Vavilapalli commented on YARN-3539: --- In a way, I am saying that t

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520312#comment-14520312 ] Vinod Kumar Vavilapalli commented on YARN-3539: --- bq. So I'm not sure if it's

[jira] [Reopened] (YARN-1876) Document the REST APIs of timeline and generic history services

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reopened YARN-1876: --- > Document the REST APIs of timeline and generic history services > ---

[jira] [Resolved] (YARN-1876) Document the REST APIs of timeline and generic history services

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-1876. --- Resolution: Duplicate Duplicate is the right resolution. > Document the REST A

[jira] [Updated] (YARN-1317) Make Queue, QueueACLs and QueueMetrics first class citizens in YARN

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1317: -- Target Version/s: 2.8.0 (was: ) I'd like to at the least get some of this done i

[jira] [Commented] (YARN-2868) FairScheduler: Metric for latency to allocate first container for an application

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520196#comment-14520196 ] Vinod Kumar Vavilapalli commented on YARN-2868: --- Going through old tickets. I

[jira] [Commented] (YARN-3561) Non-AM Containers continue to run even after AM is stopped

2015-04-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14519848#comment-14519848 ] Vinod Kumar Vavilapalli commented on YARN-3561: --- Is this because the keep-con

[jira] [Commented] (YARN-2942) Aggregated Log Files should be combined

2015-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518576#comment-14518576 ] Vinod Kumar Vavilapalli commented on YARN-2942: --- Tx for the updated docs, [~r

[jira] [Commented] (YARN-2619) NodeManager: Add cgroups support for disk I/O isolation

2015-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14518551#comment-14518551 ] Vinod Kumar Vavilapalli commented on YARN-2619: --- A very clean patch! This is

<    5   6   7   8   9   10   11   12   13   14   >