[jira] [Commented] (YARN-3249) Add the kill application to the Resource Manager Web UI

2015-03-03 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344707#comment-14344707 ] Tsuyoshi Ozawa commented on YARN-3249: -- One more minor comment about indentation:

[jira] [Updated] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-03-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3248: Attachment: App page.png All applications.png Uploaded screen shots from the latest

[jira] [Commented] (YARN-3265) CapacityScheduler deadlock when computing absolute max avail capacity (fix for trunk/branch-2)

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345211#comment-14345211 ] Hudson commented on YARN-3265: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2071 (See

[jira] [Commented] (YARN-3281) Add RMStateStore to StateMachine visualization list

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345213#comment-14345213 ] Hudson commented on YARN-3281: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2071 (See

[jira] [Commented] (YARN-3270) node label expression not getting set in ApplicationSubmissionContext

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345207#comment-14345207 ] Hudson commented on YARN-3270: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2071 (See

[jira] [Updated] (YARN-1963) Support priorities across applications within the same queue

2015-03-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-1963: -- Attachment: 0001-YARN-1963-prototype.patch Uploading a prototype version based on configuration file.

[jira] [Commented] (YARN-3265) CapacityScheduler deadlock when computing absolute max avail capacity (fix for trunk/branch-2)

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345180#comment-14345180 ] Hudson commented on YARN-3265: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #121 (See

[jira] [Commented] (YARN-3270) node label expression not getting set in ApplicationSubmissionContext

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345176#comment-14345176 ] Hudson commented on YARN-3270: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #121 (See

[jira] [Commented] (YARN-3281) Add RMStateStore to StateMachine visualization list

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345182#comment-14345182 ] Hudson commented on YARN-3281: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #121 (See

[jira] [Created] (YARN-3286) RMNode#totalCapability has stale capability after NM is reconnected.

2015-03-03 Thread Rohith (JIRA)
Rohith created YARN-3286: Summary: RMNode#totalCapability has stale capability after NM is reconnected. Key: YARN-3286 URL: https://issues.apache.org/jira/browse/YARN-3286 Project: Hadoop YARN

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344802#comment-14344802 ] Rohith commented on YARN-3222: -- Kindly review the update patch that fixes 1 2 in as mentioned

[jira] [Updated] (YARN-3286) RMNode#totalCapability has stale capability after NM is reconnected.

2015-03-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3286: - Attachment: YARN-3286-test-only.patch Attached test patch that simulate the issue. RMNode#totalCapability has

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-03-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345321#comment-14345321 ] Vrushali C commented on YARN-3031: -- Yes, we've decided to have only a write and aggregate

[jira] [Commented] (YARN-3275) CapacityScheduler: Preemption happening on non-preemptable queues

2015-03-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345290#comment-14345290 ] Jason Lowe commented on YARN-3275: -- Thanks for the patch, Eric! bq. the expectation of

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-03 Thread Prakash Ramachandran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345366#comment-14345366 ] Prakash Ramachandran commented on YARN-3267: [~lichangleo] I am not very

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-03-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345345#comment-14345345 ] Junping Du commented on YARN-3031: -- Hi [~vrushalic], Awesome! I will help to review this

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN_3267_WIP2.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Commented] (YARN-3168) Convert site documentation from apt to markdown

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345577#comment-14345577 ] Jian He commented on YARN-3168: --- thanks [~iwasakims] ! I'll do the review and commit.

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-03-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345649#comment-14345649 ] Varun Saxena commented on YARN-2962: [~kasha] / [~jianhe] / [~ozawa], kindly review

[jira] [Created] (YARN-3289) Docker images should be downloaded during localization

2015-03-03 Thread Ravi Prakash (JIRA)
Ravi Prakash created YARN-3289: -- Summary: Docker images should be downloaded during localization Key: YARN-3289 URL: https://issues.apache.org/jira/browse/YARN-3289 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3289) Docker images should be downloaded during localization

2015-03-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345578#comment-14345578 ] Jason Lowe commented on YARN-3289: -- There is no application-level (e.g.: MapReduce) task

[jira] [Commented] (YARN-3285) Convert branch-2 .apt.vm files of YARN to markdown

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345607#comment-14345607 ] Jian He commented on YARN-3285: --- some comments which may be applicable to trunk too, we may

[jira] [Created] (YARN-3288) Document and fix indentation in the DockerContainerExecutor code

2015-03-03 Thread Ravi Prakash (JIRA)
Ravi Prakash created YARN-3288: -- Summary: Document and fix indentation in the DockerContainerExecutor code Key: YARN-3288 URL: https://issues.apache.org/jira/browse/YARN-3288 Project: Hadoop YARN

[jira] [Updated] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-03 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated YARN-2190: Attachment: YARN-2190.9.patch Attach a new patch that adds the following two new options for the new Windows

[jira] [Commented] (YARN-3272) Surface container locality info

2015-03-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345424#comment-14345424 ] Wangda Tan commented on YARN-3272: -- LGTM, +1 will commit today if no opposite opinions.

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345513#comment-14345513 ] Jian He commented on YARN-3222: --- thanks Rohith ! I think the condition check you added

[jira] [Created] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-03 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created YARN-3287: - Summary: TimelineClient kerberos authentication failure uses wrong login context. Key: YARN-3287 URL: https://issues.apache.org/jira/browse/YARN-3287 Project:

[jira] [Commented] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-03 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345406#comment-14345406 ] Ravi Prakash commented on YARN-2981: Hi Abin! The patch doesn't apply because

[jira] [Resolved] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3210. --- Resolution: Fixed Fix Version/s: YARN-2928 Hadoop Flags: Reviewed Committed the patch to

[jira] [Updated] (YARN-3272) Surface container locality info in RM web UI

2015-03-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3272: - Summary: Surface container locality info in RM web UI (was: Surface container locality info ) Surface

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345658#comment-14345658 ] zhihai xu commented on YARN-3242: - [~adhoot], thanks for the review, both suggestions are

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345747#comment-14345747 ] zhihai xu commented on YARN-2893: - I find there is another possibility which can also cause

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-03 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch Fixed docs. DockerContainerExecutor must support a Cluster-wide default

[jira] [Commented] (YARN-2380) The normalizeRequests method in SchedulerUtils always resets the vCore to 1

2015-03-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345776#comment-14345776 ] Wangda Tan commented on YARN-2380: -- [~kj-ki], Thought about it, similar problems existed

[jira] [Commented] (YARN-3285) Convert branch-2 .apt.vm files of YARN to markdown

2015-03-03 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345821#comment-14345821 ] Masatake Iwasaki commented on YARN-3285: Thanks, [~jianhe]. I agree to keep focus

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345878#comment-14345878 ] Robert Kanter commented on YARN-2423: - Even if ATS v2 makes it for 2.8, I imagine it

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: YARN-3242.004.patch Old ZK client session watcher event causes ZKRMStateStore out of sync with

[jira] [Commented] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345734#comment-14345734 ] Hadoop QA commented on YARN-2190: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345852#comment-14345852 ] Anubhav Dhoot commented on YARN-3242: - LGTM Old ZK client session watcher event

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345836#comment-14345836 ] Hitesh Shah commented on YARN-2423: --- [~kasha] [~vinodkv] Will this api be backported all

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: YARN-3242.004.patch Old ZK client session watcher event causes ZKRMStateStore out of sync with

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345774#comment-14345774 ] Karthik Kambatla commented on YARN-2423: I propose we get this in. I understand

[jira] [Updated] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-03 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated YARN-2190: Attachment: YARN-2190.10.patch bq. -1 patch. The patch command could not apply the patch. Not sure why it

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345755#comment-14345755 ] Jian He commented on YARN-3021: --- bq. Overall I think automatic token renewal has always been

[jira] [Created] (YARN-3291) DockerContainerExecutor should run as a non-root user

2015-03-03 Thread Abin Shahab (JIRA)
Abin Shahab created YARN-3291: - Summary: DockerContainerExecutor should run as a non-root user Key: YARN-3291 URL: https://issues.apache.org/jira/browse/YARN-3291 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345847#comment-14345847 ] Hadoop QA commented on YARN-3242: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: (was: YARN-3242.004.patch) Old ZK client session watcher event causes ZKRMStateStore out of

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-03 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch Removed as [~raviprak] suggested. DockerContainerExecutor must support a

[jira] [Commented] (YARN-3272) Surface container locality info in RM web UI

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345737#comment-14345737 ] Hudson commented on YARN-3272: -- FAILURE: Integrated in Hadoop-trunk-Commit #7246 (See

[jira] [Created] (YARN-3290) DockerContainerExecutor should optionally limit memory and cpu

2015-03-03 Thread Abin Shahab (JIRA)
Abin Shahab created YARN-3290: - Summary: DockerContainerExecutor should optionally limit memory and cpu Key: YARN-3290 URL: https://issues.apache.org/jira/browse/YARN-3290 Project: Hadoop YARN

[jira] [Commented] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345798#comment-14345798 ] Hadoop QA commented on YARN-2981: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2015-03-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-796: Attachment: Non-exclusive-Node-Partition-Design.pdf Attached same design doc for YARN-3214 (Non-exclusive

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345828#comment-14345828 ] Zhijie Shen commented on YARN-2423: --- It seems that Spark wants the stable APIs. But we

[jira] [Updated] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-03 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-2981: -- Attachment: YARN-2981.patch Another fix DockerContainerExecutor must support a Cluster-wide default

[jira] [Commented] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345858#comment-14345858 ] Hadoop QA commented on YARN-2190: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3264) [Storage implementation] Create a POC only file based storage implementation for ATS writes

2015-03-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346477#comment-14346477 ] Robert Kanter commented on YARN-3264: - In addition to the things Zhijie said, 11. It

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-03-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345998#comment-14345998 ] Vinod Kumar Vavilapalli commented on YARN-2893: --- Great progress, [~zxu]! Your

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346175#comment-14346175 ] zhihai xu commented on YARN-2893: - Hi [~vinodkv], Sporadic job failures are due to the

[jira] [Updated] (YARN-3264) [Storage implementation] Create a POC only file based storage implementation for ATS writes

2015-03-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3264: - Attachment: YARN-3264.001.patch Uploading a patch that contains a FileSystem based backend storage

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-03-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346202#comment-14346202 ] Vrushali C commented on YARN-3031: -- The writer interface is being added in the patch in

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346474#comment-14346474 ] Rohith commented on YARN-3242: -- Are the test failures are related? Old ZK client session

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-03-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346492#comment-14346492 ] Varun Saxena commented on YARN-2962: Suggest a better config name ? Also currently

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346497#comment-14346497 ] zhihai xu commented on YARN-3242: - All these test failures are not related to my changes,

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346568#comment-14346568 ] Jian He commented on YARN-3021: --- bq. it'll skip all tokens the application provides, even

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346469#comment-14346469 ] Rohith commented on YARN-3242: -- Thanks for detailed explanation. I was able to reproduce this

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346567#comment-14346567 ] Jian He commented on YARN-3021: --- bq. have MR client specify the token renewer it needs to use

Hadoop:Runing jobs stuck even resources are available on nodes

2015-03-03 Thread Ravi Kumar
Hi We are running some test cases in parallel using maven fail-safe plugin. Most of the test cases submit MR/TEZ/oozie/hive jobs. After some time test cases are getting stuck. When checked the job tracker, we noticed that there are some jobs stuck in RUNNING state and some jobs SUBMITED but

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-03-03 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345950#comment-14345950 ] Gera Shegalov commented on YARN-2893: - Hi [~zxu], it's great that you make progress on

[jira] [Created] (YARN-3292) [Umbrella] Tests and/or tools for YARN backwards compatibility verification

2015-03-03 Thread Li Lu (JIRA)
Li Lu created YARN-3292: --- Summary: [Umbrella] Tests and/or tools for YARN backwards compatibility verification Key: YARN-3292 URL: https://issues.apache.org/jira/browse/YARN-3292 Project: Hadoop YARN

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346048#comment-14346048 ] Hadoop QA commented on YARN-3242: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3249) Add the kill application to the Resource Manager Web UI

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346080#comment-14346080 ] Jian He commented on YARN-3249: --- Also, I think it's ok to enable this by default, assuming

[jira] [Commented] (YARN-1876) Document the REST APIs of timeline and generic history services

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346110#comment-14346110 ] Jian He commented on YARN-1876: --- this won't apply too after the the doc converted to

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345976#comment-14345976 ] Marcelo Vanzin commented on YARN-2423: -- We'd rather not depend on unstable APIs. But

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346069#comment-14346069 ] Jian He commented on YARN-3222: --- thanks ! committing RMNodeImpl#ReconnectNodeTransition

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346182#comment-14346182 ] Yongjun Zhang commented on YARN-3021: - Hi [~jianhe], Thanks a lot for your comments.

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345887#comment-14345887 ] Karthik Kambatla commented on YARN-2423: [~hitesh] - in my optimistic opinion,

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-03-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345966#comment-14345966 ] zhihai xu commented on YARN-2893: - Hi [~jira.shegalov], That is a very good suggestion.

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345987#comment-14345987 ] Hadoop QA commented on YARN-3222: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3292) [Umbrella] Tests and/or tools for YARN backwards compatibility verification

2015-03-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346062#comment-14346062 ] Vinod Kumar Vavilapalli commented on YARN-3292: --- +1, this will be super

[jira] [Updated] (YARN-3292) [Umbrella] Tests/documentation and/or tools for YARN rolling upgrades backwards/forward compatibility verification

2015-03-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3292: -- Summary: [Umbrella] Tests/documentation and/or tools for YARN rolling upgrades

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150303-1-trunk.patch Rebased patch against trunk, and mark direct-access option

[jira] [Resolved] (YARN-3285) Convert branch-2 .apt.vm files of YARN to markdown

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-3285. --- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Committed to branch-2, thanks

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2015-03-03 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346006#comment-14346006 ] Anubhav Dhoot commented on YARN-3122: - Those changes look good for me. For a sample

[jira] [Commented] (YARN-3249) Add the kill application to the Resource Manager Web UI

2015-03-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346058#comment-14346058 ] Jian He commented on YARN-3249: --- [~ryu_kobayashi], thanks for your work ! here, can this be

[jira] [Commented] (YARN-3116) [Aggregator wireup] We need an assured way to determine if a container is an AM container on NM

2015-03-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346152#comment-14346152 ] Naganarasimha G R commented on YARN-3116: - Hi [~djp], +1, Approach seems to be fine

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-03 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702312/YARN-2786-20150303-1-trunk.patch against trunk revision 5af693f. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch

[jira] [Updated] (YARN-3204) Fix new findbug warnings in hadoop-yarn-server-resourcemanager(resourcemanager.scheduler.fair)

2015-03-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3204: -- Description: Please check following findbug report..

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345890#comment-14345890 ] Karthik Kambatla commented on YARN-2423: I am open to including this in point

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-03 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345909#comment-14345909 ] Rohith commented on YARN-3222: -- bq. check you added earlier about sending NodeResourceUpdate

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN_3267_WIP3.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Commented] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345925#comment-14345925 ] Hadoop QA commented on YARN-2981: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345963#comment-14345963 ] Vinod Kumar Vavilapalli commented on YARN-2423: --- bq. Zhijie's suggestion of

[jira] [Commented] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-03 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14345996#comment-14345996 ] Chuan Liu commented on YARN-2190: - bq. -1 patch. The patch command could not apply the

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-03-03 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1809: Attachment: YARN-1809.15-rebase.patch rebase the patch Synchronize RM and Generic History Service Web-UIs

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346104#comment-14346104 ] Hudson commented on YARN-3222: -- FAILURE: Integrated in Hadoop-trunk-Commit #7248 (See

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346181#comment-14346181 ] Hadoop QA commented on YARN-3267: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3264) [Storage implementation] Create a POC only file based storage implementation for ATS writes

2015-03-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346212#comment-14346212 ] Hadoop QA commented on YARN-3264: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-03-03 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346226#comment-14346226 ] Gera Shegalov commented on YARN-2893: - bq. Also I find out a cascading patch to fix the

[jira] [Commented] (YARN-3282) DockerContainerExecutor should support environment variables setting

2015-03-03 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346315#comment-14346315 ] Leitao Guo commented on YARN-3282: -- Hi [~ashahab], thanks for your comments. I agree

[jira] [Commented] (YARN-3264) [Storage implementation] Create a POC only file based storage implementation for ATS writes

2015-03-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346336#comment-14346336 ] Vrushali C commented on YARN-3264: -- [~zjshen] Sure, we can use any name (or any more

  1   2   >