[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347045#comment-14347045 ] Sunil G commented on YARN-3136: --- HI [~jlowe] and [~jianhe] Could u please take a look on the

[jira] [Assigned] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-3039: Assignee: Junping Du (was: Naganarasimha G R) [Aggregator wireup] Implement ATS app-appgregator

[jira] [Commented] (YARN-3272) Surface container locality info in RM web UI

2015-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347035#comment-14347035 ] Hudson commented on YARN-3272: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2072 (See

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347037#comment-14347037 ] Hudson commented on YARN-3222: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2072 (See

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: 0004-YARN-3136.patch getTransferredContainers can be a bottleneck during AM registration

[jira] [Assigned] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3039: --- Assignee: Naganarasimha G R (was: Junping Du) [Aggregator wireup] Implement ATS

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347053#comment-14347053 ] Naganarasimha G R commented on YARN-3039: - Hi [~djp], bq. for security reason it

[jira] [Updated] (YARN-2854) The document about timeline service and generic service needs to be updated

2015-03-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2854: Attachment: YARN-2854.20150304.1.patch Thanks [~gururaj] for helping me to convert the doc

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: (was: YARN-3242.004.patch) Old ZK client session watcher event causes ZKRMStateStore out of

[jira] [Updated] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-03-04 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-2868: - Attachment: YARN-2868.009.patch Update with latest feedback. Add metric for initial container launch

[jira] [Commented] (YARN-2693) Priority Label Manager in RM to manage application priority based on configuration

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347172#comment-14347172 ] Hadoop QA commented on YARN-2693: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347232#comment-14347232 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347199#comment-14347199 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3039: - Attachment: YARN-3039-v2-incomplete.patch Update a patch (haven't finished yet) to reflect some of

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: YARN-3242.004.patch Old ZK client session watcher event causes ZKRMStateStore out of sync with

[jira] [Commented] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347295#comment-14347295 ] Hudson commented on YARN-3131: -- FAILURE: Integrated in Hadoop-trunk-Commit #7255 (See

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-04 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347320#comment-14347320 ] Chang Li commented on YARN-3267: Have implemented unit test for this patch Timelineserver

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-04 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN_3267_V1.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Created] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-03-04 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-3293: --- Summary: Track and display capacity scheduler health metrics in web UI Key: YARN-3293 URL: https://issues.apache.org/jira/browse/YARN-3293 Project: Hadoop YARN

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347348#comment-14347348 ] Jason Lowe commented on YARN-3294: -- Do we really need a dedicated button for a specific

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: YARN-3242.004.patch Old ZK client session watcher event causes ZKRMStateStore out of sync with

[jira] [Updated] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2928: -- Attachment: Timeline Service Next Gen - Planning - ppt.pptx I made up some notes

[jira] [Updated] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3264: -- Summary: [Storage implementation] Create backing storage write interface and a POC only file based

[jira] [Resolved] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3031. --- Resolution: Duplicate Since the patch there covers the code of the writer interface. Let's resolve

[jira] [Commented] (YARN-2854) The document about timeline service and generic service needs to be updated

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347420#comment-14347420 ] Hadoop QA commented on YARN-2854: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347457#comment-14347457 ] Varun Saxena commented on YARN-2928: What is meant by manual reader ? Application

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347460#comment-14347460 ] Varun Saxena commented on YARN-3264: We can probably use try with resources construct

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347464#comment-14347464 ] Vinod Kumar Vavilapalli commented on YARN-2786: --- Looks good. Checking this

[jira] [Created] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-03-04 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-3294: --- Summary: Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period Key: YARN-3294 URL: https://issues.apache.org/jira/browse/YARN-3294 Project:

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347387#comment-14347387 ] Li Lu commented on YARN-3264: - Hi [~vrushalic], thanks for the patch! In general it looks good

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS app-appgregator service discovery

2015-03-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347384#comment-14347384 ] Junping Du commented on YARN-3039: -- Thanks [~Naganarasimha] for comments! bq. Even if we

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347490#comment-14347490 ] Hadoop QA commented on YARN-3264: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3289) Docker images should be downloaded during localization

2015-03-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347491#comment-14347491 ] Chen He commented on YARN-3289: --- Thank [~jlowe] for the comments. IMHO, we can move the

[jira] [Commented] (YARN-3289) Docker images should be downloaded during localization

2015-03-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347524#comment-14347524 ] Jason Lowe commented on YARN-3289: -- Regarding a separate prepping task, localization

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150304-1-branch2.patch YARN-2786-20150304-1-trunk.patch Uploaded

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702610/YARN-2786-20150304-1-branch2.patch against trunk revision ed70fa1. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150304-1-trunk-to-rekick-Jenkins.patch Jenkins failed is because it wanted

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-04 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3267: --- Attachment: YARN_3267_V2.patch Timelineserver applies the ACL rules after applying the limit on the number

[jira] [Commented] (YARN-3289) Docker images should be downloaded during localization

2015-03-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347619#comment-14347619 ] Chen He commented on YARN-3289: --- Or, maybe, we add some module on NM that can automatically

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347026#comment-14347026 ] Yongjun Zhang commented on YARN-3021: - Many thanks Jian. {quote} Change MR client to

[jira] [Updated] (YARN-2693) Priority Label Manager in RM to manage application priority based on configuration

2015-03-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2693: -- Attachment: 0006-YARN-2693.patch Rebasing against trunk. Errors look unrelated Priority Label Manager in RM to

[jira] [Updated] (YARN-2693) Priority Label Manager in RM to manage application priority based on configuration

2015-03-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2693: -- Attachment: (was: 0006-YARN-2693.patch) Priority Label Manager in RM to manage application priority based

[jira] [Updated] (YARN-3122) Metrics for container's actual CPU usage

2015-03-04 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3122: Attachment: YARN-3122.006.patch Fixed using constant CpuTimeTracker.UNAVAILABLE instead of hard

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347481#comment-14347481 ] Vinod Kumar Vavilapalli commented on YARN-2786: --- Actually, this won't apply

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347437#comment-14347437 ] Vinod Kumar Vavilapalli commented on YARN-2928: --- bq. Are there any plans to

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347548#comment-14347548 ] Hadoop QA commented on YARN-3242: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3264: - Attachment: YARN-3264.004.patch updating as per [~gtCarrera9] 's suggestions [Storage implementation]

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347561#comment-14347561 ] zhihai xu commented on YARN-3242: - Hi Rohith, thanks for the review and verifying the

[jira] [Commented] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347576#comment-14347576 ] Hadoop QA commented on YARN-3267: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3289) Docker images should be downloaded during localization

2015-03-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347583#comment-14347583 ] Chen He commented on YARN-3289: --- Thank you for the quick feedback, [~jlowe]. {quote} What

[jira] [Updated] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3242: Attachment: (was: YARN-3242.004.patch) Old ZK client session watcher event causes ZKRMStateStore out of

[jira] [Commented] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-04 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347431#comment-14347431 ] Remus Rusanu commented on YARN-2190: From my experience patches containing .sln or

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347626#comment-14347626 ] Li Lu commented on YARN-3264: - Hi [~vrushalic], thanks for the update. Unfortunately the

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347641#comment-14347641 ] Vrushali C commented on YARN-3264: -- [~gtCarrera] thanks! Will fix that test and remove the

[jira] [Updated] (YARN-3275) CapacityScheduler: Preemption happening on non-preemptable queues

2015-03-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3275: - Attachment: YARN-3275.v2.txt [~jlowe] and [~leftnoteasy], thank you for the reviews. Attached is an

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702617/YARN-2786-20150304-1-trunk-to-rekick-Jenkins.patch against trunk revision ed70fa1. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347633#comment-14347633 ] Karthik Kambatla commented on YARN-3122: One last nit: javadoc for

[jira] [Commented] (YARN-1310) Get rid of MR settings in YARN configuration

2015-03-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347684#comment-14347684 ] Brahma Reddy Battula commented on YARN-1310: [~kasha] ,[~djp] and [~hitesh] can

[jira] [Commented] (YARN-3292) [Umbrella] Tests/documentation and/or tools for YARN rolling upgrades backwards/forward compatibility verification

2015-03-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347710#comment-14347710 ] Li Lu commented on YARN-3292: - So far as we can see, YARN requires the following components to

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150304-2-trunk.patch Create yarn cluster CLI to enable list node labels

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150304-2-branch2.patch Attached both trunk/branch-2 patch, fixed findbugs warning

[jira] [Updated] (YARN-3122) Metrics for container's actual CPU usage

2015-03-04 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3122: Attachment: YARN-3122.007.patch Fixed javadoc Metrics for container's actual CPU usage

[jira] [Commented] (YARN-3111) Fix ratio problem on FairScheduler page

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347735#comment-14347735 ] Karthik Kambatla commented on YARN-3111: When cluster capacity is 0, do we want to

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-03-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347858#comment-14347858 ] Vrushali C commented on YARN-3134: -- There is a draft on some flow (and user and queue)

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702659/YARN-2786-20150304-2-trunk-to-kick-jenkins.patch against trunk revision 722b479. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-03-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1809: Attachment: YARN-1809.17.patch Synchronize RM and Generic History Service Web-UIs

[jira] [Updated] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3264: - Attachment: YARN-3264.005.patch Uploading new patch with review suggestions. - updated unit test for

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-04 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347995#comment-14347995 ] Hitesh Shah commented on YARN-3154: --- This should likely work. Main thing should be to

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348074#comment-14348074 ] Jian He commented on YARN-3021: --- Thanks Yongjun ! How about this: 1. Introduce a new MR

[jira] [Commented] (YARN-3242) Old ZK client session watcher event causes ZKRMStateStore out of sync with current ZK client session due to ZooKeeper asynchronously closing client session.

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348073#comment-14348073 ] Karthik Kambatla commented on YARN-3242: The patch looks good to me. The findbugs

[jira] [Commented] (YARN-3231) FairScheduler: Changing queueMaxRunningApps interferes with pending jobs

2015-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347983#comment-14347983 ] Hudson commented on YARN-3231: -- FAILURE: Integrated in Hadoop-trunk-Commit #7261 (See

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348052#comment-14348052 ] Zhijie Shen commented on YARN-3264: --- The patch looks almost good. Two minor issue: 1.

[jira] [Commented] (YARN-3275) CapacityScheduler: Preemption happening on non-preemptable queues

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347803#comment-14347803 ] Hadoop QA commented on YARN-3275: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3295) Fix documentation nits found in markdown conversion

2015-03-04 Thread Masatake Iwasaki (JIRA)
Masatake Iwasaki created YARN-3295: -- Summary: Fix documentation nits found in markdown conversion Key: YARN-3295 URL: https://issues.apache.org/jira/browse/YARN-3295 Project: Hadoop YARN

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347893#comment-14347893 ] Hadoop QA commented on YARN-3264: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2141) [Umbrella] Capture container and node resource consumption

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347932#comment-14347932 ] Karthik Kambatla commented on YARN-2141: [~curino] - the two sub-tasks capture

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347739#comment-14347739 ] Karthik Kambatla commented on YARN-3122: +1, pending Jenkins. Metrics for

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702629/YARN-2786-20150304-2-branch2.patch against trunk revision 722b479. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347866#comment-14347866 ] Hadoop QA commented on YARN-3122: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3122) Metrics for container's actual CPU usage

2015-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347931#comment-14347931 ] Hudson commented on YARN-3122: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7259 (See

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-03-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347944#comment-14347944 ] Jian He commented on YARN-1809: --- looks good overall. - the app page seems corrupted. -

[jira] [Commented] (YARN-2981) DockerContainerExecutor must support a Cluster-wide default Docker image

2015-03-04 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347972#comment-14347972 ] Abin Shahab commented on YARN-2981: --- [~sidharta-s] Can you review this?

[jira] [Assigned] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2015-03-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash reassigned YARN-1964: -- Assignee: Ravi Prakash (was: Abin Shahab) Create Docker analog of the LinuxContainerExecutor

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2015-03-04 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated YARN-1964: --- Assignee: Abin Shahab (was: Ravi Prakash) Create Docker analog of the LinuxContainerExecutor in YARN

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150304-2-trunk-to-kick-jenkins.patch Re-upload patch just to kick Jenkins

[jira] [Commented] (YARN-3231) FairScheduler changing queueMaxRunningApps on the fly will cause all pending job stuck

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347965#comment-14347965 ] Karthik Kambatla commented on YARN-3231: LGTM. +1. Checking this in.

[jira] [Updated] (YARN-3231) FairScheduler: Changing queueMaxRunningApps interferes with pending jobs

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3231: --- Summary: FairScheduler: Changing queueMaxRunningApps interferes with pending jobs (was:

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-03-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348022#comment-14348022 ] Xuan Gong commented on YARN-1809: - Thanks for the review. bq. the app page seems corrupted.

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-03-04 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12702629/YARN-2786-20150304-2-branch2.patch against trunk revision c66c3ac. {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-YARN

[jira] [Updated] (YARN-2436) yarn application help doesn't work

2015-03-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2436: --- Release Note: (was: test) yarn application help doesn't work

[jira] [Updated] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3154: Attachment: YARN-3154.3.patch address all the comments Should not upload partial logs for MR jobs or other

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348094#comment-14348094 ] Hadoop QA commented on YARN-1809: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348307#comment-14348307 ] Hadoop QA commented on YARN-3154: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348306#comment-14348306 ] Hadoop QA commented on YARN-2190: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3242) Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client

2015-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3242: --- Summary: Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other short-running' applications

2015-03-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348169#comment-14348169 ] Xuan Gong commented on YARN-3154: - bq. how should an app handle stdout and stderr i.e.

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-03-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348280#comment-14348280 ] Hadoop QA commented on YARN-1809: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3242) Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client

2015-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348083#comment-14348083 ] Hudson commented on YARN-3242: -- FAILURE: Integrated in Hadoop-trunk-Commit #7263 (See

[jira] [Updated] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2015-03-04 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated YARN-2190: Attachment: YARN-2190.11.patch [~vvasudev], thanks for review! All you comments should have been addressed.

[jira] [Updated] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3264: - Attachment: (was: YARN-3264.006.patch) [Storage implementation] Create backing storage write

  1   2   >