[jira] [Commented] (YARN-3020) n similar addContainerRequest()s produce n*(n+1)/2 containers

2015-01-12 Thread Peter D Kirchner (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273990#comment-14273990 ] Peter D Kirchner commented on YARN-3020: It looks like the bug may have come in

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274029#comment-14274029 ] Wangda Tan commented on YARN-2637: -- [~cwelch], Thanks for updating, reviewed latest patch,

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274073#comment-14274073 ] Wangda Tan commented on YARN-2868: -- [~rchiang], Thanks for working on this. [~rkanter],

[jira] [Updated] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2015-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2932: - Attachment: YARN-2932.v3.txt Upmerged and uploading new patch (v3). Add entry for preemption setting to

[jira] [Commented] (YARN-644) Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274002#comment-14274002 ] Hadoop QA commented on YARN-644: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2015-01-12 Thread M. C. Srivas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274007#comment-14274007 ] M. C. Srivas commented on YARN-2791: The scope in

[jira] [Updated] (YARN-3019) Enable RM work-preserving restart by default

2015-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3019: -- Attachment: YARN-3019.1.patch Uploaded a patch to flip yarn.resourcemanager.work-preserving-recovery.enabled

[jira] [Commented] (YARN-3019) Enable RM work-preserving restart by default

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274102#comment-14274102 ] Hadoop QA commented on YARN-3019: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-644) Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274003#comment-14274003 ] Varun Saxena commented on YARN-644: --- Kindly review Basic null check is not performed on

[jira] [Commented] (YARN-3019) Enable RM work-preserving restart by default

2015-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274013#comment-14274013 ] Jian He commented on YARN-3019: --- bq. Can you explain the behavior different with

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274023#comment-14274023 ] Robert Kanter commented on YARN-2868: - Looks good to me. The last Jenkins run was a

[jira] [Commented] (YARN-3026) Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274035#comment-14274035 ] Hadoop QA commented on YARN-3026: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274040#comment-14274040 ] Ray Chiang commented on YARN-2868: -- Great. Thanks! Add metric for initial container

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274064#comment-14274064 ] Robert Kanter commented on YARN-2957: - +1 Not sure what's wrong with Jenkins, but it's

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274162#comment-14274162 ] Hadoop QA commented on YARN-2868: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2015-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274131#comment-14274131 ] Hudson commented on YARN-2957: -- FAILURE: Integrated in Hadoop-trunk-Commit #6844 (See

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274118#comment-14274118 ] Hadoop QA commented on YARN-2932: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2791) Add Disk as a resource for scheduling

2015-01-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274171#comment-14274171 ] Wei Yan commented on YARN-2791: --- [~srivas], YARN-2618 is a simple solution that limits the

[jira] [Commented] (YARN-2957) Create unit test to automatically compare YarnConfiguration and yarn-default.xml

2015-01-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274170#comment-14274170 ] Ray Chiang commented on YARN-2957: -- Thanks! This should let me start documenting any

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274252#comment-14274252 ] Wangda Tan commented on YARN-2868: -- Some comments: 1. It seems overkill to me to use

[jira] [Assigned] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

2015-01-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-2716: -- Assignee: Karthik Kambatla Refactor ZKRMStateStore retry code with Apache Curator

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274308#comment-14274308 ] Ray Chiang commented on YARN-2868: -- RE: Comment 1) Using AtomicLong seemed like the least

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274317#comment-14274317 ] Karthik Kambatla commented on YARN-2868: bq. implementation of scheduler should

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274363#comment-14274363 ] Wangda Tan commented on YARN-2868: -- Thanks for explanation, #3 and [~kasha]'s comment make

[jira] [Commented] (YARN-2868) Add metric for initial container launch time

2015-01-12 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274369#comment-14274369 ] Ray Chiang commented on YARN-2868: -- Okay. Let me look at the changes and submit a new

[jira] [Updated] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2643: --- Attachment: yarn-2643-1.patch Rebased patch. Don't create a new DominantResourceCalculator

[jira] [Created] (YARN-3037) create HBase cluster backing storage implementation for ATS writes

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3037: - Summary: create HBase cluster backing storage implementation for ATS writes Key: YARN-3037 URL: https://issues.apache.org/jira/browse/YARN-3037 Project: Hadoop YARN

[jira] [Created] (YARN-3041) create the ATS entity/event API

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3041: - Summary: create the ATS entity/event API Key: YARN-3041 URL: https://issues.apache.org/jira/browse/YARN-3041 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-3032) implement ATS writer functionality to serve ATS readers' requests for live apps

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274512#comment-14274512 ] Naganarasimha G R commented on YARN-3032: - Hi [~sjlee0], I would like to work on

[jira] [Assigned] (YARN-3041) create the ATS entity/event API

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3041: --- Assignee: Robert Kanter create the ATS entity/event API ---

[jira] [Created] (YARN-3053) review and implement for property security in ATS v.2

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3053: - Summary: review and implement for property security in ATS v.2 Key: YARN-3053 URL: https://issues.apache.org/jira/browse/YARN-3053 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-3037) create HBase cluster backing storage implementation for ATS writes

2015-01-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3037: - Assignee: Zhijie Shen create HBase cluster backing storage implementation for ATS writes

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-01-12 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274597#comment-14274597 ] Vinod Kumar Vavilapalli commented on YARN-2928: --- Thanks for the design

[jira] [Assigned] (YARN-3053) review and implement for property security in ATS v.2

2015-01-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3053: - Assignee: Zhijie Shen review and implement for property security in ATS v.2

[jira] [Assigned] (YARN-3031) create backing storage write interface for ATS writers

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3031: -- Assignee: Varun Saxena create backing storage write interface for ATS writers

[jira] [Created] (YARN-3030) set up ATS writer with basic request serving structure and lifecycle

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3030: - Summary: set up ATS writer with basic request serving structure and lifecycle Key: YARN-3030 URL: https://issues.apache.org/jira/browse/YARN-3030 Project: Hadoop YARN

[jira] [Created] (YARN-3035) create a test-only backing storage implementation for ATS writes

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3035: - Summary: create a test-only backing storage implementation for ATS writes Key: YARN-3035 URL: https://issues.apache.org/jira/browse/YARN-3035 Project: Hadoop YARN

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274497#comment-14274497 ] Naganarasimha G R commented on YARN-2928: - Hi Sangjin, i would like to work on this

[jira] [Created] (YARN-3036) create standalone HBase backing storage implementation for ATS writes

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3036: - Summary: create standalone HBase backing storage implementation for ATS writes Key: YARN-3036 URL: https://issues.apache.org/jira/browse/YARN-3036 Project: Hadoop YARN

[jira] [Created] (YARN-3042) create ATS metrics API

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3042: - Summary: create ATS metrics API Key: YARN-3042 URL: https://issues.apache.org/jira/browse/YARN-3042 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274515#comment-14274515 ] Naganarasimha G R commented on YARN-2928: - Hi [~sjlee0], i have assigned YARN-3032

[jira] [Assigned] (YARN-3050) implement new flow-based ATS queries in the new ATS design

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3050: -- Assignee: Varun Saxena implement new flow-based ATS queries in the new ATS design

[jira] [Updated] (YARN-2984) Metrics for container's actual memory usage

2015-01-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2984: --- Attachment: yarn-2984-1.patch Thanks for the feedback, Anubhav. Uploading new patch that adds

[jira] [Created] (YARN-3038) handle ATS writer failure scenarios

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3038: - Summary: handle ATS writer failure scenarios Key: YARN-3038 URL: https://issues.apache.org/jira/browse/YARN-3038 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-3048) handle how to set up and start/stop ATS reader instances

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3048: - Summary: handle how to set up and start/stop ATS reader instances Key: YARN-3048 URL: https://issues.apache.org/jira/browse/YARN-3048 Project: Hadoop YARN Issue

[jira] [Created] (YARN-3047) set up ATS reader with basic request serving structure and lifecycle

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3047: - Summary: set up ATS reader with basic request serving structure and lifecycle Key: YARN-3047 URL: https://issues.apache.org/jira/browse/YARN-3047 Project: Hadoop YARN

[jira] [Assigned] (YARN-3044) implement RM writing app lifecycle events to ATS

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3044: --- Assignee: Naganarasimha G R implement RM writing app lifecycle events to ATS

[jira] [Assigned] (YARN-3034) implement RM starting its ATS writer

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3034: --- Assignee: Naganarasimha G R implement RM starting its ATS writer

[jira] [Assigned] (YARN-3049) implement existing ATS queries in the new ATS design

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3049: -- Assignee: Varun Saxena implement existing ATS queries in the new ATS design

[jira] [Assigned] (YARN-3048) handle how to set up and start/stop ATS reader instances

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3048: -- Assignee: Varun Saxena handle how to set up and start/stop ATS reader instances

[jira] [Commented] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274581#comment-14274581 ] Robert Kanter commented on YARN-2643: - +1 Don't create a new

[jira] [Commented] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274387#comment-14274387 ] Hadoop QA commented on YARN-2643: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3032) implement ATS writer functionality to serve ATS readers' requests for live apps

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3032: - Summary: implement ATS writer functionality to serve ATS readers' requests for live apps Key: YARN-3032 URL: https://issues.apache.org/jira/browse/YARN-3032 Project:

[jira] [Created] (YARN-3039) implement ATS writer service discovery

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3039: - Summary: implement ATS writer service discovery Key: YARN-3039 URL: https://issues.apache.org/jira/browse/YARN-3039 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Assigned] (YARN-3046) implement MapReduce AM writing some MR metrics to ATS

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3046: --- Assignee: Robert Kanter implement MapReduce AM writing some MR metrics to ATS

[jira] [Created] (YARN-3052) provide a very simple POC html ATS UI

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3052: - Summary: provide a very simple POC html ATS UI Key: YARN-3052 URL: https://issues.apache.org/jira/browse/YARN-3052 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-3051) create backing storage read interface for ATS readers

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3051: - Summary: create backing storage read interface for ATS readers Key: YARN-3051 URL: https://issues.apache.org/jira/browse/YARN-3051 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-3039) implement ATS writer service discovery

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3039: --- Assignee: Robert Kanter implement ATS writer service discovery

[jira] [Commented] (YARN-2932) Add entry for preemption setting to queue status screen and startup/refresh logging

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274448#comment-14274448 ] Wangda Tan commented on YARN-2932: -- 1. Rename isQueuePreemptable to getQueuePreemptable

[jira] [Created] (YARN-3033) implement NM starting the ATS writer companion

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3033: - Summary: implement NM starting the ATS writer companion Key: YARN-3033 URL: https://issues.apache.org/jira/browse/YARN-3033 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-3045) implement NM writing container lifecycle events and container system metrics to ATS

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3045: - Summary: implement NM writing container lifecycle events and container system metrics to ATS Key: YARN-3045 URL: https://issues.apache.org/jira/browse/YARN-3045 Project:

[jira] [Assigned] (YARN-3040) implement client-side API for handling flows

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3040: --- Assignee: Naganarasimha G R implement client-side API for handling flows

[jira] [Created] (YARN-3034) implement RM starting its ATS writer

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3034: - Summary: implement RM starting its ATS writer Key: YARN-3034 URL: https://issues.apache.org/jira/browse/YARN-3034 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-3050) implement new flow-based ATS queries in the new ATS design

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3050: - Summary: implement new flow-based ATS queries in the new ATS design Key: YARN-3050 URL: https://issues.apache.org/jira/browse/YARN-3050 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-3033) implement NM starting the ATS writer companion

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3033: --- Assignee: Naganarasimha G R implement NM starting the ATS writer companion

[jira] [Assigned] (YARN-3036) create standalone HBase backing storage implementation for ATS writes

2015-01-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3036: - Assignee: Zhijie Shen create standalone HBase backing storage implementation for ATS writes

[jira] [Assigned] (YARN-3042) create ATS metrics API

2015-01-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3042: - Assignee: Zhijie Shen create ATS metrics API -- Key:

[jira] [Assigned] (YARN-3051) create backing storage read interface for ATS readers

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3051: -- Assignee: Varun Saxena create backing storage read interface for ATS readers

[jira] [Commented] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274373#comment-14274373 ] Robert Kanter commented on YARN-2643: - LGTM. [~kasha], can you rebase the patch? It

[jira] [Created] (YARN-3031) create backing storage write interface for ATS writers

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3031: - Summary: create backing storage write interface for ATS writers Key: YARN-3031 URL: https://issues.apache.org/jira/browse/YARN-3031 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-3032) implement ATS writer functionality to serve ATS readers' requests for live apps

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3032: --- Assignee: Naganarasimha G R implement ATS writer functionality to serve ATS readers'

[jira] [Created] (YARN-3040) implement client-side API for handling flows

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3040: - Summary: implement client-side API for handling flows Key: YARN-3040 URL: https://issues.apache.org/jira/browse/YARN-3040 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-3046) implement MapReduce AM writing some MR metrics to ATS

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3046: - Summary: implement MapReduce AM writing some MR metrics to ATS Key: YARN-3046 URL: https://issues.apache.org/jira/browse/YARN-3046 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-3045) implement NM writing container lifecycle events and container system metrics to ATS

2015-01-12 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3045: --- Assignee: Naganarasimha G R implement NM writing container lifecycle events and

[jira] [Commented] (YARN-3039) implement ATS writer service discovery

2015-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274538#comment-14274538 ] Robert Kanter commented on YARN-3039: - We should look into using YARN-913's Yarn

[jira] [Assigned] (YARN-3043) create ATS configuration, metadata, etc. as part of entities

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3043: -- Assignee: Varun Saxena create ATS configuration, metadata, etc. as part of entities

[jira] [Updated] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-01-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2928: -- Description: We have the application timeline server implemented in yarn per YARN-1530 and YARN-321.

[jira] [Assigned] (YARN-3038) handle ATS writer failure scenarios

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3038: -- Assignee: Varun Saxena handle ATS writer failure scenarios

[jira] [Created] (YARN-3043) create ATS configuration, metadata, etc. as part of entities

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3043: - Summary: create ATS configuration, metadata, etc. as part of entities Key: YARN-3043 URL: https://issues.apache.org/jira/browse/YARN-3043 Project: Hadoop YARN

[jira] [Created] (YARN-3044) implement RM writing app lifecycle events to ATS

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3044: - Summary: implement RM writing app lifecycle events to ATS Key: YARN-3044 URL: https://issues.apache.org/jira/browse/YARN-3044 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-3049) implement existing ATS queries in the new ATS design

2015-01-12 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3049: - Summary: implement existing ATS queries in the new ATS design Key: YARN-3049 URL: https://issues.apache.org/jira/browse/YARN-3049 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274546#comment-14274546 ] Hadoop QA commented on YARN-2643: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274562#comment-14274562 ] Karthik Kambatla commented on YARN-2643: I think the change is too trivial to add a

[jira] [Assigned] (YARN-3047) set up ATS reader with basic request serving structure and lifecycle

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3047: -- Assignee: Varun Saxena set up ATS reader with basic request serving structure and lifecycle

[jira] [Commented] (YARN-2643) Don't create a new DominantResourceCalculator on every FairScheduler.allocate call

2015-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274591#comment-14274591 ] Hudson commented on YARN-2643: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6850 (See

[jira] [Commented] (YARN-3035) create a test-only backing storage implementation for ATS writes

2015-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274761#comment-14274761 ] Sunil G commented on YARN-3035: --- Hi [~sjlee0] As what I understood from the design document,

[jira] [Updated] (YARN-3024) LocalizerRunner should give DIE action when all resources are localized

2015-01-12 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated YARN-3024: Attachment: YARN-3024.03.patch Updated patch. I refactored {{LocalizerRunner#update()}}, separating

[jira] [Commented] (YARN-2984) Metrics for container's actual memory usage

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14274688#comment-14274688 ] Hadoop QA commented on YARN-2984: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2896) Server side PB changes for Priority Label Manager and Admin CLI support

2015-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2896: -- Attachment: 0003-YARN-2896.patch Updating patch. Kindly check overall PB support from Server side Server side

[jira] [Updated] (YARN-2693) Priority Label Manager in RM to manage priority labels

2015-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2693: -- Attachment: 0003-YARN-2693.patch Updating patch with test cases. Priority Label Manager in RM to manage

[jira] [Updated] (YARN-644) Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-644: -- Attachment: YARN-644.001.patch Basic null check is not performed on passed in arguments before using

[jira] [Commented] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273834#comment-14273834 ] Zhijie Shen commented on YARN-3009: --- bq. but I suspect this is better served instead of

[jira] [Commented] (YARN-3029) FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273845#comment-14273845 ] Hadoop QA commented on YARN-3029: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3029) FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273849#comment-14273849 ] Varun Saxena commented on YARN-3029: [~ste...@apache.org], kindly review

[jira] [Updated] (YARN-3026) Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3026: - Attachment: YARN-3026.1.patch Attached ver.1 patch and kick Jenkins. Move application-specific container

[jira] [Commented] (YARN-644) Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer

2015-01-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273766#comment-14273766 ] Hadoop QA commented on YARN-644: {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-3029) FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3029: -- Assignee: Varun Saxena FSDownload.unpack() uses local locale for FS case conversion, may not

[jira] [Commented] (YARN-3029) FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere

2015-01-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273797#comment-14273797 ] Varun Saxena commented on YARN-3029: Attached a trivial patch FSDownload.unpack()

[jira] [Commented] (YARN-3028) Better syntax for replace label CLI

2015-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273802#comment-14273802 ] Wangda Tan commented on YARN-3028: -- +1 for this proposal, we should do like this at the

[jira] [Created] (YARN-3029) FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere

2015-01-12 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3029: Summary: FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere Key: YARN-3029 URL: https://issues.apache.org/jira/browse/YARN-3029

  1   2   >