[jira] [Created] (YARN-2520) Scalable and High Available Timeline Server

2014-09-08 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2520: - Summary: Scalable and High Available Timeline Server Key: YARN-2520 URL: https://issues.apache.org/jira/browse/YARN-2520 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-2520) Scalable and High Available Timeline Server

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2520: -- Attachment: Federal Timeline Servers.jpg Attach simple architecture figure about the federal timeline

[jira] [Created] (YARN-2521) Reliable TimelineClient

2014-09-08 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2521: - Summary: Reliable TimelineClient Key: YARN-2521 URL: https://issues.apache.org/jira/browse/YARN-2521 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2512) Allow for origin pattern matching in cross origin filter

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125420#comment-14125420 ] Hudson commented on YARN-2512: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #674 (See

[jira] [Commented] (YARN-2515) Update ConverterUtils#toContainerId to parse epoch

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125418#comment-14125418 ] Hudson commented on YARN-2515: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #674 (See

[jira] [Commented] (YARN-2507) Document Cross Origin Filter Configuration for ATS

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125419#comment-14125419 ] Hudson commented on YARN-2507: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #674 (See

[jira] [Commented] (YARN-2515) Update ConverterUtils#toContainerId to parse epoch

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125509#comment-14125509 ] Hudson commented on YARN-2515: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1865 (See

[jira] [Commented] (YARN-2507) Document Cross Origin Filter Configuration for ATS

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125510#comment-14125510 ] Hudson commented on YARN-2507: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1865 (See

[jira] [Commented] (YARN-2512) Allow for origin pattern matching in cross origin filter

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125511#comment-14125511 ] Hudson commented on YARN-2512: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1865 (See

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125664#comment-14125664 ] Hadoop QA commented on YARN-2517: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125673#comment-14125673 ] Hadoop QA commented on YARN-2494: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: yarnregistry.tla yarnregistry.pdf

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-002.patch Patch -002 # adds persistence policy # {{RegistryOperationsService}}

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125706#comment-14125706 ] Hadoop QA commented on YARN-913: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125714#comment-14125714 ] Vinod Kumar Vavilapalli commented on YARN-2517: --- I am not entirely sure we

[jira] [Commented] (YARN-2515) Update ConverterUtils#toContainerId to parse epoch

2014-09-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125744#comment-14125744 ] Tsuyoshi OZAWA commented on YARN-2515: -- Thanks for your review, Jian! Update

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125760#comment-14125760 ] Tsuyoshi OZAWA commented on YARN-2517: -- Thanks for your comment, Vinod. {quote} an

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125777#comment-14125777 ] Zhijie Shen commented on YARN-2517: --- [~vinodkv], thanks for your feedback. The reason why

[jira] [Commented] (YARN-2518) Support in-process container executor

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125797#comment-14125797 ] Allen Wittenauer commented on YARN-2518: This is pretty much incompatible with

[jira] [Commented] (YARN-2461) Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration

2014-09-08 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125809#comment-14125809 ] Ray Chiang commented on YARN-2461: -- Same observation as before. No need for a new unit

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125808#comment-14125808 ] Allen Wittenauer commented on YARN-2256: Someone correct me if I'm wrong, but I'm

[jira] [Updated] (YARN-2256) Too many nodemanager audit logs are generated

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2256: --- Assignee: Varun Saxena Too many nodemanager audit logs are generated

[jira] [Updated] (YARN-2348) ResourceManager web UI should display server-side time instead of UTC time

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2348: --- Assignee: Leitao Guo ResourceManager web UI should display server-side time instead of UTC

[jira] [Updated] (YARN-2422) yarn.scheduler.maximum-allocation-mb should not be hard-coded in yarn-default.xml

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2422: --- Assignee: Gopal V yarn.scheduler.maximum-allocation-mb should not be hard-coded in

[jira] [Updated] (YARN-2097) Documentation: health check return status

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2097: --- Assignee: Rekha Joshi Documentation: health check return status

[jira] [Commented] (YARN-2518) Support in-process container executor

2014-09-08 Thread BoYang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125834#comment-14125834 ] BoYang commented on YARN-2518: -- In my rough testing, it did not fail the node manager process.

[jira] [Commented] (YARN-2518) Support in-process container executor

2014-09-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125838#comment-14125838 ] Allen Wittenauer commented on YARN-2518: Sorry, I wasn't clear: if this feature

[jira] [Commented] (YARN-2377) Localization exception stack traces are not passed as diagnostic info

2014-09-08 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125846#comment-14125846 ] Gera Shegalov commented on YARN-2377: - [~kasha], do you agree with the points above?

[jira] [Commented] (YARN-2097) Documentation: health check return status

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125852#comment-14125852 ] Hadoop QA commented on YARN-2097: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2512) Allow for origin pattern matching in cross origin filter

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125886#comment-14125886 ] Hudson commented on YARN-2512: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1890 (See

[jira] [Commented] (YARN-2507) Document Cross Origin Filter Configuration for ATS

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125885#comment-14125885 ] Hudson commented on YARN-2507: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1890 (See

[jira] [Commented] (YARN-2515) Update ConverterUtils#toContainerId to parse epoch

2014-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125884#comment-14125884 ] Hudson commented on YARN-2515: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1890 (See

[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125908#comment-14125908 ] Sangjin Lee commented on YARN-1530: --- {quote} The bottleneck is still there. Essentially I

[jira] [Commented] (YARN-2518) Support in-process container executor

2014-09-08 Thread BoYang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125907#comment-14125907 ] BoYang commented on YARN-2518: -- Yeah, there might be some issues with this, which need to be

[jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2014-09-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125950#comment-14125950 ] Karthik Kambatla commented on YARN-2154: Just discussed this with

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2459: -- Attachment: YARN-2459.4.patch RM crashes if App gets rejected for any reason and HA is enabled

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125959#comment-14125959 ] Jian He commented on YARN-2459: --- bq. Add one in TestRMRestart to get an app rejected and make

[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125990#comment-14125990 ] Zhijie Shen commented on YARN-1530: --- [~sjlee0], thanks for your feedback. Here're some

[jira] [Commented] (YARN-2080) Admission Control: Integrate Reservation subsystem with ResourceManager

2014-09-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125994#comment-14125994 ] Vinod Kumar Vavilapalli commented on YARN-2080: --- Some comments on the patch:

[jira] [Commented] (YARN-2154) FairScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2014-09-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126005#comment-14126005 ] Sandy Ryza commented on YARN-2154: -- I'd like to add another constraint that I've been

[jira] [Updated] (YARN-2256) Too many nodemanager and resourcemanager audit logs are generated

2014-09-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2256: --- Summary: Too many nodemanager and resourcemanager audit logs are generated (was: Too many nodemanager

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126036#comment-14126036 ] Hadoop QA commented on YARN-2459: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126037#comment-14126037 ] Jian He commented on YARN-2459: --- New patch added some comments in the test case RM crashes

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2459: -- Attachment: YARN-2459.5.patch RM crashes if App gets rejected for any reason and HA is enabled

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126073#comment-14126073 ] Vinod Kumar Vavilapalli commented on YARN-2033: --- Mostly looks fine, this is a

[jira] [Commented] (YARN-2256) Too many nodemanager and resourcemanager audit logs are generated

2014-09-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126119#comment-14126119 ] Varun Saxena commented on YARN-2256: bq. Someone correct me if I'm wrong, but I'm

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126135#comment-14126135 ] Hadoop QA commented on YARN-2459: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126140#comment-14126140 ] Vinod Kumar Vavilapalli commented on YARN-2440: --- Just caught up with the

[jira] [Updated] (YARN-1709) Admission Control: Reservation subsystem

2014-09-08 Thread Subramaniam Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Krishnan updated YARN-1709: --- Attachment: YARN-1709.patch Thanks [~chris.douglas] for your exhaustive review. I am

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126156#comment-14126156 ] Jian He commented on YARN-2308: --- Looked at this again, I think the solution mentioned by

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126158#comment-14126158 ] Karthik Kambatla commented on YARN-1458: Thanks Zhihai for working on this. I like

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1458: --- Attachment: yarn-1458-5.patch In Fair Scheduler, size based weight can cause update thread to

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2459: -- Attachment: YARN-2459.6.patch RM crashes if App gets rejected for any reason and HA is enabled

[jira] [Commented] (YARN-2448) RM should expose the resource types considered during scheduling when AMs register

2014-09-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126162#comment-14126162 ] Vinod Kumar Vavilapalli commented on YARN-2448: --- +1, this looks good.

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126172#comment-14126172 ] Karthik Kambatla commented on YARN-1458: By the way, I like the first approach

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126193#comment-14126193 ] Hadoop QA commented on YARN-1709: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126202#comment-14126202 ] Jian He commented on YARN-415: -- Looks good to me. Just one more question, I kind of lose

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126204#comment-14126204 ] zhihai xu commented on YARN-1458: - Hi [~kasha], thanks for the review, The first approach

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126210#comment-14126210 ] Karthik Kambatla commented on YARN-1458: bq. the alternative approach can fix zero

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126236#comment-14126236 ] Zhijie Shen commented on YARN-2033: --- [~vinodkv], thanks for your comments. I've updated

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.8.patch Investigate merging generic-history into the Timeline Store

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126240#comment-14126240 ] Hadoop QA commented on YARN-1458: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126249#comment-14126249 ] zhihai xu commented on YARN-1458: - Yes, it works, it can fix the zero weight with non-zero

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126259#comment-14126259 ] Hadoop QA commented on YARN-2459: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2320: -- Summary: Removing old application history store after we store the history data to timeline store (was:

[jira] [Commented] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126272#comment-14126272 ] Zhijie Shen commented on YARN-2320: --- According to Vinod's comments:

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-09-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126284#comment-14126284 ] Xuan Gong commented on YARN-2308: - bq. We can check if the queue exists on recovery. If

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126340#comment-14126340 ] Hadoop QA commented on YARN-2033: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.9.patch Fix one typo in the class name Investigate merging generic-history into

[jira] [Commented] (YARN-1712) Admission Control: plan follower

2014-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126397#comment-14126397 ] Jian He commented on YARN-1712: --- Thanks Subra and Carlo working on the patch. Some comments

[jira] [Updated] (YARN-1250) Generic history service should support application-acls

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1250: -- Attachment: YARN-1250.2.patch Update the patch according the latest patch of YARN-2033. Generic

[jira] [Updated] (YARN-2522) AHSClient may be not necessary

2014-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2522: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 AHSClient may be not necessary

[jira] [Updated] (YARN-2494) [YARN-796] Node label manager API and storage implementations

2014-09-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2494: - Attachment: YARN-2494.patch [YARN-796] Node label manager API and storage implementations

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126481#comment-14126481 ] Hadoop QA commented on YARN-2033: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2494) [YARN-796] Node label manager API and storage implementations

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126493#comment-14126493 ] Hadoop QA commented on YARN-2494: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126498#comment-14126498 ] zhihai xu commented on YARN-1458: - Hi [~kasha], I just found an example to prove the first

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-1458: Attachment: YARN-1458.alternative2.patch In Fair Scheduler, size based weight can cause update thread to

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126533#comment-14126533 ] zhihai xu commented on YARN-1458: - I uploaded a new patch YARN-1458.alternative2.patch

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126557#comment-14126557 ] Tsuyoshi OZAWA commented on YARN-2517: -- As Zhijie mentioned, we should have the

[jira] [Resolved] (YARN-2463) Add total cluster capacity to AllocateResponse

2014-09-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev resolved YARN-2463. - Resolution: Invalid Add total cluster capacity to AllocateResponse

[jira] [Commented] (YARN-2463) Add total cluster capacity to AllocateResponse

2014-09-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126558#comment-14126558 ] Varun Vasudev commented on YARN-2463: - Not required anymore since we don't expose the

[jira] [Created] (YARN-2523) ResourceManager UI showing negative value for Decommissioned Nodes field

2014-09-08 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2523: --- Summary: ResourceManager UI showing negative value for Decommissioned Nodes field Key: YARN-2523 URL: https://issues.apache.org/jira/browse/YARN-2523 Project: Hadoop

[jira] [Created] (YARN-2524) ResourceManager UI shows negative value for Decommissioned Nodes field

2014-09-08 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2524: --- Summary: ResourceManager UI shows negative value for Decommissioned Nodes field Key: YARN-2524 URL: https://issues.apache.org/jira/browse/YARN-2524 Project: Hadoop

[jira] [Resolved] (YARN-2524) ResourceManager UI shows negative value for Decommissioned Nodes field

2014-09-08 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty resolved YARN-2524. - Resolution: Invalid 2 issues got created by mistake. ResourceManager UI shows negative value for

[jira] [Assigned] (YARN-2523) ResourceManager UI showing negative value for Decommissioned Nodes field

2014-09-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2523: Assignee: Rohith ResourceManager UI showing negative value for Decommissioned Nodes field

[jira] [Updated] (YARN-2523) ResourceManager UI showing negative value for Decommissioned Nodes field

2014-09-08 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2523: Priority: Major (was: Minor) ResourceManager UI showing negative value for Decommissioned Nodes

[jira] [Commented] (YARN-2523) ResourceManager UI showing negative value for Decommissioned Nodes field

2014-09-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126580#comment-14126580 ] Rohith commented on YARN-2523: -- Decommissioned Node metrics are set by NodeListManager. If

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126591#comment-14126591 ] Hadoop QA commented on YARN-1458: - {color:green}+1 overall{color}. Here are the results of