[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

2015-04-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496103#comment-14496103 ] Rohith commented on YARN-2268: -- I propose the following way to handle disallow state store

[jira] [Created] (YARN-3489) RMServerUtils.validateResourceRequests should only obtain queue info once

2015-04-15 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-3489: Summary: RMServerUtils.validateResourceRequests should only obtain queue info once Key: YARN-3489 URL: https://issues.apache.org/jira/browse/YARN-3489 Project: Hadoop YARN

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496099#comment-14496099 ] Hadoop QA commented on YARN-3476: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3477) TimelineClientImpl swallows root cause of retry failures

2015-04-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3477: - Target Version/s: 2.7.1 Affects Version/s: (was: 3.0.0) 2.7.0

[jira] [Commented] (YARN-3266) RMContext inactiveNodes should have NodeId as map key

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496385#comment-14496385 ] Hudson commented on YARN-3266: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2114 (See

[jira] [Commented] (YARN-3436) Fix URIs in documention of YARN web service REST APIs

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496383#comment-14496383 ] Hudson commented on YARN-3436: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2114 (See

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496384#comment-14496384 ] Hudson commented on YARN-3361: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2114 (See

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496239#comment-14496239 ] Thomas Graves commented on YARN-3434: - So I had considered putting it in the

[jira] [Assigned] (YARN-3489) RMServerUtils.validateResourceRequests should only obtain queue info once

2015-04-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3489: -- Assignee: Varun Saxena RMServerUtils.validateResourceRequests should only obtain queue info

[jira] [Updated] (YARN-3471) Fix timeline client retry

2015-04-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3471: - Affects Version/s: 2.8.0 Fix timeline client retry -

[jira] [Commented] (YARN-3436) Fix URIs in documention of YARN web service REST APIs

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496304#comment-14496304 ] Hudson commented on YARN-3436: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #165 (See

[jira] [Commented] (YARN-3266) RMContext inactiveNodes should have NodeId as map key

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496306#comment-14496306 ] Hudson commented on YARN-3266: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #165 (See

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496305#comment-14496305 ] Hudson commented on YARN-3361: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #165 (See

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-15 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Attachment: YARN-3448.8.patch Add Rolling Time To Lives Level DB Plugin Capabilities

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496519#comment-14496519 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-trunk-Commit #7588 (See

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496490#comment-14496490 ] Zhijie Shen commented on YARN-3051: --- Hence, regardless the implementation detail, we

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496534#comment-14496534 ] Varun Saxena commented on YARN-3051: Updated a WIP patch. Will update javadoc after

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496509#comment-14496509 ] Varun Saxena commented on YARN-3051: As per the patch I am currently working on, if

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496538#comment-14496538 ] Junping Du commented on YARN-3411: -- Thanks [~vrushalic] for delivering the proposal and

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3051: --- Attachment: YARN-3051.wip.patch [Storage abstraction] Create backing storage read interface for ATS

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496503#comment-14496503 ] Sangjin Lee commented on YARN-3051: --- Yep. That's perfect. [Storage abstraction] Create

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496511#comment-14496511 ] Sangjin Lee commented on YARN-3390: --- {quote} For putIfAbsent and remove, I don't use

[jira] [Commented] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496528#comment-14496528 ] Hadoop QA commented on YARN-3448: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3490) Add an application decorator to ClientRMService

2015-04-15 Thread Jian Fang (JIRA)
Jian Fang created YARN-3490: --- Summary: Add an application decorator to ClientRMService Key: YARN-3490 URL: https://issues.apache.org/jira/browse/YARN-3490 Project: Hadoop YARN Issue Type: New

[jira] [Updated] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

2015-04-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2605: Issue Type: Sub-task (was: Bug) Parent: YARN-149 [RM HA] Rest api endpoints doing redirect

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-04-15 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496648#comment-14496648 ] Jian Fang commented on YARN-2306: - Could someone please tell me which JIRA has fixed this

[jira] [Created] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
zhihai xu created YARN-3491: --- Summary: Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer). Key: YARN-3491

[jira] [Updated] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2696: - Attachment: YARN-2696.2.patch Attached ver.2 patch fixed findbugs warning and test failures

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496617#comment-14496617 ] Wangda Tan commented on YARN-3434: -- [~tgraves], I think your concerns may not be a

[jira] [Commented] (YARN-3326) ReST support for getLabelsToNodes

2015-04-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496693#comment-14496693 ] Tsuyoshi Ozawa commented on YARN-3326: -- +1, committing this shortly. Hey

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496644#comment-14496644 ] Wangda Tan commented on YARN-3434: -- bq. All you would be using it for is passing it down

[jira] [Commented] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496663#comment-14496663 ] Jason Lowe commented on YARN-3491: -- Could you elaborate a bit on why the submit is time

[jira] [Created] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-15 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-3492: -- Summary: AM fails to come up because RM and NM can't connect to each other Key: YARN-3492 URL: https://issues.apache.org/jira/browse/YARN-3492 Project: Hadoop

[jira] [Updated] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3492: --- Attachment: yarn-kasha-resourcemanager-kasha-mbp.local.log

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496881#comment-14496881 ] Jian He commented on YARN-2696: --- few minor comments - add a comment why no_label max

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496888#comment-14496888 ] Jian He commented on YARN-3354: --- +1 Container should contains node-labels asked by

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496892#comment-14496892 ] Jian He commented on YARN-2696: --- - Does this overlap with below

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496910#comment-14496910 ] Wangda Tan commented on YARN-3434: -- [~tgraves], Make sense to me, especially for the

[jira] [Commented] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496918#comment-14496918 ] Tsuyoshi Ozawa commented on YARN-3492: -- [~kasha], could you attach yarn-site.xml and

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496920#comment-14496920 ] Jian He commented on YARN-3404: --- +1 View the queue name to YARN Application page

[jira] [Updated] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3492: --- Attachment: yarn-site.xml mapred-site.xml AM fails to come up because RM and

[jira] [Updated] (YARN-3005) [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java

2015-04-15 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-3005: Assignee: Kengo Seki [JDK7] Use switch statement for String instead of if-else statement in

[jira] [Updated] (YARN-3326) Support RESTful API for getLabelsToNodes

2015-04-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3326: - Summary: Support RESTful API for getLabelsToNodes (was: ReST support for getLabelsToNodes )

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496735#comment-14496735 ] Thomas Graves commented on YARN-3434: - I am not saying child needs to know how parent

[jira] [Commented] (YARN-3462) Patches applied for YARN-2424 are inconsistent between trunk and branch-2

2015-04-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496757#comment-14496757 ] Naganarasimha G R commented on YARN-3462: - Thanks for reviewing and Commiting ,

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

2015-04-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496712#comment-14496712 ] Tsuyoshi Ozawa commented on YARN-3326: -- Committed this to trunk and branch-2. Thanks

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

2015-04-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496733#comment-14496733 ] Naganarasimha G R commented on YARN-3326: - Thanks [~ozawa], thanks for the review,

[jira] [Commented] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496702#comment-14496702 ] zhihai xu commented on YARN-3491: - I saw the serialization for public resource localization

[jira] [Commented] (YARN-3005) [JDK7] Use switch statement for String instead of if-else statement in RegistrySecurity.java

2015-04-15 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496708#comment-14496708 ] Akira AJISAKA commented on YARN-3005: - Assigned [~sekikn]. Thanks. [JDK7] Use switch

[jira] [Commented] (YARN-3394) WebApplication proxy documentation is incomplete

2015-04-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496725#comment-14496725 ] Tsuyoshi Ozawa commented on YARN-3394: -- Thanks Naganarasimha for your contribution and

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496732#comment-14496732 ] Hadoop QA commented on YARN-2696: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

2015-04-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496731#comment-14496731 ] Hudson commented on YARN-3326: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7590 (See

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497311#comment-14497311 ] Hadoop QA commented on YARN-3463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497087#comment-14497087 ] Wangda Tan commented on YARN-3434: -- bq. Or were you saying create a ResourceLimit and pass

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.64.patch rebased to current trunk Integrate OrderingPolicy Framework with

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497261#comment-14497261 ] Wangda Tan commented on YARN-2498: -- Discussed with [~mayank_bansal], taking over and

[jira] [Created] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-3493: Summary: RM fails to come up with error Failed to load/recover state when mem settings are changed Key: YARN-3493 URL: https://issues.apache.org/jira/browse/YARN-3493

[jira] [Assigned] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2498: Assignee: Wangda Tan (was: Mayank Bansal) Respect labels in preemption policy of capacity

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497065#comment-14497065 ] Wangda Tan commented on YARN-3434: -- bq. Are you suggesting we change the patch to modify

[jira] [Commented] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497085#comment-14497085 ] zhihai xu commented on YARN-3491: - Hi [~jlowe], thanks for the comment. Queueing is faster,

[jira] [Updated] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumana Sathish updated YARN-3493: - Attachment: yarn-yarn-resourcemanager.log.zip RM fails to come up with error Failed to

[jira] [Updated] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3493: -- Fix Version/s: (was: 2.7.0) RM fails to come up with error Failed to load/recover state when mem

[jira] [Assigned] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-3493: - Assignee: Jian He RM fails to come up with error Failed to load/recover state when mem settings are

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497129#comment-14497129 ] Jian He commented on YARN-3493: --- [~kasha], I think this happened on a different code path.

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497139#comment-14497139 ] Hadoop QA commented on YARN-2696: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.65.patch Suppress orderingpolicy from appearing in web service responses, is still

[jira] [Updated] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3493: -- Attachment: YARN-3493.1.patch Upload a patch to ignore this exception on recovery RM fails to come up with

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497341#comment-14497341 ] Sangjin Lee commented on YARN-3390: --- I took a pass at the patch, and it looks good for

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497320#comment-14497320 ] Sangjin Lee commented on YARN-3051: --- We chatted offline about the issue of what context

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497055#comment-14497055 ] Thomas Graves commented on YARN-3434: - I agree with Both section. I'm not sure I

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-15 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497076#comment-14497076 ] Thomas Graves commented on YARN-3434: - so you are saying add amountNeededUnreserve to

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497122#comment-14497122 ] Karthik Kambatla commented on YARN-3493: [~jianhe] - YARN-2010 should have fixed

[jira] [Commented] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497304#comment-14497304 ] Sangjin Lee commented on YARN-3491: --- I have the same question as [~jlowe]. The actual

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497315#comment-14497315 ] Vrushali C commented on YARN-3051: -- Hi [~varun_saxena] As per the discussion in the call

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497317#comment-14497317 ] Jian He commented on YARN-3493: --- cancel the patch, uploading a newer version. RM fails to

[jira] [Assigned] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-3494: Assignee: Rohith Expose AM resource limit and user limit in QueueMetrics

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497378#comment-14497378 ] Rohith commented on YARN-3493: -- +1(non-binding) RM fails to come up with error Failed to

[jira] [Commented] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497411#comment-14497411 ] zhihai xu commented on YARN-3491: - Hi [~sjlee0], that is a good point. I just think about

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497413#comment-14497413 ] Rohith commented on YARN-3493: -- The same problem would occur enabling RM work preserving

[jira] [Updated] (YARN-3495) Confusing log generated by FairScheduler

2015-04-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3495: --- Attachment: YARN-3495.patch Confusing log generated by FairScheduler

[jira] [Created] (YARN-3495) Confusing log generated by FairScheduler

2015-04-15 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created YARN-3495: -- Summary: Confusing log generated by FairScheduler Key: YARN-3495 URL: https://issues.apache.org/jira/browse/YARN-3495 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3495) Confusing log generated by FairScheduler

2015-04-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497516#comment-14497516 ] Brahma Reddy Battula commented on YARN-3495: Attached the patch..Kindly

[jira] [Commented] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497565#comment-14497565 ] zhihai xu commented on YARN-3491: - Hi [~jlowe] and [~sjlee0], I think I know what is

[jira] [Updated] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Description: Improve the public resource localization to do both FSDownload submission to the thread pool

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497439#comment-14497439 ] Hadoop QA commented on YARN-3493: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3437) convert load test driver to timeline service v.2

2015-04-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3437: -- Attachment: YARN-3437.002.patch Rebased the patch with the latest from the YARN-2928 branch. convert

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497451#comment-14497451 ] Hadoop QA commented on YARN-3463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Summary: PublicLocalizer#addResource is too slow. (was: Improve the public resource localization to do both

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497354#comment-14497354 ] Hadoop QA commented on YARN-3463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3493: -- Attachment: YARN-3493.2.patch uploaded a new patch RM fails to come up with error Failed to load/recover state

[jira] [Commented] (YARN-3495) Confusing log generated by FairScheduler

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497571#comment-14497571 ] Hadoop QA commented on YARN-3495: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3496) Add a configuration to disable/enable storing localization state in NM StateStore

2015-04-15 Thread zhihai xu (JIRA)
zhihai xu created YARN-3496: --- Summary: Add a configuration to disable/enable storing localization state in NM StateStore Key: YARN-3496 URL: https://issues.apache.org/jira/browse/YARN-3496 Project: Hadoop

[jira] [Created] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-15 Thread Jian He (JIRA)
Jian He created YARN-3494: - Summary: Expose AM resource limit and user limit in QueueMetrics Key: YARN-3494 URL: https://issues.apache.org/jira/browse/YARN-3494 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-15 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.66.patch Fix build warnings, the tests all pass on my box. Integrate

[jira] [Updated] (YARN-3491) Improve the public resource localization to do both FSDownload submission to the thread pool and completed localization handling in one thread (PublicLocalizer).

2015-04-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3491: Description: Improve the public resource localization to do both FSDownload submission to the thread pool

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497432#comment-14497432 ] Hadoop QA commented on YARN-3437: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497500#comment-14497500 ] Brahma Reddy Battula commented on YARN-3492: [~kasha] Thanks for reporting this

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-04-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497416#comment-14497416 ] Rohith commented on YARN-3493: -- bq. The same problem would occur Just to clarify I am

[jira] [Updated] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2696: - Attachment: YARN-2696.3.patch Addressed all comments from [~jianhe] and fixed test failure in

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

2015-04-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14496981#comment-14496981 ] Wangda Tan commented on YARN-3354: -- Test failure is not related to the patch. Container

  1   2   >