[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006883#comment-15006883 ] Junping Du commented on YARN-4354: -- bq. I don't think there's anything magical about localization vs. the

[jira] [Issue Comment Deleted] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4354: - Comment: was deleted (was: Sorry for making a mistake. I was paying more attentions to other conflicts

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006780#comment-15006780 ] Junping Du commented on YARN-4354: -- Sorry for making a mistake. I was paying more attentions to other

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006779#comment-15006779 ] Junping Du commented on YARN-4354: -- Sorry for making a mistake. I was paying more attentions to other

[jira] [Updated] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4354: - Attachment: YARN-4354-branch-2.7.002.patch The commit to branch-2.7 broke the build because the

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006683#comment-15006683 ] Jason Lowe commented on YARN-4354: -- bq. To make NM more robust, I think we should tolerate this kind of

[jira] [Commented] (YARN-4290) "yarn nodes -list" should print all nodes reports information

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007106#comment-15007106 ] Wangda Tan commented on YARN-4290: -- [~sunilg]/[~Naganarasimha], There're several resources in the output I

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007077#comment-15007077 ] Sangjin Lee commented on YARN-4350: --- Thanks [~Naganarasimha] for the quick patch. I applied the patch on

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007076#comment-15007076 ] Jason Lowe commented on YARN-3840: -- Did anyone do a performance test with this change? Recently I'm

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007083#comment-15007083 ] Wangda Tan commented on YARN-3769: -- [~eepayne], thanks for update: bq. Would it be more efficient to just

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007082#comment-15007082 ] Sangjin Lee commented on YARN-2859: --- Just to be sure, those 3 issues you mentioned impact only the

[jira] [Commented] (YARN-4287) Capacity Scheduler: Rack Locality improvement

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007129#comment-15007129 ] Wangda Tan commented on YARN-4287: -- Thanks for update [~nroberts], I tried this patch on 2.7, all CS tests

[jira] [Updated] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4225: - Attachment: YARN-4225.001.patch Attching YARN-4225.001.patch for both trunk and branch-2.8 > Add

[jira] [Commented] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007172#comment-15007172 ] Wangda Tan commented on YARN-3849: -- [~sunilg], I tried to apply patch to branch-2.7 but failed, could you

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007196#comment-15007196 ] Xuan Gong commented on YARN-4234: - Fix the testcase failures and whitespace warning. > New put APIs in

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Description: The RLESparseResourceAllocation.removeInterval(...) method handles well exact match

[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007518#comment-15007518 ] Carlo Curino commented on YARN-3454: The new "merge" functionalities we added has been used both to

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007357#comment-15007357 ] Hadoop QA commented on YARN-4234: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Summary: RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing

[jira] [Commented] (YARN-4297) TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007499#comment-15007499 ] Hadoop QA commented on YARN-4297: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007543#comment-15007543 ] Naganarasimha G R commented on YARN-4183: - Hi [~sjlee0], Thanks for sharing your thoughts bq. If

[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4140: - Target Version/s: 2.7.3 > RM container allocation delayed incase of app submitted to Nodelabel partition >

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007360#comment-15007360 ] Wangda Tan commented on YARN-4140: -- I think we may need to consider to put this to next 2.7 release, this

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007392#comment-15007392 ] Naganarasimha G R commented on YARN-4350: - Thanks [~sjlee0] for verifying it, But few points: *

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007493#comment-15007493 ] Li Lu commented on YARN-4234: - One more problem: Looking into the writer, I can see the writer maintains one

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007358#comment-15007358 ] Hadoop QA commented on YARN-4053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007382#comment-15007382 ] Naganarasimha G R commented on YARN-2859: - Hi [~sjlee0], Ok to reword it , suppose we enable

[jira] [Assigned] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-3454: -- Assignee: Carlo Curino > RLESparseResourceAllocation does not handle removal of partial

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007329#comment-15007329 ] Jason Lowe commented on YARN-3840: -- Filed YARN-4357 to track the performance issue with the apps page. >

[jira] [Commented] (YARN-4357) Applications page loads very slowly when there are lots of applications

2015-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007326#comment-15007326 ] Jason Lowe commented on YARN-4357: -- The extra time appears to be all client-side processing in the

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007208#comment-15007208 ] Li Lu commented on YARN-4234: - Hi [~xgong], not sure if you've noticed [~sjlee0]'s comments in YATN-4183: bq.

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007242#comment-15007242 ] Sangjin Lee commented on YARN-4183: --- I agree we probably shouldn't put too many points of discussion here

[jira] [Updated] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4053: --- Attachment: (was: YARN-4053-feature-YARN-2928.04.patch) > Change the way metric values are stored

[jira] [Updated] (YARN-4334) Ability to avoid ResourceManager recovery if state store is "too old"

2015-11-16 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4334: --- Attachment: YARN-4334.wip.2.patch Thanks [~jlowe] for review! I have updated .2 prototype patch, please try it

[jira] [Commented] (YARN-4297) TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007344#comment-15007344 ] Varun Saxena commented on YARN-4297: Rebased the patch. Have also handled issue raised in YARN-3407

[jira] [Updated] (YARN-4349) Support CallerContext in YARN

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4349: - Attachment: YARN-4349.3.patch Attached ver.3 patch, make MR app-master's caller context starts with

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007289#comment-15007289 ] Jason Lowe commented on YARN-4354: -- I committed the 2.7 patch to branch-2.7.2 as well, since it was

[jira] [Updated] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4234: Attachment: YARN-4234-2015-11-16.1.patch > New put APIs in TimelineClient for ats v1.5 >

[jira] [Updated] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4053: --- Attachment: YARN-4053-feature-YARN-2928.04.patch > Change the way metric values are stored in HBase

[jira] [Updated] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4053: --- Attachment: YARN-4053-feature-YARN-2928.04.patch > Change the way metric values are stored in HBase

[jira] [Created] (YARN-4357) Applications page loads very slowly when there are lots of applications

2015-11-16 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4357: Summary: Applications page loads very slowly when there are lots of applications Key: YARN-4357 URL: https://issues.apache.org/jira/browse/YARN-4357 Project: Hadoop YARN

[jira] [Updated] (YARN-4297) TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4297: --- Attachment: (was: YARN-4297-YARN-2928.02.patch) > TestJobHistoryEventHandler and

[jira] [Updated] (YARN-4297) TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4297: --- Attachment: YARN-4297-feature-YARN-2928.02.patch > TestJobHistoryEventHandler and

[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007623#comment-15007623 ] Hadoop QA commented on YARN-3454: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007588#comment-15007588 ] Naganarasimha G R commented on YARN-4140: - Yes [~wangda], we need to atleast selectively pick few

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007589#comment-15007589 ] Naganarasimha G R commented on YARN-3216: - Hi [~wangda] and [~sunilg], What about this for 2.7.3 ?

[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007603#comment-15007603 ] Carlo Curino commented on YARN-3454: We also removed the minAlloc input parameter that was unused (and

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.patch > RLESparseResourceAllocation does not handle removal of partial intervals

[jira] [Commented] (YARN-4348) ZKRMStateStore.syncInternal should wait for zkResyncWaitTime instead of zkSessionTimeout

2015-11-16 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007618#comment-15007618 ] Tsuyoshi Ozawa commented on YARN-4348: -- YARN-4306 for the assertion error of getProxy. I'll check

[jira] [Commented] (YARN-4290) "yarn nodes -list" should print all nodes reports information

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007628#comment-15007628 ] Naganarasimha G R commented on YARN-4290: - Yes [~wangda], it would be better given in that way as

[jira] [Updated] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4350: Attachment: (was: YARN-4350-feature-YARN-2928.008.patch) > TestDistributedShell fails >

[jira] [Updated] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4350: Attachment: YARN-4350-feature-YARN-2928.001.patch updated the name of the patch file >

[jira] [Created] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4358: -- Summary: Improve relationship between SharingPolicy and ReservationAgent Key: YARN-4358 URL: https://issues.apache.org/jira/browse/YARN-4358 Project: Hadoop YARN

[jira] [Commented] (YARN-4349) Support CallerContext in YARN

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007665#comment-15007665 ] Hadoop QA commented on YARN-4349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4234: Attachment: YARN-4234-2015-11-16.2.patch > New put APIs in TimelineClient for ats v1.5 >

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007736#comment-15007736 ] Xuan Gong commented on YARN-4234: - bq. While this is totally fine for summary logs, it will cause entities

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2015-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007967#comment-15007967 ] Bibin A Chundatt commented on YARN-4140: +1 for merging in 2.7 . > RM container allocation delayed

[jira] [Created] (YARN-4361) Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model

2015-11-16 Thread jialei weng (JIRA)
jialei weng created YARN-4361: - Summary: Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model Key: YARN-4361 URL:

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007996#comment-15007996 ] Jian He commented on YARN-3840: --- I verified locally by simulating 10k apps. the patch does affect the browser

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008015#comment-15008015 ] Hadoop QA commented on YARN-4350: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008019#comment-15008019 ] Hudson commented on YARN-3840: -- FAILURE: Integrated in Hadoop-trunk-Commit #8811 (See

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008038#comment-15008038 ] Hudson commented on YARN-3840: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #684 (See

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008041#comment-15008041 ] Joep Rottinghuis commented on YARN-4053: Looks good [~varun_saxena] this is a nice separation of

[jira] [Created] (YARN-4362) Too many preemption activity when nodelabels are non exclusive

2015-11-16 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4362: -- Summary: Too many preemption activity when nodelabels are non exclusive Key: YARN-4362 URL: https://issues.apache.org/jira/browse/YARN-4362 Project: Hadoop YARN

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008056#comment-15008056 ] Hudson commented on YARN-3840: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1408 (See

[jira] [Assigned] (YARN-4362) Too many preemption activity when nodelabels are non exclusive

2015-11-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-4362: -- Assignee: Varun Saxena > Too many preemption activity when nodelabels are non exclusive >

[jira] [Updated] (YARN-4362) Too many preemption activity when nodelabels are non exclusive

2015-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4362: --- Attachment: capacity-scheduler.xml Preemptedpartition.log

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007649#comment-15007649 ] Hadoop QA commented on YARN-4350: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007652#comment-15007652 ] Allen Wittenauer commented on YARN-4350: Already looking at it. ;) > TestDistributedShell fails >

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.1.patch Updating including missing class > RLESparseResourceAllocation does not

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007657#comment-15007657 ] Carlo Curino commented on YARN-4358: In this patch, we propose to change the relationship between

[jira] [Created] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-16 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4360: -- Summary: Improve GreedyReservationAgent to support "early" allocations, and performance improvements Key: YARN-4360 URL: https://issues.apache.org/jira/browse/YARN-4360

[jira] [Reopened] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened YARN-3840: --- [~jlowe], thanks for reporting this. I did local test with a small number of apps only. I'm going to revert this

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007744#comment-15007744 ] Hadoop QA commented on YARN-4225: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2015-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007767#comment-15007767 ] Sunil G commented on YARN-4140: --- This ticket is good candidate for 2.7 line as we will be running in to this

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007793#comment-15007793 ] Wangda Tan commented on YARN-3216: -- I feel this could be risky regarding to complexity of this patch. And

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007846#comment-15007846 ] Naganarasimha G R commented on YARN-4350: - thanks for the fast reply, I only saw it now ! :) >

[jira] [Created] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2015-11-16 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4359: -- Summary: Update LowCost agents logic to take advantage of YARN-4358 Key: YARN-4359 URL: https://issues.apache.org/jira/browse/YARN-4359 Project: Hadoop YARN

[jira] [Commented] (YARN-4290) "yarn nodes -list" should print all nodes reports information

2015-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007759#comment-15007759 ] Sunil G commented on YARN-4290: --- Thanks [~leftnoteasy] for the input and thanks [~Naganarasimha Garla] for

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1500#comment-1500 ] Sunil G commented on YARN-3216: --- Yes [~Naganarasimha Garla]. It will be covering a good fix for AM

[jira] [Commented] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007780#comment-15007780 ] Sunil G commented on YARN-3849: --- Yes. Is not applying there. i will share a 2.7 patch for same. Thank You

[jira] [Commented] (YARN-4349) Support CallerContext in YARN

2015-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007829#comment-15007829 ] Jian He commented on YARN-4349: --- lgtm > Support CallerContext in YARN > - > >

[jira] [Commented] (YARN-4290) "yarn nodes -list" should print all nodes reports information

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007836#comment-15007836 ] Naganarasimha G R commented on YARN-4290: - Hi [~sunilg], i was assuming *(MEM/CPU)* was just to

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007841#comment-15007841 ] Hadoop QA commented on YARN-4234: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007855#comment-15007855 ] Sunil G commented on YARN-3216: --- Yes, patch covers major changes in scheduler, and depends on few metric

[jira] [Commented] (YARN-4290) "yarn nodes -list" should print all nodes reports information

2015-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007851#comment-15007851 ] Sunil G commented on YARN-4290: --- Ok. I feel Resource.toString is not separated by "/". From {{Resource}}

[jira] [Commented] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007864#comment-15007864 ] Naganarasimha G R commented on YARN-3216: - That would good [~sunilg], Please try once, as i feel

[jira] [Updated] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4358: --- Attachment: YARN-4358.patch This patch is marked-as-ready, but depends on YARN-3454 to apply

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007882#comment-15007882 ] Carlo Curino commented on YARN-4358: As side effects, this patch also: * introduces tracking of

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007896#comment-15007896 ] Carlo Curino commented on YARN-4358: This patch fixes the behavior for the GreedyReservationAgent.

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008064#comment-15008064 ] Hudson commented on YARN-3840: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2613 (See

[jira] [Commented] (YARN-4362) Too many preemption activity when nodelabels are non exclusive

2015-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008072#comment-15008072 ] Bibin A Chundatt commented on YARN-4362: Attached logs and xml. Looks like the guaranteed resource

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

2015-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008085#comment-15008085 ] Hudson commented on YARN-3840: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #672 (See

[jira] [Updated] (YARN-4361) Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model

2015-11-16 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-4361: -- Attachment: 0001-Fix-Total-resource-count-mistake-NodeRemovedSchedule.patch A appropriate way to handle

[jira] [Updated] (YARN-4361) Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model

2015-11-16 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-4361: -- Attachment: (was: 0001-Fix-Total-resource-count-mistake-NodeRemovedSchedule.patch) > Total resource

[jira] [Updated] (YARN-4361) Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model

2015-11-16 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-4361: -- Attachment: YARN-4361v1.patch A appropriate way to solve the issue. Just remove the 'if' logic. > Total

[jira] [Updated] (YARN-4361) Total resource count mistake:NodeRemovedSchedulerEvent in ReconnectNodeTransition will reduce the newNode.getTotalCapability() in Multi-thread model

2015-11-16 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-4361: -- Description: Total resource count mistake: NodeRemovedSchedulerEvent in ReconnectNodeTransition will

[jira] [Commented] (YARN-4348) ZKRMStateStore.syncInternal should wait for zkResyncWaitTime instead of zkSessionTimeout

2015-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006454#comment-15006454 ] Hadoop QA commented on YARN-4348: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4363) In TestFairScheduler, testcase should not create FairScheduler redundantly

2015-11-16 Thread Tao Jie (JIRA)
Tao Jie created YARN-4363: - Summary: In TestFairScheduler, testcase should not create FairScheduler redundantly Key: YARN-4363 URL: https://issues.apache.org/jira/browse/YARN-4363 Project: Hadoop YARN

[jira] [Updated] (YARN-4363) In TestFairScheduler, testcase should not create FairScheduler redundantly

2015-11-16 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4363: -- Attachment: YARN-4363.001.patch > In TestFairScheduler, testcase should not create FairScheduler redundantly >

  1   2   >