[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: (was: YARN-3508.01.patch) Preemption processing occuring on the main RM dispatcher

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-05-28 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563824#comment-14563824 ] Joep Rottinghuis commented on YARN-3706: Just realized an additional problem. If we

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: YARN-3508.01.patch Preemption processing occuring on the main RM dispatcher

[jira] [Created] (YARN-3736) Persist the Plan information, ie. accepted reservations to the RMStateStore for failover

2015-05-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-3736: Summary: Persist the Plan information, ie. accepted reservations to the RMStateStore for failover Key: YARN-3736 URL: https://issues.apache.org/jira/browse/YARN-3736

[jira] [Updated] (YARN-3737) Add support for recovery of reserved apps (running under dynamic queues) to Fair Scheduler

2015-05-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3737: - Component/s: (was: capacityscheduler) Description: YARN-3736 persists the current state of

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: YARN-3508.01.patch Preemption processing occuring on the main RM dispatcher

[jira] [Updated] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3733: - Attachment: YARN-3733.patch Attached the patch fixing the issue. Kindly review the patch. On RM restart AM

[jira] [Created] (YARN-3739) Add recovery of reservation system to RM failover process

2015-05-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-3739: Summary: Add recovery of reservation system to RM failover process Key: YARN-3739 URL: https://issues.apache.org/jira/browse/YARN-3739 Project: Hadoop YARN

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-05-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563720#comment-14563720 ] Sangjin Lee commented on YARN-2556: --- [~lichangleo], thanks much for the latest patch! I

[jira] [Updated] (YARN-3716) Node-label-expression should be included by ResourceRequestPBImpl.toString

2015-05-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3716: - Target Version/s: 2.8.0 Summary: Node-label-expression should be included by

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563769#comment-14563769 ] Hadoop QA commented on YARN-3733: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3737) Persist the Plan information, ie. accepted reservations to the RMStateStore for failover

2015-05-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-3737: Summary: Persist the Plan information, ie. accepted reservations to the RMStateStore for failover Key: YARN-3737 URL: https://issues.apache.org/jira/browse/YARN-3737

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: YARN-3508.01.patch Preemption processing occuring on the main RM dispatcher

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: (was: YARN-3508.01.patch) Preemption processing occuring on the main RM dispatcher

[jira] [Commented] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563646#comment-14563646 ] Hadoop QA commented on YARN-3017: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3738) Add support for recovery of reserved apps (running under dynamic queues) to Capacity Scheduler

2015-05-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-3738: Summary: Add support for recovery of reserved apps (running under dynamic queues) to Capacity Scheduler Key: YARN-3738 URL: https://issues.apache.org/jira/browse/YARN-3738

[jira] [Commented] (YARN-3560) Not able to navigate to the cluster from tracking url (proxy) generated after submission of job

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563661#comment-14563661 ] Hadoop QA commented on YARN-3560: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563662#comment-14563662 ] Hadoop QA commented on YARN-2556: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3723) Need to clearly document primaryFilter and otherInfo value type

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563298#comment-14563298 ] Hudson commented on YARN-3723: -- FAILURE: Integrated in Hadoop-trunk-Commit #7916 (See

[jira] [Updated] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-05-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3585: - Attachment: YARN-3585.patch NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-05-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563404#comment-14563404 ] Chang Li commented on YARN-2556: [~sjlee0] Thanks so much for review and providing valuable

[jira] [Commented] (YARN-3721) build is broken on YARN-2928 branch due to possible dependency cycle

2015-05-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563475#comment-14563475 ] Sangjin Lee commented on YARN-3721: --- Another note: I see that there are used but

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-05-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563268#comment-14563268 ] Zhijie Shen commented on YARN-3725: --- [~jeagles], would you please take a look at this

[jira] [Updated] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2900: -- Target Version/s: (was: 2.6.1) Application (Attempt and Container) Not Found in AHS results in

[jira] [Commented] (YARN-3721) build is broken on YARN-2928 branch due to possible dependency cycle

2015-05-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563422#comment-14563422 ] Sangjin Lee commented on YARN-3721: --- I'll commit it if I don't hear from anyone in the

[jira] [Updated] (YARN-2556) Tool to measure the performance of the timeline server

2015-05-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-2556: --- Attachment: YARN-2556.11.patch Tool to measure the performance of the timeline server

[jira] [Commented] (YARN-3721) build is broken on YARN-2928 branch due to possible dependency cycle

2015-05-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563415#comment-14563415 ] Li Lu commented on YARN-3721: - Since YARN-3726 is in, maybe we can commit this one soon?

[jira] [Commented] (YARN-3723) Need to clearly document primaryFilter and otherInfo value type

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563282#comment-14563282 ] Xuan Gong commented on YARN-3723: - Committed into trunk/branch-2/branch-2.7. Thanks, zhijie

[jira] [Commented] (YARN-3518) default rm/am expire interval should not less than default resourcemanager connect wait time

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563322#comment-14563322 ] Hadoop QA commented on YARN-3518: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3723) Need to clearly document primaryFilter and otherInfo value type

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563272#comment-14563272 ] Xuan Gong commented on YARN-3723: - +1 lgtm. Will commit Need to clearly document

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563474#comment-14563474 ] Hadoop QA commented on YARN-3585: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

2015-05-28 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Shahid Khan updated YARN-3017: --- Attachment: YARN-3017.patch Please find the fix in the attached patch ContainerID in

[jira] [Updated] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2900: -- Target Version/s: 2.7.1 Application (Attempt and Container) Not Found in AHS results in Internal

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563296#comment-14563296 ] Zhijie Shen commented on YARN-2900: --- [~mitdesai], are you still working on this jira? Any

[jira] [Updated] (YARN-2573) Integrate ReservationSystem with the RM failover mechanism

2015-05-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2573: - Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-2572) Integrate

[jira] [Updated] (YARN-3560) Not able to navigate to the cluster from tracking url (proxy) generated after submission of job

2015-05-28 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Shahid Khan updated YARN-3560: --- Attachment: YARN-3560.patch The same implementation is already done. Attaching the

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564218#comment-14564218 ] Devaraj K commented on YARN-3733: - Thanks [~bibinchundatt], [~rohithsharma] and [~sunilg]

[jira] [Updated] (YARN-3705) forcemanual transitionToStandby in RM-HA automatic-failover mode should change elector state

2015-05-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3705: --- Description: Executing {{rmadmin -transitionToStandby --forcemanual}} in

[jira] [Commented] (YARN-3722) Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils

2015-05-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563955#comment-14563955 ] Masatake Iwasaki commented on YARN-3722: Thanks, [~devaraj.k]. Merge multiple

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-28 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564039#comment-14564039 ] Xianyin Xin commented on YARN-3547: --- Thanks [~kasha], [~leftnoteasy]. [~kasha], do you

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-05-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564091#comment-14564091 ] Robert Kanter commented on YARN-3528: - I don't think we can simply put 0 everywhere.

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-28 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564128#comment-14564128 ] Karthik Kambatla commented on YARN-3547: Per recent discussion, let us go with the

[jira] [Updated] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3740: Attachment: YARN-3740.1.patch trivial patch without testcases Fixed the typo with the configuration name:

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563934#comment-14563934 ] Wangda Tan commented on YARN-3547: -- I'm fine with the approach suggested by [~kasha].

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.2.patch Create an extension of ProportionalCapacityPreemptionPolicy which

[jira] [Updated] (YARN-3705) forcemanual transitionToStandby in RM-HA automatic-failover mode should change elector state

2015-05-28 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3705: --- Summary: forcemanual transitionToStandby in RM-HA automatic-failover mode should change

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564007#comment-14564007 ] Hadoop QA commented on YARN-3508: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3218) Implement ConcatenatableAggregatedLogFormat Reader and Writer

2015-05-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-3218: Attachment: YARN-3218.002.patch The 002 patch adds the {{ConcatenatableAggregatedLogFormat}} Reader

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-05-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564006#comment-14564006 ] Naganarasimha G R commented on YARN-3044: - Hi [~zjshen], Seems like test case

[jira] [Commented] (YARN-3218) Implement ConcatenatableAggregatedLogFormat Reader and Writer

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564062#comment-14564062 ] Hadoop QA commented on YARN-3218: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564107#comment-14564107 ] Hadoop QA commented on YARN-3510: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3723) Need to clearly document primaryFilter and otherInfo value type

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563918#comment-14563918 ] Hudson commented on YARN-3723: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #200 (See

[jira] [Updated] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3740: Labels: (was: new) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

[jira] [Updated] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3740: Labels: new (was: ) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.3.patch Remove some unnecessary changes to other preemption tests introduced while

[jira] [Updated] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3733: - Attachment: YARN-3733.patch On RM restart AM getting more than maximum possible memory when many tasks in

[jira] [Updated] (YARN-3690) 'mvn site' fails on JDK8

2015-05-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3690: --- Attachment: YARN-3690-002.patch 'mvn site' fails on JDK8

[jira] [Updated] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3740: Description: YARN-3700 introduces a new configuration named APPLICATION_HISTORY_PREFIX_MAX_APPS, which need

[jira] [Updated] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3740: Summary: Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS (was: fix the type

[jira] [Created] (YARN-3740) fix the type of configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-3740: --- Summary: fix the type of configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS Key: YARN-3740 URL: https://issues.apache.org/jira/browse/YARN-3740 Project: Hadoop YARN

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564031#comment-14564031 ] Robert Kanter commented on YARN-3713: - +1 Remove duplicate function call

[jira] [Commented] (YARN-3690) 'mvn site' fails on JDK8

2015-05-28 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564095#comment-14564095 ] Akira AJISAKA commented on YARN-3690: - Thanks [~brahmareddy] for taking this issue.

[jira] [Commented] (YARN-3716) Node-label-expression should be included by ResourceRequestPBImpl.toString

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564001#comment-14564001 ] Hudson commented on YARN-3716: -- FAILURE: Integrated in Hadoop-trunk-Commit #7922 (See

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564110#comment-14564110 ] Hadoop QA commented on YARN-3510: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3733: - Attachment: (was: YARN-3733.patch) On RM restart AM getting more than maximum possible memory when many

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564003#comment-14564003 ] Hadoop QA commented on YARN-3740: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-05-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564014#comment-14564014 ] Vrushali C commented on YARN-3044: -- Hi [~Naganarasimha Garla] bq. Test code failure in

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.5.patch Found a couple little missed things improved documentation of the new

[jira] [Commented] (YARN-3558) Additional containers getting reserved from RM in case of Fair scheduler

2015-05-28 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564112#comment-14564112 ] Xianyin Xin commented on YARN-3558: --- By check the log, i think i found the cause. First

[jira] [Commented] (YARN-3690) 'mvn site' fails on JDK8

2015-05-28 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564147#comment-14564147 ] Brahma Reddy Battula commented on YARN-3690: [~ajisakaa] updated the

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563983#comment-14563983 ] Craig Welch commented on YARN-3510: --- The attached patch supports an optional

[jira] [Updated] (YARN-2556) Tool to measure the performance of the timeline server

2015-05-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-2556: --- Attachment: YARN-2556.12.patch Tool to measure the performance of the timeline server

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-28 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564211#comment-14564211 ] Xianyin Xin commented on YARN-3547: --- Sorry [~kasha], i correct the comment in

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564248#comment-14564248 ] Hadoop QA commented on YARN-3510: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-28 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564204#comment-14564204 ] Xianyin Xin commented on YARN-3547: --- Sorry [~kasha], i misunderstood the discussion.

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-05-28 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564205#comment-14564205 ] Chang Li commented on YARN-2556: [~sjlee0] Thanks so much for patiently guiding me to

[jira] [Updated] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-28 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3547: -- Attachment: YARN-3547.006.patch Upload YARN-3547.006.patch. FairScheduler: Apps that have no resource

[jira] [Created] (YARN-3741) consider nulling member maps/sets of TimelineEntity

2015-05-28 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-3741: - Summary: consider nulling member maps/sets of TimelineEntity Key: YARN-3741 URL: https://issues.apache.org/jira/browse/YARN-3741 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3690) 'mvn site' fails on JDK8

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564192#comment-14564192 ] Hadoop QA commented on YARN-3690: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-05-28 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3510: -- Attachment: YARN-3510.6.patch Ran all of the tests listed as failing or timing out on my box with the

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564163#comment-14564163 ] Hadoop QA commented on YARN-3733: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3699) Decide if flow version should be part of row key or column

2015-05-28 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564216#comment-14564216 ] Vrushali C commented on YARN-3699: -- Hi [~djp], Wanted to check in and see if you got a

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-05-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562380#comment-14562380 ] Varun Saxena commented on YARN-3051: Thanks for the replies. [Storage abstraction]

[jira] [Commented] (YARN-3721) build is broken on YARN-2928 branch due to possible dependency cycle

2015-05-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562367#comment-14562367 ] Sangjin Lee commented on YARN-3721: --- See

[jira] [Created] (YARN-3732) Change NodeHeartbeatResponse.java and RegisterNodeManagerResponse.java as abstract classes

2015-05-28 Thread Devaraj K (JIRA)
Devaraj K created YARN-3732: --- Summary: Change NodeHeartbeatResponse.java and RegisterNodeManagerResponse.java as abstract classes Key: YARN-3732 URL: https://issues.apache.org/jira/browse/YARN-3732

[jira] [Updated] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3733: --- Affects Version/s: 2.7.0 On RM restart AM getting more than maximum possible memory when

[jira] [Assigned] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-3733: Assignee: Rohith On RM restart AM getting more than maximum possible memory when many tasks in queue

[jira] [Created] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3733: -- Summary: On RM restart AM getting more than maximum possible memory when many tasks in queue Key: YARN-3733 URL: https://issues.apache.org/jira/browse/YARN-3733

[jira] [Commented] (YARN-3721) build is broken on YARN-2928 branch due to possible dependency cycle

2015-05-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562353#comment-14562353 ] Zhijie Shen commented on YARN-3721: --- +1 for the approach. BTW, there always exists a

[jira] [Commented] (YARN-3066) Hadoop leaves orphaned tasks running after job is killed

2015-05-28 Thread Alan Burlison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562618#comment-14562618 ] Alan Burlison commented on YARN-3066: - Bugtraq is long gone, everything is now in the

[jira] [Created] (YARN-3735) Retain JRE Fatal error logs upon container failure

2015-05-28 Thread Srikanth Sundarrajan (JIRA)
Srikanth Sundarrajan created YARN-3735: -- Summary: Retain JRE Fatal error logs upon container failure Key: YARN-3735 URL: https://issues.apache.org/jira/browse/YARN-3735 Project: Hadoop YARN

[jira] [Commented] (YARN-3722) Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562750#comment-14562750 ] Hudson commented on YARN-3722: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Commented] (YARN-3581) Deprecate -directlyAccessNodeLabelStore in RMAdminCLI

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562746#comment-14562746 ] Hudson commented on YARN-3581: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Commented] (YARN-2355) MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562748#comment-14562748 ] Hudson commented on YARN-2355: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #941 (See

[jira] [Updated] (YARN-3722) Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils

2015-05-28 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3722: Summary: Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils (was: Merge

[jira] [Created] (YARN-3734) Force dirhandler.checkDirs() when there is a localization failure

2015-05-28 Thread Lavkesh Lahngir (JIRA)
Lavkesh Lahngir created YARN-3734: - Summary: Force dirhandler.checkDirs() when there is a localization failure Key: YARN-3734 URL: https://issues.apache.org/jira/browse/YARN-3734 Project: Hadoop YARN

[jira] [Commented] (YARN-3733) On RM restart AM getting more than maximum possible memory when many tasks in queue

2015-05-28 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562622#comment-14562622 ] Rohith commented on YARN-3733: -- Verified the RM logs from [~bibinchundatt] offline. The

[jira] [Commented] (YARN-3581) Deprecate -directlyAccessNodeLabelStore in RMAdminCLI

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562664#comment-14562664 ] Hudson commented on YARN-3581: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

[jira] [Commented] (YARN-2355) MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562666#comment-14562666 ] Hudson commented on YARN-2355: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

[jira] [Commented] (YARN-3626) On Windows localized resources are not moved to the front of the classpath when they should be

2015-05-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14562674#comment-14562674 ] Hudson commented on YARN-3626: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #211 (See

  1   2   >