[jira] [Commented] (YARN-473) Capacity Scheduler webpage and REST API not showing correct number of pending applications

2015-08-06 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/YARN-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659695#comment-14659695 ] Raju Bairishetti commented on YARN-473: --- REST API is showing wrong number of pending a

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659706#comment-14659706 ] Sunil G commented on YARN-3992: --- Thank you [~rohithsharma] for the review and commit.! > Tes

[jira] [Updated] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3948: -- Attachment: 0005-YARN-3948.patch Thanks [~rohithsharma]. Uploading a new patch after changing documentation part

[jira] [Created] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-08-06 Thread forrestchen (JIRA)
forrestchen created YARN-4022: - Summary: queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml Key: YARN-4022 URL: https://issues.apache.org/jira/browse/YARN-4022 Projec

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-08-06 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Description: When I delete an existing queue by modify the xxx-schedule.xml, I can still see the queue i

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659829#comment-14659829 ] Junping Du commented on YARN-3045: -- The Jenkins test wasn't triggered for some reason. Man

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659937#comment-14659937 ] Junping Du commented on YARN-3045: -- bq. The first patch was put up in April and later vers

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659943#comment-14659943 ] Hadoop QA commented on YARN-3948: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659994#comment-14659994 ] Hudson commented on YARN-3983: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See [https://

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659993#comment-14659993 ] Hudson commented on YARN-3992: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See [https://

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659989#comment-14659989 ] Hudson commented on YARN-3961: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See [https://

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659985#comment-14659985 ] Hudson commented on YARN-3736: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1009 (See [https://

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660015#comment-14660015 ] Junping Du commented on YARN-4019: -- +1. 03 patch LGTM. Committing it in. > Add JvmPauseMo

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660027#comment-14660027 ] Hudson commented on YARN-3983: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #279 (See [htt

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660022#comment-14660022 ] Hudson commented on YARN-3961: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #279 (See [htt

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660026#comment-14660026 ] Hudson commented on YARN-3992: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #279 (See [htt

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660018#comment-14660018 ] Hudson commented on YARN-3736: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #279 (See [htt

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660031#comment-14660031 ] Hadoop QA commented on YARN-3045: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660190#comment-14660190 ] Hudson commented on YARN-4019: -- FAILURE: Integrated in Hadoop-trunk-Commit #8272 (See [https:

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660264#comment-14660264 ] Hudson commented on YARN-3992: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See [https://

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660260#comment-14660260 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See [https://

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660256#comment-14660256 ] Hudson commented on YARN-3736: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See [https://

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660265#comment-14660265 ] Hudson commented on YARN-3983: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2206 (See [https://

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660300#comment-14660300 ] Hudson commented on YARN-3983: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See [htt

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660295#comment-14660295 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See [htt

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660291#comment-14660291 ] Hudson commented on YARN-3736: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See [htt

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660299#comment-14660299 ] Hudson commented on YARN-3992: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #268 (See [htt

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660306#comment-14660306 ] Junping Du commented on YARN-3011: -- Thanks [~varun_saxena] and all for fixing this issue.

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660320#comment-14660320 ] Karthik Kambatla commented on YARN-3176: Using the instantaneous fairshare might be

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660326#comment-14660326 ] Sunil G commented on YARN-3948: --- When I open the FindBugs report, its shows 0 warning. Hence

[jira] [Created] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Sunil G (JIRA)
Sunil G created YARN-4023: - Summary: Publish Application Priority to TimelineServer Key: YARN-4023 URL: https://issues.apache.org/jira/browse/YARN-4023 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660404#comment-14660404 ] Ashwin Shankar commented on YARN-2098: -- [~sunilg], I saw that couple of tickets under

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-08-06 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v5.patch This is the latest revised patch. A messageReceived() call uses two counte

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660415#comment-14660415 ] Bikas Saha commented on YARN-3736: -- Sounds good! > Add RMStateStore apis to store and loa

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660444#comment-14660444 ] Sangjin Lee commented on YARN-3049: --- The latest patch (v.7) looks good to me. Which time

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660436#comment-14660436 ] Robert Kanter commented on YARN-4019: - Thanks for the review [~djp] > Add JvmPauseMoni

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660457#comment-14660457 ] Sunil G commented on YARN-2098: --- Hi [~ashwinshankar77] Yes. YARN-2003 is committed. It has ch

[jira] [Commented] (YARN-3993) Change to use the AM flag in ContainerContext determine AM container

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660479#comment-14660479 ] Sunil G commented on YARN-3993: --- Thank you [~zjshen] for review commit! > Change to use the

[jira] [Resolved] (YARN-3167) [Collector implementation] Implement the core functionality of the timeline collector

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C resolved YARN-3167. -- Resolution: Invalid I think this jira is outdated now. The functionality of the Timeline Collector has

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-08-06 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660496#comment-14660496 ] Kuhu Shukla commented on YARN-2410: --- Requesting [~nroberts] and [~jlowe] to review the r

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660512#comment-14660512 ] Hudson commented on YARN-4019: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660510#comment-14660510 ] Hudson commented on YARN-3992: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660511#comment-14660511 ] Hudson commented on YARN-3983: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660505#comment-14660505 ] Hudson commented on YARN-3961: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660501#comment-14660501 ] Hudson commented on YARN-3736: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660517#comment-14660517 ] Carlo Curino commented on YARN-3974: +1. I committed this to trunk and branch-2. Thanks

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660522#comment-14660522 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660518#comment-14660518 ] Hudson commented on YARN-3736: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660529#comment-14660529 ] Hudson commented on YARN-4019: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660527#comment-14660527 ] Hudson commented on YARN-3992: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660528#comment-14660528 ] Hudson commented on YARN-3983: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660531#comment-14660531 ] Anubhav Dhoot commented on YARN-3961: - Thanks [~asuresh] for review and commit! > Expo

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660538#comment-14660538 ] Hudson commented on YARN-3974: -- FAILURE: Integrated in Hadoop-trunk-Commit #8275 (See [https:

[jira] [Created] (YARN-4024) YARN RM should avoid resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4024: Summary: YARN RM should avoid resolving IP when NMs doing heartbeat Key: YARN-4024 URL: https://issues.apache.org/jira/browse/YARN-4024 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660541#comment-14660541 ] Subru Krishnan commented on YARN-3974: -- Thanks [~adhoot] for all the feedback and [~cu

[jira] [Commented] (YARN-4024) YARN RM should avoid resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660546#comment-14660546 ] Wangda Tan commented on YARN-4024: -- Actually, there're two problems we need to solve: 1. D

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4024: - Summary: YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat (was: YARN RM should avoid

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660559#comment-14660559 ] Sunil G commented on YARN-4024: --- Hi [~leftnoteasy] Thank you for bringing this, which is a po

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660570#comment-14660570 ] zhihai xu commented on YARN-4024: - Does this issue duplicate with YARN-4001? > YARN RM sho

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660583#comment-14660583 ] Wangda Tan commented on YARN-4024: -- [~sunilg], Thanks for comment, I'm not sure what's the

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660587#comment-14660587 ] Wangda Tan commented on YARN-4024: -- Thanks for pointing YARN-4001, yes, they're same issue

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4024: - Assignee: (was: Wangda Tan) > YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat >

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660592#comment-14660592 ] Hadoop QA commented on YARN-2410: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Resolved] (YARN-4001) normalizeHostName takes too much of execution time

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-4001. -- Resolution: Duplicate [~zhiguohong], I found this issue after filed YARN-4024, since we have some discus

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660595#comment-14660595 ] Wangda Tan commented on YARN-4024: -- [~zhiguohong], I noticed YARN-4001 after filed YARN-40

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660598#comment-14660598 ] Ashwin Shankar commented on YARN-3176: -- I believe [~ka...@cloudera.com] is right about

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660603#comment-14660603 ] Ashwin Shankar commented on YARN-3176: -- Sry, in my comment above I missed a closing ""

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660602#comment-14660602 ] Sunil G commented on YARN-4024: --- Thanks [~leftnoteasy] for sharing detailed case. Yes, what

[jira] [Assigned] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4003: -- Assignee: Carlo Curino > ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behav

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660607#comment-14660607 ] Wangda Tan commented on YARN-4024: -- Thanks for sharing your thoughts, [~sunilg]. I think w

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660608#comment-14660608 ] Wangda Tan commented on YARN-4003: -- [~curino]. It makes sense to me, hope we can get some

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660619#comment-14660619 ] Sunil G commented on YARN-4024: --- +1. Yes. That will be fine. I feel we can keep unit as mins

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660621#comment-14660621 ] Ashwin Shankar commented on YARN-2098: -- Thanks [~sunilg] ! Hey [~ywskycn], when you ge

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660626#comment-14660626 ] Wei Yan commented on YARN-2098: --- [~sunilg], [~ashwinshankar77]. Sure, will rebase a new one.

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660638#comment-14660638 ] Naganarasimha G R commented on YARN-3045: - Hi All, bq. I appreciate Naganarasimha G

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660651#comment-14660651 ] Siqi Li commented on YARN-3176: --- [~ashwinshankar77], I don't think the sample alloc is a good

[jira] [Commented] (YARN-3526) ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660686#comment-14660686 ] Siqi Li commented on YARN-3526: --- The latest patch can be applied to 2.6.0 branch cleanly > A

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660689#comment-14660689 ] Siqi Li commented on YARN-2414: --- The latest patch can be applied to 2.6.0 branch cleanly > R

[jira] [Commented] (YARN-2997) NM keeps sending already-sent completed containers to RM until containers are removed from context

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660692#comment-14660692 ] Siqi Li commented on YARN-2997: --- The latest patch can be applied to 2.6.0 branch cleanly > N

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660694#comment-14660694 ] Siqi Li commented on YARN-3094: --- The latest patch can be applied to 2.6.0 branch cleanly > r

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660701#comment-14660701 ] Siqi Li commented on YARN-3485: --- The latest patch can be applied to 2.6.0 branch cleanly > F

[jira] [Commented] (YARN-3641) NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services.

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660704#comment-14660704 ] Siqi Li commented on YARN-3641: --- The latest patch can be applied to 2.6.0 branch cleanly > N

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660760#comment-14660760 ] Ashwin Shankar commented on YARN-3176: -- [~l201514], Just trying to understand, what is

[jira] [Updated] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3966: -- Attachment: YARN-3966.1.patch > Fix excessive loggings in CapacityScheduler > ---

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660768#comment-14660768 ] Jian He commented on YARN-3966: --- I went through the code path and cleaned up some logs as nee

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660770#comment-14660770 ] Xuan Gong commented on YARN-3966: - Instead of removing the logs, change the log level from

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.008.patch v008 patch, rebase to latest YARN-2928 branch. > Refactor timelineservice

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660787#comment-14660787 ] Siqi Li commented on YARN-3176: --- One example could be queueMaxAppsDefault is set to 50, and "

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660790#comment-14660790 ] Carlo Curino commented on YARN-4003: [~leftnoteasy], just to be clear with "it makes se

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660819#comment-14660819 ] Jian He commented on YARN-3966: --- The logs I removed are redundant logs with others. Apart fro

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660820#comment-14660820 ] Wangda Tan commented on YARN-3966: -- Patch LGTM, +1. > Fix excessive loggings in CapacityS

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660826#comment-14660826 ] Li Lu commented on YARN-3906: - Hi [~sjlee0], sorry about the delay. The latest patch LGTM, howe

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660851#comment-14660851 ] Wangda Tan commented on YARN-4003: -- [~curino], sorry for confusing you. +1 for attached

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660852#comment-14660852 ] Wangda Tan commented on YARN-4003: -- And do you think we need add a max-am-percent to PlanQ

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660853#comment-14660853 ] Zhijie Shen commented on YARN-3049: --- Here's a quick example: {code} @Test public void

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660859#comment-14660859 ] Ashwin Shankar commented on YARN-3176: -- bq. In this case, MaxRunningAppEnforcer could

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660867#comment-14660867 ] Vrushali C commented on YARN-3049: -- Hi [~zjshen] In my experience, that kind of conversion

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660877#comment-14660877 ] Li Lu commented on YARN-3049: - Hi [~vrushalic], I think the conversion to string happens on the

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660895#comment-14660895 ] Siqi Li commented on YARN-3176: --- Considering an other example, grandparent -> parent -> child

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660902#comment-14660902 ] Li Lu commented on YARN-3049: - A little bit more investigation shows that we're using Strings f

  1   2   >