[jira] [Commented] (YARN-3651) Support SSL for AM webapp

2015-08-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661398#comment-14661398 ] Varun Saxena commented on YARN-3651: Moving the issue to MAPREDUCE > Support SSL for A

[jira] [Updated] (YARN-4013) Publisher V2 should write the unmanaged AM flag and application priority

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4013: -- Description: Upon rebase the branch, I find we need to redo the similar work for V2 publisher: https://issues.a

[jira] [Updated] (YARN-4013) Publisher V2 should write the unmanaged AM flag and application priority

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4013: -- Summary: Publisher V2 should write the unmanaged AM flag and application priority (was: Publisher V2 should writ

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Attachment: YARN-4026.1.patch Attached initial patch to be reviewed. > FiCaSchedulerApp: ContainerAllocato

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Description: After YARN-3983, we have an extensible ContainerAllocator which can be used by FiCaSchedulerA

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: Revisit ContainerAllocator interface design

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Description: After YARN-3983, we have an extensible ContainerAllocator which can be used by FiCaSchedulerA

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Summary: FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource reques

[jira] [Created] (YARN-4026) FiCaSchedulerApp: Revisit ContainerAllocator interface design

2015-08-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4026: Summary: FiCaSchedulerApp: Revisit ContainerAllocator interface design Key: YARN-4026 URL: https://issues.apache.org/jira/browse/YARN-4026 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661345#comment-14661345 ] Rohith Sharma K S commented on YARN-3948: - Thanks [~jianhe] for review!! > Display

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661343#comment-14661343 ] Hudson commented on YARN-3948: -- FAILURE: Integrated in Hadoop-trunk-Commit #8277 (See [https:

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661315#comment-14661315 ] Jian He commented on YARN-3948: --- looks good to me too. thanks [~sunilg] and [~rohithsharma] !

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661314#comment-14661314 ] Rohith Sharma K S commented on YARN-4023: - I mean Jira summary and description. >

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661313#comment-14661313 ] Vrushali C commented on YARN-3049: -- Filed https://issues.apache.org/jira/browse/YARN-4025

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661312#comment-14661312 ] Rohith Sharma K S commented on YARN-4023: - Thats fine.. YARN-4013 ticket can be upd

[jira] [Created] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-06 Thread Vrushali C (JIRA)
Vrushali C created YARN-4025: Summary: Deal with byte representations of Longs in writer code Key: YARN-4025 URL: https://issues.apache.org/jira/browse/YARN-4025 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661310#comment-14661310 ] Sunil G commented on YARN-4023: --- Thanks [~rohithsharma]. I planned this one for Timeline V1.

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661298#comment-14661298 ] Rohith Sharma K S commented on YARN-4023: - [~sunilg] Does this JIRA handles for V1

[jira] [Commented] (YARN-3948) Display Application Priority in RM Web UI

2015-08-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661286#comment-14661286 ] Rohith Sharma K S commented on YARN-3948: - latest patch looks good to me.. I will c

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661251#comment-14661251 ] Siqi Li commented on YARN-3176: --- That makes sense. If you feel like this change is unnecessar

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661186#comment-14661186 ] Sunil G commented on YARN-4003: --- HI [~curino] [~leftnoteasy] Sorry for coming in this late.

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661154#comment-14661154 ] Hadoop QA commented on YARN-3906: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661153#comment-14661153 ] Ashwin Shankar commented on YARN-3176: -- It depends on the use case, if a user has lots

[jira] [Commented] (YARN-221) NM should provide a way for AM to tell it not to aggregate logs.

2015-08-06 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661140#comment-14661140 ] Ming Ma commented on YARN-221: -- My main motivation of reusing ContainerTerminationContext is to

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661124#comment-14661124 ] Hadoop QA commented on YARN-3966: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-221) NM should provide a way for AM to tell it not to aggregate logs.

2015-08-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661122#comment-14661122 ] Xuan Gong commented on YARN-221: Looks like ContainerTerminationContext is for AuxiliarySer

[jira] [Updated] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3906: -- Attachment: YARN-3906-YARN-2928.005.patch v.5 patch posted. Adjusted for YARN-3984. Also updated the tab

[jira] [Resolved] (YARN-4016) docker container is still running when app is killed

2015-08-06 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved YARN-4016. Resolution: Duplicate Hong! Please reopen if you find that it hasn't been fixed in trunk > docker co

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661106#comment-14661106 ] Sangjin Lee commented on YARN-3906: --- I'll update the patch shortly. However, I think YARN

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661086#comment-14661086 ] Hadoop QA commented on YARN-3904: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661012#comment-14661012 ] Sangjin Lee commented on YARN-3049: --- Yes, +1 with proceeding with this patch and addressi

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661007#comment-14661007 ] Li Lu commented on YARN-3049: - I checked EntityRowKey.java and seems like we never convert flow

[jira] [Commented] (YARN-3962) If we change node manager identity to run as virtual account, then resource localization service fails to start with incorrect permission

2015-08-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661004#comment-14661004 ] Chris Nauroth commented on YARN-3962: - This looks good to me. I agree with Xuan that i

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660991#comment-14660991 ] Vrushali C commented on YARN-3049: -- bq. I'm worried that Bytes.toString() doesn't make the

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660987#comment-14660987 ] Vrushali C commented on YARN-3049: -- Yes I will take that jira up. > [Storage Implementa

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660952#comment-14660952 ] Zhijie Shen commented on YARN-3049: --- As the issue is not blocking the whole reader implem

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660948#comment-14660948 ] Siqi Li commented on YARN-3176: --- for that, we can maybe introduce something like a "default"

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660935#comment-14660935 ] Li Lu commented on YARN-3049: - bq. Also, to Li Lu's point, we should provide an additional api

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2015-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660930#comment-14660930 ] Junping Du commented on YARN-3223: -- Hi [~brookz], I think [~varun_saxena] hasn't start eff

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660925#comment-14660925 ] Ashwin Shankar commented on YARN-3176: -- Yes, this is valid case when inheriting would

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660923#comment-14660923 ] Vrushali C commented on YARN-3049: -- It looks like the conversion back to String was done t

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660902#comment-14660902 ] Li Lu commented on YARN-3049: - A little bit more investigation shows that we're using Strings f

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660895#comment-14660895 ] Siqi Li commented on YARN-3176: --- Considering an other example, grandparent -> parent -> child

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660877#comment-14660877 ] Li Lu commented on YARN-3049: - Hi [~vrushalic], I think the conversion to string happens on the

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660867#comment-14660867 ] Vrushali C commented on YARN-3049: -- Hi [~zjshen] In my experience, that kind of conversion

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660859#comment-14660859 ] Ashwin Shankar commented on YARN-3176: -- bq. In this case, MaxRunningAppEnforcer could

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660853#comment-14660853 ] Zhijie Shen commented on YARN-3049: --- Here's a quick example: {code} @Test public void

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660852#comment-14660852 ] Wangda Tan commented on YARN-4003: -- And do you think we need add a max-am-percent to PlanQ

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660851#comment-14660851 ] Wangda Tan commented on YARN-4003: -- [~curino], sorry for confusing you. +1 for attached

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660826#comment-14660826 ] Li Lu commented on YARN-3906: - Hi [~sjlee0], sorry about the delay. The latest patch LGTM, howe

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660820#comment-14660820 ] Wangda Tan commented on YARN-3966: -- Patch LGTM, +1. > Fix excessive loggings in CapacityS

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660819#comment-14660819 ] Jian He commented on YARN-3966: --- The logs I removed are redundant logs with others. Apart fro

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660790#comment-14660790 ] Carlo Curino commented on YARN-4003: [~leftnoteasy], just to be clear with "it makes se

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660787#comment-14660787 ] Siqi Li commented on YARN-3176: --- One example could be queueMaxAppsDefault is set to 50, and "

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.008.patch v008 patch, rebase to latest YARN-2928 branch. > Refactor timelineservice

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660770#comment-14660770 ] Xuan Gong commented on YARN-3966: - Instead of removing the logs, change the log level from

[jira] [Commented] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660768#comment-14660768 ] Jian He commented on YARN-3966: --- I went through the code path and cleaned up some logs as nee

[jira] [Updated] (YARN-3966) Fix excessive loggings in CapacityScheduler

2015-08-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3966: -- Attachment: YARN-3966.1.patch > Fix excessive loggings in CapacityScheduler > ---

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660760#comment-14660760 ] Ashwin Shankar commented on YARN-3176: -- [~l201514], Just trying to understand, what is

[jira] [Commented] (YARN-3641) NodeManager: stopRecoveryStore() shouldn't be skipped when exceptions happen in stopping NM's sub-services.

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660704#comment-14660704 ] Siqi Li commented on YARN-3641: --- The latest patch can be applied to 2.6.0 branch cleanly > N

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660701#comment-14660701 ] Siqi Li commented on YARN-3485: --- The latest patch can be applied to 2.6.0 branch cleanly > F

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660694#comment-14660694 ] Siqi Li commented on YARN-3094: --- The latest patch can be applied to 2.6.0 branch cleanly > r

[jira] [Commented] (YARN-2997) NM keeps sending already-sent completed containers to RM until containers are removed from context

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660692#comment-14660692 ] Siqi Li commented on YARN-2997: --- The latest patch can be applied to 2.6.0 branch cleanly > N

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660689#comment-14660689 ] Siqi Li commented on YARN-2414: --- The latest patch can be applied to 2.6.0 branch cleanly > R

[jira] [Commented] (YARN-3526) ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660686#comment-14660686 ] Siqi Li commented on YARN-3526: --- The latest patch can be applied to 2.6.0 branch cleanly > A

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660651#comment-14660651 ] Siqi Li commented on YARN-3176: --- [~ashwinshankar77], I don't think the sample alloc is a good

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-06 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660638#comment-14660638 ] Naganarasimha G R commented on YARN-3045: - Hi All, bq. I appreciate Naganarasimha G

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660626#comment-14660626 ] Wei Yan commented on YARN-2098: --- [~sunilg], [~ashwinshankar77]. Sure, will rebase a new one.

[jira] [Commented] (YARN-2098) App priority support in Fair Scheduler

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660621#comment-14660621 ] Ashwin Shankar commented on YARN-2098: -- Thanks [~sunilg] ! Hey [~ywskycn], when you ge

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660619#comment-14660619 ] Sunil G commented on YARN-4024: --- +1. Yes. That will be fine. I feel we can keep unit as mins

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660608#comment-14660608 ] Wangda Tan commented on YARN-4003: -- [~curino]. It makes sense to me, hope we can get some

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660607#comment-14660607 ] Wangda Tan commented on YARN-4024: -- Thanks for sharing your thoughts, [~sunilg]. I think w

[jira] [Assigned] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4003: -- Assignee: Carlo Curino > ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behav

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660602#comment-14660602 ] Sunil G commented on YARN-4024: --- Thanks [~leftnoteasy] for sharing detailed case. Yes, what

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660603#comment-14660603 ] Ashwin Shankar commented on YARN-3176: -- Sry, in my comment above I missed a closing ""

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-08-06 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660598#comment-14660598 ] Ashwin Shankar commented on YARN-3176: -- I believe [~ka...@cloudera.com] is right about

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660595#comment-14660595 ] Wangda Tan commented on YARN-4024: -- [~zhiguohong], I noticed YARN-4001 after filed YARN-40

[jira] [Resolved] (YARN-4001) normalizeHostName takes too much of execution time

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-4001. -- Resolution: Duplicate [~zhiguohong], I found this issue after filed YARN-4024, since we have some discus

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-08-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660592#comment-14660592 ] Hadoop QA commented on YARN-2410: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4024: - Assignee: (was: Wangda Tan) > YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat >

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660587#comment-14660587 ] Wangda Tan commented on YARN-4024: -- Thanks for pointing YARN-4001, yes, they're same issue

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660583#comment-14660583 ] Wangda Tan commented on YARN-4024: -- [~sunilg], Thanks for comment, I'm not sure what's the

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660570#comment-14660570 ] zhihai xu commented on YARN-4024: - Does this issue duplicate with YARN-4001? > YARN RM sho

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660559#comment-14660559 ] Sunil G commented on YARN-4024: --- Hi [~leftnoteasy] Thank you for bringing this, which is a po

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4024: - Summary: YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat (was: YARN RM should avoid

[jira] [Commented] (YARN-4024) YARN RM should avoid resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660546#comment-14660546 ] Wangda Tan commented on YARN-4024: -- Actually, there're two problems we need to solve: 1. D

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660541#comment-14660541 ] Subru Krishnan commented on YARN-3974: -- Thanks [~adhoot] for all the feedback and [~cu

[jira] [Created] (YARN-4024) YARN RM should avoid resolving IP when NMs doing heartbeat

2015-08-06 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4024: Summary: YARN RM should avoid resolving IP when NMs doing heartbeat Key: YARN-4024 URL: https://issues.apache.org/jira/browse/YARN-4024 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660538#comment-14660538 ] Hudson commented on YARN-3974: -- FAILURE: Integrated in Hadoop-trunk-Commit #8275 (See [https:

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660531#comment-14660531 ] Anubhav Dhoot commented on YARN-3961: - Thanks [~asuresh] for review and commit! > Expo

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660528#comment-14660528 ] Hudson commented on YARN-3983: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660527#comment-14660527 ] Hudson commented on YARN-3992: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660529#comment-14660529 ] Hudson commented on YARN-4019: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660518#comment-14660518 ] Hudson commented on YARN-3736: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660522#comment-14660522 ] Hudson commented on YARN-3961: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2225 (See [htt

[jira] [Commented] (YARN-3974) Refactor the reservation system test cases to use parameterized base test

2015-08-06 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660517#comment-14660517 ] Carlo Curino commented on YARN-3974: +1. I committed this to trunk and branch-2. Thanks

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660501#comment-14660501 ] Hudson commented on YARN-3736: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660511#comment-14660511 ] Hudson commented on YARN-3983: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3961) Expose pending, running and reserved containers of a queue in REST api and yarn top

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660505#comment-14660505 ] Hudson commented on YARN-3961: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660510#comment-14660510 ] Hudson commented on YARN-3992: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

[jira] [Commented] (YARN-4019) Add JvmPauseMonitor to ResourceManager and NodeManager

2015-08-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660512#comment-14660512 ] Hudson commented on YARN-4019: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #276 (See

  1   2   >