[jira] [Commented] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650147#comment-14650147 ] Hadoop QA commented on YARN-3978: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-07-31 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650049#comment-14650049 ] Sangjin Lee commented on YARN-3045: --- {quote} Sorry was not able to completely get it. Are

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650069#comment-14650069 ] Zhijie Shen commented on YARN-3904: --- bq. I'm not 100% sure if that's what we would like

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-07-31 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650076#comment-14650076 ] Sangjin Lee commented on YARN-3995: --- Let me give it some more thought. I'll chime in

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650082#comment-14650082 ] Zhijie Shen commented on YARN-4006: --- Sure, take your time. I'll cancel the patch until

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4006: -- Description: When attempting to use The Hadoop Alternate Authentication Classes. They do not exactly work with

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650092#comment-14650092 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-07-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3992: -- Attachment: 0002-YARN-3992.patch Thank you [~rohithsharma] for pointing out this. A slight modification is done

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650098#comment-14650098 ] Hadoop QA commented on YARN-3904: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650106#comment-14650106 ] Zhijie Shen commented on YARN-3049: --- What I meant before is that HBaseTimelineWriterImpl

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650114#comment-14650114 ] Hadoop QA commented on YARN-3049: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-07-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3978: - Attachment: YARN-3978.004.patch Thanks very much [~jeagles] for your review and comments. {quote} It is

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650066#comment-14650066 ] Greg Senia commented on YARN-4006: -- [~zjshen] I will be including the sample and abstract

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-31 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650075#comment-14650075 ] Sangjin Lee commented on YARN-3049: --- I thought that the application created event would

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-4006: -- Assignee: Greg Senia YARN ATS Alternate Kerberos HTTP Authentication Changes

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

2015-07-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-16.patch Fixing checkstyle Collect memory/cpu usage on the node

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650105#comment-14650105 ] Hadoop QA commented on YARN-3984: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649228#comment-14649228 ] Hudson commented on YARN-3971: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649232#comment-14649232 ] Hudson commented on YARN-433: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649225#comment-14649225 ] Hudson commented on YARN-433: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649273#comment-14649273 ] Hudson commented on YARN-3971: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649277#comment-14649277 ] Hudson commented on YARN-433: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649276#comment-14649276 ] Hudson commented on YARN-3963: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2200 (See

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649221#comment-14649221 ] Hudson commented on YARN-3971: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649224#comment-14649224 ] Hudson commented on YARN-3963: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #262 (See

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649231#comment-14649231 ] Hudson commented on YARN-3963: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2219 (See

[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore

2015-07-31 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649311#comment-14649311 ] Jun Gong commented on YARN-4005: NM only removes containers in 'recentlyStoppedContainers'

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649369#comment-14649369 ] zhihai xu commented on YARN-433: Thanks [~xgong] for the contribution! Thanks [~adhoot] for

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649381#comment-14649381 ] Hudson commented on YARN-3963: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-07-31 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649466#comment-14649466 ] Akira AJISAKA commented on YARN-3176: - +1 pending Jenkins.

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649382#comment-14649382 ] Hudson commented on YARN-433: - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649378#comment-14649378 ] Hudson commented on YARN-3971: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #270 (See

[jira] [Commented] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-07-31 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649403#comment-14649403 ] Jonathan Eagles commented on YARN-3978: --- [~eepayne], this patch looks mainly good.

[jira] [Commented] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649411#comment-14649411 ] Hadoop QA commented on YARN-4005: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore

2015-07-31 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4005: --- Attachment: YARN-4005.01.patch Completed container whose app is finished is not removed from NMStateStore

[jira] [Commented] (YARN-3026) Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

2015-07-31 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649321#comment-14649321 ] MENG DING commented on YARN-3026: - bq. In CS (before this patch), excessReservation won't

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-07-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649347#comment-14649347 ] Jason Lowe commented on YARN-3998: -- I think it's more effort for YARN to support this than

[jira] [Commented] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649542#comment-14649542 ] Hudson commented on YARN-3990: -- FAILURE: Integrated in Hadoop-trunk-Commit #8251 (See

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-1809: -- Labels: 2.6.1-candidate (was: ) Synchronize RM and Generic History Service Web-UIs

[jira] [Commented] (YARN-3945) maxApplicationsPerUser is wrongly calculated

2015-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649531#comment-14649531 ] Wangda Tan commented on YARN-3945: -- Thanks for comments, [~nroberts]! bq. I don't think

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649548#comment-14649548 ] Wangda Tan commented on YARN-4003: -- [~curino], is it possible to compute

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated YARN-4006: - Attachment: YARN-4006-branch2.6.0.patch YARN ATS Alternate Kerberos HTTP Authentication Changes

[jira] [Commented] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-07-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649516#comment-14649516 ] Jason Lowe commented on YARN-3990: -- +1 lgtm. Committing this. AsyncDispatcher may

[jira] [Updated] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-3287: -- Labels: 2.6.1-candidate (was: ) TimelineClient kerberos authentication failure uses wrong login

[jira] [Updated] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-3725: -- Labels: 2.6.1-candidate (was: ) App submission via REST API is broken in secure mode due to Timeline

[jira] [Updated] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

2015-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-3493: -- Labels: 2.6.1-candidate (was: ) RM fails to come up with error Failed to load/recover state when mem

[jira] [Updated] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-2900: -- Labels: 2.6.1-candidate (was: ) Application (Attempt and Container) Not Found in AHS results in

[jira] [Updated] (YARN-3267) Timelineserver applies the ACL rules after applying the limit on the number of records

2015-07-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-3267: -- Labels: 2.6.1-candidate (was: ) Timelineserver applies the ACL rules after applying the limit on the

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649598#comment-14649598 ] Zhijie Shen commented on YARN-3984: --- Sure, it's fine too. One question, do we make sure

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-31 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649601#comment-14649601 ] Vrushali C commented on YARN-3984: -- bq. One question, do we make sure every event has such

[jira] [Commented] (YARN-3176) In Fair Scheduler, child queue should inherit maxApp from its parent

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649663#comment-14649663 ] Hadoop QA commented on YARN-3176: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649754#comment-14649754 ] Hadoop QA commented on YARN-3906: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-07-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649666#comment-14649666 ] Subru Krishnan commented on YARN-3736: -- Thanks [~asuresh] for reviewing the patch.

[jira] [Commented] (YARN-3026) Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

2015-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649560#comment-14649560 ] Wangda Tan commented on YARN-3026: -- bq. So there is no need for

[jira] [Created] (YARN-4007) Add support for different network setups when launching the docker container

2015-07-31 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4007: --- Summary: Add support for different network setups when launching the docker container Key: YARN-4007 URL: https://issues.apache.org/jira/browse/YARN-4007 Project:

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-31 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.006.patch Upload the 006 version of the patch. In this patch I addressed most of

[jira] [Updated] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3983: - Attachment: YARN-3983.3.patch Thanks for comments, [~jianhe], attached ver.3 patch. Make

[jira] [Updated] (YARN-3251) Fix CapacityScheduler deadlock when computing absolute max avail capacity (short term fix for 2.6.1)

2015-07-31 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3251: -- Labels: 2.6.1-candidate (was: ) Fix CapacityScheduler deadlock when computing absolute max avail

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-07-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648817#comment-14648817 ] Rohith Sharma K S commented on YARN-3543: - Thanks [~xgong] for identifying

[jira] [Commented] (YARN-4004) container-executor should print output of docker logs if the docker container exits with non-0 exit status

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648860#comment-14648860 ] Hadoop QA commented on YARN-4004: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-07-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-3543: Attachment: 0007-YARN-3543.patch ApplicationReport should be able to tell whether the

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-07-31 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648841#comment-14648841 ] Brahma Reddy Battula commented on YARN-3528: Will fix testcase failures and

[jira] [Updated] (YARN-4004) container-executor should print out of docker logs if the docker container exits with non-0 exit status

2015-07-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4004: Attachment: YARN-4004.001.patch Attached file with fix. The patch also fixes a bunch of compiler

[jira] [Created] (YARN-4004) container-executor should print out of docker logs if the docker container exits with non-0 exit status

2015-07-31 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4004: --- Summary: container-executor should print out of docker logs if the docker container exits with non-0 exit status Key: YARN-4004 URL: https://issues.apache.org/jira/browse/YARN-4004

[jira] [Commented] (YARN-3736) Add RMStateStore apis to store and load accepted reservations for failover

2015-07-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648831#comment-14648831 ] Arun Suresh commented on YARN-3736: --- The patch looks mostly good [~adhoot], Some minor

[jira] [Updated] (YARN-4004) container-executor should print output of docker logs if the docker container exits with non-0 exit status

2015-07-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4004: Summary: container-executor should print output of docker logs if the docker container exits with

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649107#comment-14649107 ] Hadoop QA commented on YARN-3887: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649129#comment-14649129 ] Hudson commented on YARN-3971: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649133#comment-14649133 ] Hudson commented on YARN-433: - SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649132#comment-14649132 ] Hudson commented on YARN-3963: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1003 (See

[jira] [Commented] (YARN-3983) Make CapacityScheduler to easier extend application allocation logic

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650128#comment-14650128 ] Hadoop QA commented on YARN-3983: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650130#comment-14650130 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore

2015-07-31 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4005: --- Description: If a container is completed and its corresponding app is finished, NM does not add it to ''NM

[jira] [Updated] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore

2015-07-31 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4005: --- Description: If a container is completed and its corresponding app is finished, NM only removes it from its

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650138#comment-14650138 ] Hadoop QA commented on YARN-3992: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-07-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649985#comment-14649985 ] Naganarasimha G R commented on YARN-3045: - Thanks [~sjlee0], for clarifying and

[jira] [Updated] (YARN-3984) Rethink event column key issue

2015-07-31 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3984: - Attachment: YARN-3984-YARN-2928.001.patch Attached patch v001 as per above discussions. One change is

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

2015-07-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-16.patch Solved most of [~kasha]'s comments. Collect memory/cpu usage on the

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated YARN-4006: - Attachment: YARN-4006-branch-trunk.patch Trunk Patch YARN ATS Alternate Kerberos HTTP Authentication

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated YARN-4006: - Affects Version/s: 2.7.2 YARN ATS Alternate Kerberos HTTP Authentication Changes

[jira] [Updated] (YARN-4007) Add support for different network setups when launching the docker container

2015-07-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4007: Description: We should allow users to be able to launch containers with appropriate network setups.

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-07-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649990#comment-14649990 ] Naganarasimha G R commented on YARN-3995: - Hi [~sjlee0] [~zjshen], Hoping for some

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-07-31 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649993#comment-14649993 ] Inigo Goiri commented on YARN-3534: --- I guess in #2 you meant yarn-default.xml, right? I

[jira] [Commented] (YARN-4004) container-executor should print output of docker logs if the docker container exits with non-0 exit status

2015-07-31 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650007#comment-14650007 ] Sidharta Seethana commented on YARN-4004: - For the segment of code below, would it

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-31 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650014#comment-14650014 ] Li Lu commented on YARN-3984: - Hi [~vrushalic], thanks for the patch. The current patch LGTM

[jira] [Commented] (YARN-2884) Proxying all AM-RM communications

2015-07-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650016#comment-14650016 ] Subru Krishnan commented on YARN-2884: -- Thanks [~kishorch] for fixing the test patch

[jira] [Commented] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2015-07-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650015#comment-14650015 ] Zhijie Shen commented on YARN-4006: --- [~gss2002], it seems that the patch doesn't come

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2015-07-31 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648939#comment-14648939 ] Bibin A Chundatt commented on YARN-3940: For first case mentioned above Will check

[jira] [Updated] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3873: -- Attachment: 0005-YARN-3873.patch Thank you [~leftnoteasy] for sharing comments. For now

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-07-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648969#comment-14648969 ] Rohith Sharma K S commented on YARN-3887: - [~sunilg] thanks for updating patch One

[jira] [Commented] (YARN-3996) YARN-789 (Support for zero capabilities in fairscheduler) is broken after YARN-3305

2015-07-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648944#comment-14648944 ] Rohith Sharma K S commented on YARN-3996: - CIIAW,

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648927#comment-14648927 ] Hadoop QA commented on YARN-3543: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3887) Support for changing Application priority during runtime

2015-07-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3887: -- Attachment: 0004-YARN-3887.patch Thank you [~leftnoteasy] Attaching a latest patch addressing the comments.

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649085#comment-14649085 ] Hadoop QA commented on YARN-3873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-07-31 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649089#comment-14649089 ] Jun Gong commented on YARN-3998: [~jlowe] Thanks for the comment. I agree with you. I am

[jira] [Commented] (YARN-3992) TestApplicationPriority.testApplicationPriorityAllocation fails intermittently

2015-07-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649001#comment-14649001 ] Rohith Sharma K S commented on YARN-3992: - Thanks [~sunilg] for providing the

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649058#comment-14649058 ] Hudson commented on YARN-433: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #273 (See

[jira] [Commented] (YARN-3963) AddNodeLabel on duplicate label addition shows success

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649057#comment-14649057 ] Hudson commented on YARN-3963: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #273 (See

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

2015-07-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649054#comment-14649054 ] Hudson commented on YARN-3971: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #273 (See

[jira] [Commented] (YARN-3945) maxApplicationsPerUser is wrongly calculated

2015-07-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649063#comment-14649063 ] Naganarasimha G R commented on YARN-3945: - [~nroberts] Missed to check this flow,

  1   2   >