[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196784#comment-15196784 ] Xuan Gong commented on YARN-4814: - Thanks, [~jlowe] I have revert the previous commit from

[jira] [Updated] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4814: Attachment: YARN-4814.2.patch > ATS 1.5 timelineclient impl call flush after every event write >

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196777#comment-15196777 ] Anoop Sam John commented on YARN-4736: -- I see u mean HBASE-15436 > Issues with

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-15 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196776#comment-15196776 ] Anoop Sam John commented on YARN-4736: -- HDFS-15436?? > Issues with HBaseTimelineWriterImpl >

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

2016-03-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196751#comment-15196751 ] Chris Douglas commented on YARN-2883: - Concerning v004: * The use of {{getRemoteUgi}} in

[jira] [Commented] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196682#comment-15196682 ] Hadoop QA commented on YARN-4359: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196637#comment-15196637 ] Hadoop QA commented on YARN-4117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196565#comment-15196565 ] Wangda Tan commented on YARN-4108: -- Thanks for reviewing my patch, [~eepayne]. bq. If this behavior is

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196551#comment-15196551 ] Eric Payne commented on YARN-4108: -- Thanks, [~leftnoteasy], for all of the great effort on this JIRA. This

[jira] [Comment Edited] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196541#comment-15196541 ] Jian He edited comment on YARN-998 at 3/16/16 12:28 AM: thanks Junping for the

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196541#comment-15196541 ] Jian He commented on YARN-998: -- thanks Junping for the explanation, few comments I have: -

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196528#comment-15196528 ] Hadoop QA commented on YARN-4686: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4812) TestFairScheduler#testContinuousScheduling fails intermittently

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196508#comment-15196508 ] Karthik Kambatla commented on YARN-4812: The test failures are unrelated. >

[jira] [Commented] (YARN-4805) Don't go through all schedulers in ParameterizedTestBase

2016-03-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196504#comment-15196504 ] Karthik Kambatla commented on YARN-4805: There is a minor chance that can happen. Previously, most

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196490#comment-15196490 ] Hadoop QA commented on YARN-4117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196475#comment-15196475 ] Xuan Gong commented on YARN-4817: - [~djp] bq. Shall we use WARN instead of INFO for many messages, like:

[jira] [Commented] (YARN-4517) [YARN-3368] Add nodes page

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196450#comment-15196450 ] Li Lu commented on YARN-4517: - Hi [~varun_saxena], sorry about the late reply. With regard to the

[jira] [Reopened] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reopened YARN-4814: - > ATS 1.5 timelineclient impl call flush after every event write >

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196432#comment-15196432 ] Li Lu commented on YARN-4814: - Thanks [~jlowe]! So sorry I put this patch back too fast. Yes the goal here is

[jira] [Updated] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-03-15 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishai Menache updated YARN-4359: Attachment: YARN-4359.6.patch > Update LowCost agents logic to take advantage of YARN-4358 >

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196397#comment-15196397 ] Hadoop QA commented on YARN-4785: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196398#comment-15196398 ] Hadoop QA commented on YARN-4359: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2016-03-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196386#comment-15196386 ] Daniel Templeton commented on YARN-4813: The root cause is a replay error in GSS: {noformat}

[jira] [Commented] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-15 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196359#comment-15196359 ] Brook Zhou commented on YARN-4818: -- You're right, it was some issue with our FileSystem implementation. I

[jira] [Resolved] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-15 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou resolved YARN-4818. -- Resolution: Invalid > AggregatedLogFormat.LogValue.write() incorrectly truncates files >

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196347#comment-15196347 ] Junping Du commented on YARN-998: - Hi [~jianhe], thanks for reviewing and comments. bq. is the purpose of

[jira] [Commented] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2016-03-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196340#comment-15196340 ] Subru Krishnan commented on YARN-4468: -- Thanks [~curino] for the documentation patch. I have opened

[jira] [Updated] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2016-03-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4827: - Summary: Document configuration of ReservationSystem for FairScheduler (was: CLONE - Document

[jira] [Updated] (YARN-4827) CLONE - Document configuration of ReservationSystem for FairScheduler

2016-03-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4827: - Description: This JIRA tracks the effort to add documentation on how to configure

[jira] [Created] (YARN-4827) CLONE - Document configuration of ReservationSystem for FairScheduler

2016-03-15 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-4827: Summary: CLONE - Document configuration of ReservationSystem for FairScheduler Key: YARN-4827 URL: https://issues.apache.org/jira/browse/YARN-4827 Project: Hadoop

[jira] [Created] (YARN-4826) Document configuration of ReservationSystem for CapacityScheduler

2016-03-15 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-4826: Summary: Document configuration of ReservationSystem for CapacityScheduler Key: YARN-4826 URL: https://issues.apache.org/jira/browse/YARN-4826 Project: Hadoop YARN

[jira] [Commented] (YARN-4687) Document Reservation ACLs

2016-03-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196324#comment-15196324 ] Arun Suresh commented on YARN-4687: --- Thanks for the fix [~seanpo03] +1, will check it in shortly >

[jira] [Commented] (YARN-4683) Document the List Reservations REST API

2016-03-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196323#comment-15196323 ] Arun Suresh commented on YARN-4683: --- Agreed.. +1, Will check it in shortly > Document the List

[jira] [Commented] (YARN-4683) Document the List Reservations REST API

2016-03-15 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196307#comment-15196307 ] Sean Po commented on YARN-4683: --- Thanks for the comments [~asuresh]. Subru has created a ticket addressing

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196310#comment-15196310 ] Jian He commented on YARN-998: -- [~djp], to better understand this jira, is the purpose of the jira to make RM

[jira] [Created] (YARN-4825) Remove redundant code in ClientRMService::listReservations

2016-03-15 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-4825: Summary: Remove redundant code in ClientRMService::listReservations Key: YARN-4825 URL: https://issues.apache.org/jira/browse/YARN-4825 Project: Hadoop YARN

[jira] [Updated] (YARN-4823) Rename the nested reservation id field in listReservation to ID

2016-03-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4823: - Description: The listReservation REST API returns a ReservationId field which has a nested id

[jira] [Created] (YARN-4824) Replace numbers with enums for ReservationRequestInterpreter in Reservation REST APIs

2016-03-15 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-4824: Summary: Replace numbers with enums for ReservationRequestInterpreter in Reservation REST APIs Key: YARN-4824 URL: https://issues.apache.org/jira/browse/YARN-4824

[jira] [Commented] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196297#comment-15196297 ] Jason Lowe commented on YARN-4818: -- Is there a recent change in 2.8 that broke this? I haven't seen it in

[jira] [Created] (YARN-4823) Rename the nested reservation id field in listReservation to ID

2016-03-15 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-4823: Summary: Rename the nested reservation id field in listReservation to ID Key: YARN-4823 URL: https://issues.apache.org/jira/browse/YARN-4823 Project: Hadoop YARN

[jira] [Assigned] (YARN-4823) Rename the nested reservation id field in listReservation to ID

2016-03-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-4823: Assignee: Subru Krishnan (was: Carlo Curino) > Rename the nested reservation id field in

[jira] [Updated] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-15 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-4818: - Component/s: nodemanager > AggregatedLogFormat.LogValue.write() incorrectly truncates files >

[jira] [Updated] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-15 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-4818: - Labels: log-aggregation (was: ) > AggregatedLogFormat.LogValue.write() incorrectly truncates files >

[jira] [Updated] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-4686: -- Attachment: YARN-4686.006.patch [~eepayne] good catch! I've switched that line in the comment in this

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196270#comment-15196270 ] Eric Payne commented on YARN-4686: -- [~ebadger], thanks for updating this patch. Just one minor nit: In

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196259#comment-15196259 ] Jason Lowe commented on YARN-4814: -- Sorry I missed this before it went in. Don't we have an issue where

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196235#comment-15196235 ] Hadoop QA commented on YARN-998: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196231#comment-15196231 ] Jian He commented on YARN-4108: --- lgtm, thanks Wangda ! > CapacityScheduler: Improve preemption to preempt

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196152#comment-15196152 ] Giovanni Matteo Fumarola commented on YARN-1547: Cool, reattached as v0. > Prevent DoS of

[jira] [Updated] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-1547: --- Attachment: YARN-1547.v0.pdf > Prevent DoS of ApplicationMasterProtocol by

[jira] [Updated] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4822: - Description: Currently, ProportionalCapacityPreemptionPolicy has hard coded logic to select candidates to

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196096#comment-15196096 ] Hudson commented on YARN-4817: -- FAILURE: Integrated in Hadoop-trunk-Commit #9466 (See

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196095#comment-15196095 ] Hudson commented on YARN-4814: -- FAILURE: Integrated in Hadoop-trunk-Commit #9466 (See

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196092#comment-15196092 ] Arun Suresh commented on YARN-3926: --- [~vvasudev], I was wondering if the possibility of allowing an NM to

[jira] [Updated] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4822: - Summary: Refactor existing Preemption Policy of CS for easier adding new approach to select preemption

[jira] [Updated] (YARN-4822) Refactoring of existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4822: - Description: Currently, ProportionalCapacityPreemptionPolicy has hard coded logic to select candidates to

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196023#comment-15196023 ] Junping Du commented on YARN-4817: -- Shall we use WARN instead of INFO for many messages, like: {{Service

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196013#comment-15196013 ] Vinod Kumar Vavilapalli commented on YARN-1547: --- [~giovanni.fumarola], a process feedback, we

[jira] [Updated] (YARN-4818) AggregatedLogFormat.LogValue.write() incorrectly truncates files

2016-03-15 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-4818: - Attachment: YARN-4818-v0.patch > AggregatedLogFormat.LogValue.write() incorrectly truncates files >

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195981#comment-15195981 ] Giovanni Matteo Fumarola commented on YARN-1547: Thank [~vinodkv] for the feedbacks, and

[jira] [Updated] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-1547: --- Attachment: YARN-1547.pdf > Prevent DoS of ApplicationMasterProtocol by

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195963#comment-15195963 ] Junping Du commented on YARN-4815: -- I thought LinkedHashMap is good enough for LRU in most cases. Any

[jira] [Assigned] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4821: --- Assignee: Naganarasimha G R > have a separate NM timeline publishing interval >

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: YARN-4117.v4.patch > End to end unit test with mini YARN cluster

[jira] [Created] (YARN-4822) Refactoring of existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-15 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-4822: Summary: Refactoring of existing Preemption Policy of CS for easier adding new approach to select preemption candidates Key: YARN-4822 URL:

[jira] [Updated] (YARN-4822) Refactoring of existing Preemption Policy of CS for easier adding new approach to select preemption candidates

2016-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4822: - Issue Type: Sub-task (was: Bug) Parent: YARN-45 > Refactoring of existing Preemption Policy of CS

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195951#comment-15195951 ] Junping Du commented on YARN-4817: -- [~gtCarrera9], can you wait a bit? It sounds like a few LOG level

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Issue Type: Sub-task (was: Bug) Parent: YARN-45 > CapacityScheduler: Improve preemption to

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195931#comment-15195931 ] Li Lu commented on YARN-3150: - Sure np. We can update that after the v1.5 docs are done. > [Documentation]

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195933#comment-15195933 ] Junping Du commented on YARN-4814: -- +1. Patch looks good to me too. [~gtCarrera9], please go ahead to

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: (was: YARN-4117.v4.patch) > End to end unit test with mini

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195940#comment-15195940 ] Li Lu commented on YARN-4815: - Sorry [~djp], I'm still wondering why we're not using the Guava cache here?

[jira] [Commented] (YARN-4817) Change Log Level to DEBUG for putDomain call in ATS 1.5

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195941#comment-15195941 ] Li Lu commented on YARN-4817: - Fix is trivial. Will commit shortly. > Change Log Level to DEBUG for putDomain

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

2016-03-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195911#comment-15195911 ] Sangjin Lee commented on YARN-3150: --- Thanks for the update [~gtCarrera9]. I am going to look at creating

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195936#comment-15195936 ] Junping Du commented on YARN-4815: -- +1. Patch LGTM. Will commit it tomorrow if no further comments. > ATS

[jira] [Commented] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195899#comment-15195899 ] Sangjin Lee commented on YARN-4821: --- I don't think it needs to be that sophisticated. It can be as simple

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195900#comment-15195900 ] Li Lu commented on YARN-4814: - Will commit this shortly. > ATS 1.5 timelineclient impl call flush after every

[jira] [Commented] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195891#comment-15195891 ] Sangjin Lee commented on YARN-4821: --- Please feel free to assign it to yourself. I'm fine with it. This

[jira] [Commented] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195884#comment-15195884 ] Naganarasimha G R commented on YARN-4821: - ??is it we capture instantaneous CPU usage or CPU for

[jira] [Commented] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195881#comment-15195881 ] Junping Du commented on YARN-4785: -- The fix looks good to me. However, I think we should improve the test

[jira] [Commented] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195874#comment-15195874 ] Naganarasimha G R commented on YARN-4821: - Hi [~sjlee0], One query wrt this is how to calculate

[jira] [Updated] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4821: -- Labels: yarn-2928-1st-milestone (was: ) > have a separate NM timeline publishing interval >

[jira] [Created] (YARN-4821) have a separate NM timeline publishing interval

2016-03-15 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-4821: - Summary: have a separate NM timeline publishing interval Key: YARN-4821 URL: https://issues.apache.org/jira/browse/YARN-4821 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195852#comment-15195852 ] Sangjin Lee commented on YARN-4712: --- The latest patch looks good to me. However, we still need others'

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: YARN-4117.v4.patch > End to end unit test with mini YARN cluster

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-15 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: (was: YARN-4117.v4.patch) > End to end unit test with mini

[jira] [Updated] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2016-03-15 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ishai Menache updated YARN-4359: Attachment: YARN-4359.5.patch > Update LowCost agents logic to take advantage of YARN-4358 >

[jira] [Updated] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4785: Attachment: YARN-4785.001.patch Uploaded a patch with the fix. > inconsistent value type of the

[jira] [Commented] (YARN-4736) Issues with HBaseTimelineWriterImpl

2016-03-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195773#comment-15195773 ] Sangjin Lee commented on YARN-4736: --- Dropped a comment on HDFS-15436. Even though there may be nothing we

[jira] [Commented] (YARN-4811) Generate histograms for actual container resource usage

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195753#comment-15195753 ] Varun Vasudev commented on YARN-4811: - [~jianhe], [~kasha] - can you guys review the patch? Thanks! >

[jira] [Commented] (YARN-4811) Generate histograms for actual container resource usage

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195722#comment-15195722 ] Hadoop QA commented on YARN-4811: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3876) get_executable() assumes everything is Linux

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195661#comment-15195661 ] Hadoop QA commented on YARN-3876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-4785: --- Assignee: Varun Vasudev > inconsistent value type of the "type" field for LeafQueueInfo in

[jira] [Commented] (YARN-4717) TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup

2016-03-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195629#comment-15195629 ] Robert Kanter commented on YARN-4717: - +1 LGTM easy fix :) >

[jira] [Commented] (YARN-4683) Document the List Reservations REST API

2016-03-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195630#comment-15195630 ] Arun Suresh commented on YARN-4683: --- The Patch looks mostly ok [~seanpo03]. My only reservation (pun

[jira] [Commented] (YARN-4667) RM Admin CLI for refreshNodesResources throws NPE when nothing is configured

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195605#comment-15195605 ] Junping Du commented on YARN-4667: -- Move it to sub task of YARN-291 for better tracking when releasing the

[jira] [Updated] (YARN-4667) RM Admin CLI for refreshNodesResources throws NPE when nothing is configured

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4667: - Priority: Critical (was: Major) > RM Admin CLI for refreshNodesResources throws NPE when nothing is

[jira] [Updated] (YARN-4667) RM Admin CLI for refreshNodesResources throws NPE when nothing is configured

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4667: - Issue Type: Sub-task (was: Bug) Parent: YARN-291 > RM Admin CLI for refreshNodesResources throws

[jira] [Updated] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-998: Target Version/s: 2.8.0 > Persistent resource change during NM/RM restart >

[jira] [Updated] (YARN-998) Persistent resource change during NM/RM restart

2016-03-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-998: Attachment: YARN-998-v1.patch Upload the patch with following changes: 1. ResourceTrackService will

  1   2   >