[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060752#comment-15060752 ] Varun Saxena commented on YARN-4238: Quick update based on the discussion we had in call. We decided

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

2015-12-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060751#comment-15060751 ] Daniel Templeton commented on YARN-3102: Sounds like a generally reasonable approach. I definitely

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060792#comment-15060792 ] Varun Saxena commented on YARN-4238: Quick update based on the discussion we had in call. We decided

[jira] [Assigned] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-16 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rich Haase reassigned YARN-4257: Assignee: Rich Haase > Move scheduler validateConf method to AbstractYarnScheduler and make it >

[jira] [Commented] (YARN-4207) Add a non-judgemental YARN app completion status

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060726#comment-15060726 ] Hudson commented on YARN-4207: -- FAILURE: Integrated in Hadoop-trunk-Commit #8977 (See

[jira] [Updated] (YARN-4420) Add REST API for List Reservations

2015-12-16 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4420: -- Attachment: YARN-4420.v1.patch First version of the patch. This is dependent on YARN-4340, so I have not made

[jira] [Commented] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060311#comment-15060311 ] Varun Saxena commented on YARN-4466: Assigned to Naga > ResourceManager should tolerate unexpected

[jira] [Updated] (YARN-4466) ResourceManager should tolerate unexpected exceptions to happen in non-critical subsystem/services like SystemMetricsPublisher

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4466: --- Assignee: Naganarasimha G R (was: Varun Saxena) > ResourceManager should tolerate unexpected

[jira] [Updated] (YARN-3586) RM only get back addresses of Collectors that NM needs to know.

2015-12-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3586: - Attachment: YARN-3586-feature-YARN-2928.patch Update a patch with proper unit test. > RM only get back

[jira] [Updated] (YARN-4423) Cleanup lint warnings in resource mananger

2015-12-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4423: --- Attachment: YARN-4423.003.patch Rebased > Cleanup lint warnings in resource mananger >

[jira] [Updated] (YARN-3586) RM only get back addresses of Collectors that NM needs to know.

2015-12-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3586: - Priority: Critical (was: Major) > RM only get back addresses of Collectors that NM needs to know. >

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060757#comment-15060757 ] Varun Saxena commented on YARN-4238: Sorry...Submitted comment by mistake. > createdTime and

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-16 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060808#comment-15060808 ] Rich Haase commented on YARN-4257: -- Makes sense to me. > Move scheduler validateConf method to

[jira] [Commented] (YARN-4207) Add a non-judgemental YARN app completion status

2015-12-16 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060611#comment-15060611 ] Siddharth Seth commented on YARN-4207: -- +1. This looks good. Thanks [~rhaase] > Add a non-judgemental

[jira] [Updated] (YARN-4293) ResourceUtilization should be a part of yarn node CLI

2015-12-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4293: - Description: In order to get resource utilization information easier, "yarn node" CLI should include

[jira] [Commented] (YARN-3586) RM only get back addresses of Collectors that NM needs to know.

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060794#comment-15060794 ] Hadoop QA commented on YARN-3586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-12-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060881#comment-15060881 ] Wangda Tan commented on YARN-4108: -- Thanks [~curino] for comments! I think all your suggestions/concerns

[jira] [Commented] (YARN-3863) Enhance filters in TimelineReader

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060884#comment-15060884 ] Varun Saxena commented on YARN-3863: We can add a filter for created time too. Had missed it. >

[jira] [Commented] (YARN-4423) Cleanup lint warnings in resource mananger

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060437#comment-15060437 ] Hadoop QA commented on YARN-4423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4423) Cleanup lint warnings in resource mananger

2015-12-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4423: --- Attachment: YARN-4423.003.patch > Cleanup lint warnings in resource mananger >

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

2015-12-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060461#comment-15060461 ] Wangda Tan commented on YARN-4333: -- [~Tao Jie], I've added you to contributor list and assigned the JIRA

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060543#comment-15060543 ] Carlo Curino commented on YARN-4108: [~leftnoteasy] thanks for explaining us what you are working on.

[jira] [Updated] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4304: -- Attachment: 0005-YARN-4304.patch Uploading a new version of patch as YARN-4418 is committed. Also addressed the

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060574#comment-15060574 ] Hudson commented on YARN-4452: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8975 (See

[jira] [Commented] (YARN-4423) Cleanup lint warnings in resource mananger

2015-12-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060458#comment-15060458 ] Daniel Templeton commented on YARN-4423: The patch doesn't apply to trunk because it now depends on

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within queue

2015-12-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4333: - Assignee: Tao Jie > Fair scheduler should support preemption within queue >

[jira] [Commented] (YARN-4198) CapacityScheduler locking / synchronization improvements

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060459#comment-15060459 ] Carlo Curino commented on YARN-4198: [~xinxianyin] the way we got to this was by running a "busy"

[jira] [Commented] (YARN-4423) Cleanup lint warnings in resource mananger

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060453#comment-15060453 ] Hadoop QA commented on YARN-4423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4461) Redundant nodeLocalityDelay log in LeafQueue

2015-12-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060466#comment-15060466 ] Wangda Tan commented on YARN-4461: -- Thanks [~eepayne], patch looks good, +1. > Redundant

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060559#comment-15060559 ] Bikas Saha commented on YARN-1197: -- The API supports it but the backed implementation does not. So in the

[jira] [Updated] (YARN-4423) Cleanup lint warnings in resource mananger

2015-12-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4423: --- Attachment: (was: YARN-4423.003.patch) > Cleanup lint warnings in resource mananger >

[jira] [Updated] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4003: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4193 > ReservationQueue inherit

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060568#comment-15060568 ] Junping Du commented on YARN-4452: -- I just committed 002 patch to trunk and branch-2. However, I meet some

[jira] [Updated] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4462: --- Summary: FairScheduler: Disallow preemption from a queue (was: Scheduler should prevent

[jira] [Commented] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060909#comment-15060909 ] Karthik Kambatla commented on YARN-4462: Today, FairScheduler allows disabling preemption *for* a

[jira] [Updated] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-16 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4428: --- Attachment: YARN-4428.1.2.patch .1.2 patch addressed checkstyle issues > Redirect RM page to AHS page when

[jira] [Assigned] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-4462: -- Assignee: Karthik Kambatla > FairScheduler: Disallow preemption from a queue >

[jira] [Commented] (YARN-3480) Recovery may get very slow with lots of services with lots of app-attempts

2015-12-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060978#comment-15060978 ] Jian He commented on YARN-3480: --- thanks for updating, few more comments: - rename startAttemptIdInStateStore

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2015-12-16 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061124#comment-15061124 ] Brook Zhou commented on YARN-3223: -- Test breaks unrelated. > Resource update during NM graceful

[jira] [Commented] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

2015-12-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060892#comment-15060892 ] Subru Krishnan commented on YARN-2575: -- Thanks [~seanpo03] for taking this up, this is an important

[jira] [Updated] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2015-12-16 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4414: --- Attachment: YARN-4414.1.3.patch oops, my bad, intended to name latest patch as .1.3. removed the .2.2 patch

[jira] [Updated] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2015-12-16 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4414: --- Attachment: (was: YARN-4414.2.2.patch) > Nodemanager connection errors are retried at multiple levels >

[jira] [Commented] (YARN-4461) Redundant nodeLocalityDelay log in LeafQueue

2015-12-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061104#comment-15061104 ] Jason Lowe commented on YARN-4461: -- +1 committing this. > Redundant nodeLocalityDelay log in LeafQueue >

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060935#comment-15060935 ] Hudson commented on YARN-4225: -- FAILURE: Integrated in Hadoop-trunk-Commit #8978 (See

[jira] [Commented] (YARN-4416) Deadlock due to synchronised get Methods in AbstractCSQueue

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060936#comment-15060936 ] Hudson commented on YARN-4416: -- FAILURE: Integrated in Hadoop-trunk-Commit #8978 (See

[jira] [Commented] (YARN-4293) ResourceUtilization should be a part of yarn node CLI

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060937#comment-15060937 ] Hudson commented on YARN-4293: -- FAILURE: Integrated in Hadoop-trunk-Commit #8978 (See

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060952#comment-15060952 ] Hadoop QA commented on YARN-4304: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2015-12-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061126#comment-15061126 ] Jian He commented on YARN-4438: --- Thanks for detailed review ! bq. All that is needed is store the

[jira] [Updated] (YARN-4462) Scheduler should prevent certain application from being preempted

2015-12-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4462: --- Component/s: (was: scheduler) fairscheduler > Scheduler should prevent

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2015-12-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4464: --- Target Version/s: 3.0.0 Priority: Blocker (was: Major) Hadoop Flags:

[jira] [Assigned] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2015-12-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-4464: -- Assignee: Daniel Templeton > default value of

[jira] [Updated] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2015-12-16 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4414: --- Attachment: YARN-4414.2.2.patch .2.2 fix the white space issue > Nodemanager connection errors are retried at

[jira] [Commented] (YARN-3586) RM only get back addresses of Collectors that NM needs to know.

2015-12-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061094#comment-15061094 ] Varun Saxena commented on YARN-3586: Thanks Junping for the patch. Overall the patch looks good. A

[jira] [Commented] (YARN-4461) Redundant nodeLocalityDelay log in LeafQueue

2015-12-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061170#comment-15061170 ] Hudson commented on YARN-4461: -- FAILURE: Integrated in Hadoop-trunk-Commit #8980 (See

[jira] [Commented] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

2015-12-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061212#comment-15061212 ] Li Lu commented on YARN-4445: - All failing system tests passed on my local machine. +1. Since it has been

[jira] [Commented] (YARN-4461) Redundant nodeLocalityDelay log in LeafQueue

2015-12-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061298#comment-15061298 ] Eric Payne commented on YARN-4461: -- Thanks a lot, [~jlowe] and [~leftnoteasy]! > Redundant

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-12-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061296#comment-15061296 ] Eric Payne commented on YARN-4225: -- Thanks a lot, [~leftnoteasy] > Add preemption status to yarn queue

[jira] [Commented] (YARN-4463) Container launch failure when yarn.nodemanager.log-dirs directory path contains space

2015-12-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061472#comment-15061472 ] Rohith Sharma K S commented on YARN-4463: - I am no sure does it works, have you tried configuring

[jira] [Updated] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4195: --- Attachment: YARN-4195.patch > Support of node-labels in the ReservationSystem "Plan" >

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061563#comment-15061563 ] Carlo Curino commented on YARN-4003: [~Sunil G], I think your understanding is correct. The point is

[jira] [Commented] (YARN-4454) NM to nodelabel mapping going wrong after RM restart

2015-12-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061476#comment-15061476 ] Bibin A Chundatt commented on YARN-4454: On 2nd time recovery the ordering is going wrong

[jira] [Commented] (YARN-4164) Retrospect update ApplicationPriority API return type

2015-12-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061477#comment-15061477 ] Sunil G commented on YARN-4164: --- Thanks [~rohithsharma] for updating the patch. Looks good. [~jianhe],

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-12-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: YARN-2934.v1.007.patch Thanks for the review [~jira.shegalov], bq. Please make

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061562#comment-15061562 ] Carlo Curino commented on YARN-4195: Regarding clean-up: [~subru], I will need some help to make the

[jira] [Updated] (YARN-4197) Modify PlanFollower to handle reservation with node-labels

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4197: --- Assignee: Alexey Tumanov > Modify PlanFollower to handle reservation with node-labels >

[jira] [Updated] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4196: --- Assignee: Ishai Menache (was: Carlo Curino) > Enhance ReservationAgent(s) to support node-label >

[jira] [Assigned] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4196: -- Assignee: Carlo Curino > Enhance ReservationAgent(s) to support node-label >

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061577#comment-15061577 ] sandflee commented on YARN-1197: seems complicated for AM to do this, especially we added disk,network to

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

2015-12-16 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061481#comment-15061481 ] KWON BYUNGCHANG commented on YARN-4464: --- 0 is good :) > default value of

[jira] [Updated] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

2015-12-16 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-2575: -- Attachment: YARN-2575.v2.patch > Consider creating separate ACLs for Reservation create/update/delete/list ops >

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061560#comment-15061560 ] Carlo Curino commented on YARN-4195: The posted patch is a rebase of our working branch. It is useful

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061260#comment-15061260 ] Naganarasimha G R commented on YARN-4452: - will provide for it shortly ! > NPE when submit

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061301#comment-15061301 ] Hadoop QA commented on YARN-3458: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061393#comment-15061393 ] MENG DING commented on YARN-1197: - [~sandflee], for now you can achieve the goal of increasing and

[jira] [Commented] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061407#comment-15061407 ] Hadoop QA commented on YARN-4428: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-3458) CPU resource monitoring in Windows

2015-12-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned YARN-3458: --- Assignee: Chris Nauroth (was: Inigo Goiri) > CPU resource monitoring in Windows >

[jira] [Commented] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-16 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061280#comment-15061280 ] Tao Jie commented on YARN-4462: --- hi [~kasha] I have done some attempt of this on FairScheduler based on

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-12-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-3458: Assignee: Inigo Goiri (was: Chris Nauroth) > CPU resource monitoring in Windows >

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061347#comment-15061347 ] sandflee commented on YARN-1197: user application(long running) are running on our yarn platform, they

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061186#comment-15061186 ] Li Lu commented on YARN-4224: - Discussed about the PUT use case with Wangda. Right now we're not planning any

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-12-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-3458: Hadoop Flags: Reviewed +1 for patch v9. I'll wait a few days before committing, since I see other

[jira] [Updated] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-16 Thread Rich Haase (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rich Haase updated YARN-4257: - Attachment: YARN-4257.patch > Move scheduler validateConf method to AbstractYarnScheduler and make it >

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061348#comment-15061348 ] sandflee commented on YARN-1197: user application(long running) are running on our yarn platform, they

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061349#comment-15061349 ] sandflee commented on YARN-1197: user application(long running) are running on our yarn platform, they

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061346#comment-15061346 ] sandflee commented on YARN-1197: user application(long running) are running on our yarn platform, they

[jira] [Assigned] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-4462: -- Assignee: Tao Jie (was: Karthik Kambatla) All yours, [~Tao Jie]. > FairScheduler:

[jira] [Updated] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

2015-12-16 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-2575: -- Attachment: (was: YARN-2575.v2.patch) > Consider creating separate ACLs for Reservation

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-16 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059829#comment-15059829 ] Sidharta Seethana commented on YARN-3542: - Thanks, [~vvasudev]. +1 on the latest patch from me. >

[jira] [Commented] (YARN-4445) Unify the term flowId and flowName in timeline v2 codebase

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059904#comment-15059904 ] Hadoop QA commented on YARN-4445: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3480) Recovery may get very slow with lots of services with lots of app-attempts

2015-12-16 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059964#comment-15059964 ] Jun Gong commented on YARN-3480: Fix findbugs and test errors. > Recovery may get very slow with lots of

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-16 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059943#comment-15059943 ] Gera Shegalov commented on YARN-2934: - Hi [~Naganarasimha], Please make sure that the patch does not

[jira] [Updated] (YARN-3480) Recovery may get very slow with lots of services with lots of app-attempts

2015-12-16 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3480: --- Attachment: YARN-3480.09.patch > Recovery may get very slow with lots of services with lots of app-attempts >

[jira] [Commented] (YARN-4333) Fair scheduler should support preemption within queue

2015-12-16 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059968#comment-15059968 ] Tao Jie commented on YARN-4333: --- In attached patch, we append app-level check for starvation stats to

[jira] [Updated] (YARN-4333) Fair scheduler should support preemption within queue

2015-12-16 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4333: -- Attachment: YARN-4333.001.patch > Fair scheduler should support preemption within queue >

[jira] [Commented] (YARN-4462) Scheduler should prevent certain application from being preempted

2015-12-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060039#comment-15060039 ] Sunil G commented on YARN-4462: --- Yes Tao Jie. I understood your scenaruo where cost of one long running

[jira] [Commented] (YARN-4461) Redundant nodeLocalityDelay log in LeafQueue

2015-12-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060109#comment-15060109 ] Eric Payne commented on YARN-4461: -- The two failing tests above ({{TestClientRMTokens}} and

[jira] [Commented] (YARN-4452) NPE when submit Unmanaged application

2015-12-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060119#comment-15060119 ] Naganarasimha G R commented on YARN-4452: - Hi [~djp], thanks for sharing your views. bq. But may be

[jira] [Commented] (YARN-4462) Scheduler should prevent certain application from being preempted

2015-12-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060133#comment-15060133 ] Naganarasimha G R commented on YARN-4462: - hi [~Tao Jie], bq. However we apply FairScheduler in our

[jira] [Commented] (YARN-3480) Recovery may get very slow with lots of services with lots of app-attempts

2015-12-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059828#comment-15059828 ] Hadoop QA commented on YARN-3480: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4465) SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled

2015-12-16 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4465: -- Summary: SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled Key: YARN-4465 URL: https://issues.apache.org/jira/browse/YARN-4465

  1   2   >