[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625953#comment-14625953 ] Varun Saxena commented on YARN-3878: [~jianhe], [~kasha], [~devaraj.k], kindly review.

[jira] [Updated] (YARN-463) Show explicitly excluded nodes on the UI

2015-07-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated YARN-463: -- Attachment: YARN-463.patch Screen Shot 2015-07-14 at 1.25.46 PM.png This patch add

[jira] [Updated] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3878: --- Attachment: YARN-3878.09.patch AsyncDispatcher can hang while stopping if it is configured for

[jira] [Reopened] (YARN-463) Show explicitly excluded nodes on the UI

2015-07-14 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong reopened YARN-463: --- Assignee: zhaoyunjiong Currently hosts already in yarn.resourcemanager.nodes.exclude-path when

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id 9999)

2015-07-14 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625949#comment-14625949 ] Mohammad Shahid Khan commented on YARN-3840: I want somebody to review the

[jira] [Commented] (YARN-463) Show explicitly excluded nodes on the UI

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625990#comment-14625990 ] Hadoop QA commented on YARN-463: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625946#comment-14625946 ] Hadoop QA commented on YARN-3878: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3846) RM Web UI queue filter is not working

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626036#comment-14626036 ] Hadoop QA commented on YARN-3846: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-07-14 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626133#comment-14626133 ] Tsuyoshi Ozawa commented on YARN-3170: -- +1, checking this in. YARN architecture

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-07-14 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626141#comment-14626141 ] Tsuyoshi Ozawa commented on YARN-3170: -- [~brahmareddy] Oh, the change against line 1

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626186#comment-14626186 ] Ajith S commented on YARN-3885: --- Hi [~leftnoteasy], thanks for the input The testcase i have

[jira] [Updated] (YARN-3844) Make hadoop-yarn-project Native code -Wall-clean

2015-07-14 Thread Alan Burlison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Burlison updated YARN-3844: Attachment: YARN-3844.007.patch Make hadoop-yarn-project Native code -Wall-clean

[jira] [Updated] (YARN-3844) Make hadoop-yarn-project Native code -Wall-clean

2015-07-14 Thread Alan Burlison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alan Burlison updated YARN-3844: Attachment: (was: YARN-3844.006.patch) Make hadoop-yarn-project Native code -Wall-clean

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-14 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626207#comment-14626207 ] Peng Zhang commented on YARN-3535: -- [~rohithsharma] Thanks for rebase and adding tests.

[jira] [Commented] (YARN-3844) Make hadoop-yarn-project Native code -Wall-clean

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626225#comment-14626225 ] Hadoop QA commented on YARN-3844: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-14 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626244#comment-14626244 ] Peng Zhang commented on YARN-3535: -- bq. Remove call of recoverResourceRequestForContainer

[jira] [Commented] (YARN-3845) [YARN] YARN status in web ui does not show correctly in IE 11

2015-07-14 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626322#comment-14626322 ] Mohammad Shahid Khan commented on YARN-3845: IE 11 refused to work with rgba

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626238#comment-14626238 ] Hudson commented on YARN-3453: -- FAILURE: Integrated in Hadoop-Yarn-trunk #986 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626242#comment-14626242 ] Hudson commented on YARN-3878: -- FAILURE: Integrated in Hadoop-Yarn-trunk #986 (See

[jira] [Updated] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3873: -- Issue Type: Sub-task (was: Bug) Parent: YARN-3306 pendingApplications in LeafQueue should also use

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626317#comment-14626317 ] Hadoop QA commented on YARN-3170: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3170) YARN architecture document needs updating

2015-07-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3170: --- Attachment: YARN-3170-011.patch YARN architecture document needs updating

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-07-14 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626303#comment-14626303 ] Brahma Reddy Battula commented on YARN-3170: Oh.. [~ozawa] thanks a lot for

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626329#comment-14626329 ] Sunil G commented on YARN-3873: --- Thank you [~leftnoteasy] for sharing your thoughts. I

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626227#comment-14626227 ] Hudson commented on YARN-3453: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #256 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626232#comment-14626232 ] Hudson commented on YARN-3878: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #256 (See

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626449#comment-14626449 ] Hudson commented on YARN-3453: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2202 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626453#comment-14626453 ] Hudson commented on YARN-3878: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2202 (See

[jira] [Assigned] (YARN-3845) [YARN] YARN status in web ui does not show correctly in IE 11

2015-07-14 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Shahid Khan reassigned YARN-3845: -- Assignee: Mohammad Shahid Khan [YARN] YARN status in web ui does not show

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626438#comment-14626438 ] Sunil G commented on YARN-3893: --- Hi [~varun_saxena] bq.Reinitialization of Active Services is

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626437#comment-14626437 ] Sunil G commented on YARN-3893: --- Hi [~varun_saxena] bq.Reinitialization of Active Services is

[jira] [Commented] (YARN-3152) Missing hadoop exclude file fails RMs in HA

2015-07-14 Thread Neill Lima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626448#comment-14626448 ] Neill Lima commented on YARN-3152: -- Hello [~Naganarasimha], I am visiting this topic since

[jira] [Created] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread Xiaodi Ke (JIRA)
Xiaodi Ke created YARN-3922: --- Summary: Introduce adaptive heartbeat between RM and NM Key: YARN-3922 URL: https://issues.apache.org/jira/browse/YARN-3922 Project: Hadoop YARN Issue Type: New

[jira] [Commented] (YARN-3327) if NMClientAsync stopContainer failed because of IOException, there's no chance to stopContainer again

2015-07-14 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626528#comment-14626528 ] sandflee commented on YARN-3327: There is no logs any more, it's a long time and I just fix

[jira] [Commented] (YARN-3923) Introduce adaptive heartbeat between RM and AM

2015-07-14 Thread Xiaodi Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626529#comment-14626529 ] Xiaodi Ke commented on YARN-3923: - We already have some ideas and are working on the

[jira] [Commented] (YARN-3816) [Aggregation] App-level Aggregation for YARN system metrics

2015-07-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626567#comment-14626567 ] Sangjin Lee commented on YARN-3816: --- [~djp], thanks for your POC patch! I understand

[jira] [Created] (YARN-3923) Introduce adaptive heartbeat between RM and AM

2015-07-14 Thread Xiaodi Ke (JIRA)
Xiaodi Ke created YARN-3923: --- Summary: Introduce adaptive heartbeat between RM and AM Key: YARN-3923 URL: https://issues.apache.org/jira/browse/YARN-3923 Project: Hadoop YARN Issue Type: New

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626489#comment-14626489 ] Hudson commented on YARN-3453: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #254 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626493#comment-14626493 ] Hudson commented on YARN-3878: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #254 (See

[jira] [Commented] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread Xiaodi Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626527#comment-14626527 ] Xiaodi Ke commented on YARN-3922: - We already have some ideas and are working on the

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626384#comment-14626384 ] Hudson commented on YARN-3453: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2183 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626388#comment-14626388 ] Hudson commented on YARN-3878: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2183 (See

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625985#comment-14625985 ] Hudson commented on YARN-3453: -- FAILURE: Integrated in Hadoop-trunk-Commit #8160 (See

[jira] [Commented] (YARN-3453) Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626400#comment-14626400 ] Hudson commented on YARN-3453: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #244 (See

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626404#comment-14626404 ] Hudson commented on YARN-3878: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #244 (See

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-07-14 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v1.patch The ShuffleHandler messageReceived calls sendMapOutput only if the number

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626622#comment-14626622 ] Hadoop QA commented on YARN-2410: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626664#comment-14626664 ] Xuan Gong commented on YARN-3893: - Sorry, should call stopAndReinitiate(). Both RM in

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626688#comment-14626688 ] Varun Saxena commented on YARN-3893: Yes but we do need to reinitialize services.

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626661#comment-14626661 ] Xuan Gong commented on YARN-3893: - How about first calling rm.transitionToStandby(false),

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626677#comment-14626677 ] Sunil G commented on YARN-3893: --- Hi [~xgong] Yes, we can do that. But I feel now we call

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626694#comment-14626694 ] Varun Saxena commented on YARN-3893: We do need to stop active services because many

[jira] [Created] (YARN-3924) Submitting an application to standby ResourceManager should respond better than Connection Refused

2015-07-14 Thread Dustin Cote (JIRA)
Dustin Cote created YARN-3924: - Summary: Submitting an application to standby ResourceManager should respond better than Connection Refused Key: YARN-3924 URL: https://issues.apache.org/jira/browse/YARN-3924

[jira] [Commented] (YARN-3635) Get-queue-mapping should be a common interface of YarnScheduler

2015-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627086#comment-14627086 ] Wangda Tan commented on YARN-3635: -- [~kasha]/[~sandyr], do you want to take a look at

[jira] [Commented] (YARN-3923) Introduce adaptive heartbeat between RM and AM

2015-07-14 Thread Xiaodi Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626961#comment-14626961 ] Xiaodi Ke commented on YARN-3923: - Hi [~vvasudev], please see my reply in YARN-3922.

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626909#comment-14626909 ] Varun Saxena commented on YARN-3893: [~sunilg], even I was suggesting earlier in my

[jira] [Commented] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread Xiaodi Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626960#comment-14626960 ] Xiaodi Ke commented on YARN-3922: - Hi [~vvasudev], thank you for pointing out YARN-3630.

[jira] [Commented] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626995#comment-14626995 ] Hadoop QA commented on YARN-2681: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2015-07-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627026#comment-14627026 ] Chris Douglas commented on YARN-3877: - * Not sure I understand this change: {noformat}

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-14 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449-YARN-1197.5.patch As suggested by [~leftnoteasy], I added dummy functions to classes

[jira] [Commented] (YARN-3635) Get-queue-mapping should be a common interface of YarnScheduler

2015-07-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627036#comment-14627036 ] Jian He commented on YARN-3635: --- newest patch looks good to me, + ! Get-queue-mapping

[jira] [Commented] (YARN-3656) LowCost: A Cost-Based Placement Agent for YARN Reservations

2015-07-14 Thread Ishai Menache (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627082#comment-14627082 ] Ishai Menache commented on YARN-3656: - Thank you [~asuresh] for your comments! We will

[jira] [Updated] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0021-YARN-2003.patch Thank you [~leftnoteasy] and [~jianhe] Uploading a new set of patch addressing

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627047#comment-14627047 ] Hadoop QA commented on YARN-2003: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626911#comment-14626911 ] Varun Saxena commented on YARN-3893: I am fine either ways though because as you said

[jira] [Commented] (YARN-3735) Retain JRE Fatal error logs upon container failure

2015-07-14 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627048#comment-14627048 ] Vinod Kumar Vavilapalli commented on YARN-3735: --- YARN doesn't assume JVM

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627080#comment-14627080 ] Sangjin Lee commented on YARN-3049: --- Thanks [~zjshen] for your WIP patch! I skimmed

[jira] [Commented] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-14 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627213#comment-14627213 ] MENG DING commented on YARN-1449: - * checkstyle error are false alarms. These are needed

[jira] [Commented] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627244#comment-14627244 ] Wangda Tan commented on YARN-1449: -- +1 to latest patch. AM-NM protocol changes to

[jira] [Updated] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-14 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3925: Attachment: YARN-3925.000.patch ContainerLogsUtils#getContainerLogFile fails to read container log files

[jira] [Updated] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2015-07-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3926: Attachment: Proposal for modifying resource model and profiles.pdf Attached the proposal. Extend

[jira] [Commented] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627374#comment-14627374 ] Xianyin Xin commented on YARN-3922: --- Maybe we should reconsider to rename the feature

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627349#comment-14627349 ] Li Lu commented on YARN-3049: - Hi [~zjshen], I have a concern similar to [~sjlee0]'s, on

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627370#comment-14627370 ] Arun Suresh commented on YARN-3535: --- Apologies for the late suggestion. [~djp], Correct

[jira] [Commented] (YARN-3878) AsyncDispatcher can hang while stopping if it is configured for draining events on stop

2015-07-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627238#comment-14627238 ] Jian He commented on YARN-3878: --- latest patch looks good to me, will commit if no comments

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627426#comment-14627426 ] Ajith S commented on YARN-3885: --- Hi [~xinxianyin] and [~leftnoteasy] Yes, Xin's scenario

[jira] [Updated] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-3885: -- Attachment: YARN-3885.05.patch reworked on [~xinxianyin] and [~leftnoteasy] comments

[jira] [Commented] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627232#comment-14627232 ] MENG DING commented on YARN-3922: - There is a {{sendOutofBandHeartBeat}} in

[jira] [Commented] (YARN-3850) NM fails to read files from full disks which can lead to container logs being lost and other issues

2015-07-14 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627311#comment-14627311 ] zhihai xu commented on YARN-3850: - Hi [~jlowe] and [~varun_saxena], I find

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2015-07-14 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627328#comment-14627328 ] Varun Vasudev commented on YARN-3926: - Thoughts on the proposal are welcome. The plan

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627433#comment-14627433 ] Ajith S commented on YARN-3885: --- version 05 patch NAME: queueA CUR: memory:209, vCores:0

[jira] [Updated] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3893: --- Attachment: 0001-YARN-3893.patch [~sunilg], [~varun_saxena] and [~xgong] Thanks a lot for

[jira] [Commented] (YARN-3524) Mapreduce failed due to AM Container-Launch failure at NM on windows

2015-07-14 Thread Kaveen Raajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627476#comment-14627476 ] Kaveen Raajan commented on YARN-3524: - Hi [~cnauroth], Thanks for your kind responce.

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627571#comment-14627571 ] Rohith Sharma K S commented on YARN-3535: - bq. wouldn't removing the if clause just

[jira] [Updated] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3893: --- Attachment: 0002-YARN-3893.patch Both RM in active state when Admin#transitionToActive

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627577#comment-14627577 ] Rohith Sharma K S commented on YARN-3535: - I was not handled recovering twise RR, I

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627576#comment-14627576 ] Rohith Sharma K S commented on YARN-3535: - bq. For preemption, container killed has

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627480#comment-14627480 ] Hadoop QA commented on YARN-3885: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627550#comment-14627550 ] Hadoop QA commented on YARN-3893: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627185#comment-14627185 ] Hadoop QA commented on YARN-1449: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-14 Thread zhihai xu (JIRA)
zhihai xu created YARN-3925: --- Summary: ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Key: YARN-3925 URL: https://issues.apache.org/jira/browse/YARN-3925 Project:

[jira] [Created] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2015-07-14 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-3926: --- Summary: Extend the YARN resource model for easier resource-type management and profiles Key: YARN-3926 URL: https://issues.apache.org/jira/browse/YARN-3926 Project:

[jira] [Commented] (YARN-3925) ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.

2015-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627340#comment-14627340 ] Hadoop QA commented on YARN-3925: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627404#comment-14627404 ] Xianyin Xin commented on YARN-3885: --- Agree [~leftnoteasy]. suppose we have a case

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627527#comment-14627527 ] Wangda Tan commented on YARN-3885: -- [~ajithshetty], Thanks for updating, instead of

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626833#comment-14626833 ] Varun Saxena commented on YARN-3893: Ok, lets add a flag. According to me, we need to

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626826#comment-14626826 ] Xuan Gong commented on YARN-3893: - Thanks for [~varun_saxena] and [~sunilg]. I am fine with

[jira] [Commented] (YARN-3924) Submitting an application to standby ResourceManager should respond better than Connection Refused

2015-07-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626840#comment-14626840 ] Xuan Gong commented on YARN-3924: - The submit application request should re-direct to the

[jira] [Updated] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3922: - Labels: (was: newbie) Introduce adaptive heartbeat between RM and NM

[jira] [Commented] (YARN-3922) Introduce adaptive heartbeat between RM and NM

2015-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14626866#comment-14626866 ] Wangda Tan commented on YARN-3922: -- Removed newbie label since it seems not a easy feature

  1   2   >