[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765187#comment-13765187 ] Bikas Saha commented on YARN-540: - I think there is a member variable in AMRMClient that is

[jira] [Commented] (YARN-1176) RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes

[ https://issues.apache.org/jira/browse/YARN-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765329#comment-13765329 ] Hudson commented on YARN-1176: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #330 (See

[jira] [Created] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

J.Andreina created YARN-1184: Summary: ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA Key: YARN-1184 URL:

[jira] [Commented] (YARN-1176) RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes

[ https://issues.apache.org/jira/browse/YARN-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765352#comment-13765352 ] Hudson commented on YARN-1176: -- FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #728 (See

[jira] [Commented] (YARN-1176) RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes

[ https://issues.apache.org/jira/browse/YARN-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765417#comment-13765417 ] Hudson commented on YARN-1176: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1520 (See

[jira] [Commented] (YARN-1176) RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes

[ https://issues.apache.org/jira/browse/YARN-1176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765444#comment-13765444 ] Hudson commented on YARN-1176: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1546 (See

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765538#comment-13765538 ] Karthik Kambatla commented on YARN-1183: Patch looks mostly good. Few comments: #

[jira] [Updated] (YARN-1078) TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows

[ https://issues.apache.org/jira/browse/YARN-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-1078: Target Version/s: 3.0.0, 2.1.1-beta Affects Version/s: (was: 2.3.0)

[jira] [Commented] (YARN-1185) FileSystemRMStateStore doesn't use temporary files when writing data

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765649#comment-13765649 ] Bikas Saha commented on YARN-1185: -- Yes. Since FileSystem interface does not provide any

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.patch Yarn Scheduler Load Simulator -

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: (was: YARN-1021.pdf) Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-1149) NM throws InvalidStateTransitonException: Invalid event: APPLICATION_LOG_HANDLING_FINISHED at RUNNING

[ https://issues.apache.org/jira/browse/YARN-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765722#comment-13765722 ] Xuan Gong commented on YARN-1149: - bq.It creates additional overhead, as the events will be

[jira] [Commented] (YARN-1166) YARN 'appsFailed' metric should be of type 'counter'

[ https://issues.apache.org/jira/browse/YARN-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765709#comment-13765709 ] Akira AJISAKA commented on YARN-1166: - [~vinodkv], thanks for your comment. I

[jira] [Updated] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-1021: -- Attachment: YARN-1021.pdf Yarn Scheduler Load Simulator -

[jira] [Commented] (YARN-1078) TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows

[ https://issues.apache.org/jira/browse/YARN-1078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765562#comment-13765562 ] Hudson commented on YARN-1078: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4404 (See

[jira] [Updated] (YARN-867) Isolation of failures in aux services

[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-867: --- Attachment: YARN-867.4.patch Isolation of failures in aux services

[jira] [Commented] (YARN-867) Isolation of failures in aux services

[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765696#comment-13765696 ] Xuan Gong commented on YARN-867: NEW patch added more transitions in

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765760#comment-13765760 ] Luke Lu commented on YARN-311: -- I think the v6.2 patch looks reasonable. If there is no further

[jira] [Commented] (YARN-1166) YARN 'appsFailed' metric should be of type 'counter'

[ https://issues.apache.org/jira/browse/YARN-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765764#comment-13765764 ] Akira AJISAKA commented on YARN-1166: - [~srimanth.gunturi], this fix seems simple. I've

[jira] [Commented] (YARN-1185) FileSystemRMStateStore doesn't use temporary files when writing data

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765622#comment-13765622 ] Jason Lowe commented on YARN-1185: -- Also, couldn't it be left with zero-length files if it

[jira] [Commented] (YARN-1185) FileSystemRMStateStore doesn't use temporary files when writing data

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765620#comment-13765620 ] Jason Lowe commented on YARN-1185: -- Ah I see. That's an assumption based on a specific

[jira] [Commented] (YARN-1166) YARN 'appsFailed' metric should be of type 'counter'

[ https://issues.apache.org/jira/browse/YARN-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765716#comment-13765716 ] Srimanth Gunturi commented on YARN-1166: Isnt the fix as simple as changing

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765772#comment-13765772 ] Wei Yan commented on YARN-1021: --- Update a new patch according to [~curino]'s comments. Main

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765735#comment-13765735 ] Andrey Klochkov commented on YARN-1183: --- Yep, you're right about trackingUrl being

[jira] [Created] (YARN-1185) FileSystemRMStateStore doesn't use temporary files when writing data

Jason Lowe created YARN-1185: Summary: FileSystemRMStateStore doesn't use temporary files when writing data Key: YARN-1185 URL: https://issues.apache.org/jira/browse/YARN-1185 Project: Hadoop YARN

[jira] [Commented] (YARN-1130) Improve the log flushing for tasks when mapred.userlog.limit.kb is set

[ https://issues.apache.org/jira/browse/YARN-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765870#comment-13765870 ] Paul Han commented on YARN-1130: Patch is submitted. A few notes here: # Added a LogUtils

[jira] [Created] (YARN-1189) NMTokenSecretManagerInNM is not being told when applications have finished

Jason Lowe created YARN-1189: Summary: NMTokenSecretManagerInNM is not being told when applications have finished Key: YARN-1189 URL: https://issues.apache.org/jira/browse/YARN-1189 Project: Hadoop YARN

[jira] [Commented] (YARN-1185) FileSystemRMStateStore doesn't use temporary files when writing data

[ https://issues.apache.org/jira/browse/YARN-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765607#comment-13765607 ] Bikas Saha commented on YARN-1185: -- The expectation was that the data being written to

[jira] [Commented] (YARN-1183) MiniYARNCluster shutdown takes several minutes intermittently

[ https://issues.apache.org/jira/browse/YARN-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765891#comment-13765891 ] Hadoop QA commented on YARN-1183: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1166) YARN 'appsFailed' metric should be of type 'counter'

[ https://issues.apache.org/jira/browse/YARN-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-1166: Attachment: YARN-1166.3.patch YARN 'appsFailed' metric should be of type 'counter'

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765758#comment-13765758 ] Hadoop QA commented on YARN-1021: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-867) Isolation of failures in aux services

[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765730#comment-13765730 ] Hadoop QA commented on YARN-867: {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

Siqi Li created YARN-1190: - Summary: enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb Key: YARN-1190 URL:

[jira] [Updated] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1190: -- Description: Since there is no reducer, the memory allocated to reducer is irrelevant to enable uber mode of a

[jira] [Created] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

Akira AJISAKA created YARN-1188: --- Summary: The context of QueueMetrics becomes 'default' when using FairScheduler Key: YARN-1188 URL: https://issues.apache.org/jira/browse/YARN-1188 Project: Hadoop

[jira] [Updated] (YARN-1191) [YARN-321] Compilation is failing for YARN-321 branch

[ https://issues.apache.org/jira/browse/YARN-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-1191: Attachment: YARN-1191-1.patch Attaching patch. Thanks, Mayank [YARN-321]

[jira] [Created] (YARN-1191) [YARN-321] Compilation is failing for YARN-321 branch

Mayank Bansal created YARN-1191: --- Summary: [YARN-321] Compilation is failing for YARN-321 branch Key: YARN-1191 URL: https://issues.apache.org/jira/browse/YARN-1191 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1191) [YARN-321] Compilation is failing for YARN-321 branch

[ https://issues.apache.org/jira/browse/YARN-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-1191: Description: Compilation is failing for YARN-321 branch was:Like YARN-978, we need some

[jira] [Commented] (YARN-1191) [YARN-321] Compilation is failing for YARN-321 branch

[ https://issues.apache.org/jira/browse/YARN-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766005#comment-13766005 ] Hadoop QA commented on YARN-1191: - {color:red}-1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-1191) [YARN-321] Compilation is failing for YARN-321 branch

[ https://issues.apache.org/jira/browse/YARN-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal reassigned YARN-1191: --- Assignee: Mayank Bansal (was: Zhijie Shen) [YARN-321] Compilation is failing for

[jira] [Assigned] (YARN-1157) ResourceManager UI has invalid tracking URL link for distributed shell application

[ https://issues.apache.org/jira/browse/YARN-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1157: --- Assignee: Xuan Gong ResourceManager UI has invalid tracking URL link for distributed shell

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766028#comment-13766028 ] Mayank Bansal commented on YARN-978: If we can add the tracking url that would be useful

[jira] [Updated] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-540: - Attachment: YARN-540.7.patch Race condition causing RM to potentially relaunch already unregistered AMs on

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766032#comment-13766032 ] Jian He commented on YARN-540: -- Thanks for the detailed comments, upload a new patch bq. there

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766040#comment-13766040 ] Hadoop QA commented on YARN-540: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-1188: Target Version/s: 2.3.0 The context of QueueMetrics becomes 'default' when using FairScheduler

[jira] [Updated] (YARN-1188) The context of QueueMetrics becomes 'default' when using FairScheduler

[ https://issues.apache.org/jira/browse/YARN-1188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-1188: Fix Version/s: (was: 2.3.0) (was: 3.0.0) The context of