[jira] [Commented] (YARN-3006) Improve the error message when attempting manual failover with auto-failover enabled

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267455#comment-14267455 ] Hadoop QA commented on YARN-3006: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2996) Refine some fs operations in FileSystemRMStateStore to improve performance

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267388#comment-14267388 ] Hadoop QA commented on YARN-2996: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3006) Improve the error message when attempting manual failover with auto-failover enabled

2015-01-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-3006: Attachment: YARN-3006.001.patch Attaching a simple patch. Improve the error message when

[jira] [Commented] (YARN-2427) Add support for moving apps between queues in RM web services

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267545#comment-14267545 ] Hudson commented on YARN-2427: -- FAILURE: Integrated in Hadoop-Yarn-trunk #800 (See

[jira] [Commented] (YARN-2427) Add support for moving apps between queues in RM web services

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267663#comment-14267663 ] Hudson commented on YARN-2427: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1998 (See

[jira] [Commented] (YARN-2978) ResourceManager crashes with NPE while getting queue info

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267664#comment-14267664 ] Hudson commented on YARN-2978: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1998 (See

[jira] [Commented] (YARN-2978) ResourceManager crashes with NPE while getting queue info

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267540#comment-14267540 ] Hudson commented on YARN-2978: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #66 (See

[jira] [Commented] (YARN-2427) Add support for moving apps between queues in RM web services

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267539#comment-14267539 ] Hudson commented on YARN-2427: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #66 (See

[jira] [Commented] (YARN-2978) ResourceManager crashes with NPE while getting queue info

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267546#comment-14267546 ] Hudson commented on YARN-2978: -- FAILURE: Integrated in Hadoop-Yarn-trunk #800 (See

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2015-01-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268756#comment-14268756 ] Sunil G commented on YARN-2933: --- Hi [~mayank_bansal] and [~wangda] This is a very needed

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-01-07 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268767#comment-14268767 ] Gera Shegalov commented on YARN-2934: - bq. Given this, even the tailed stderr is not

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268761#comment-14268761 ] Vinod Kumar Vavilapalli commented on YARN-2934: --- bq. Yes it's related, but

[jira] [Created] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

2015-01-07 Thread MUFEED USMAN (JIRA)
MUFEED USMAN created YARN-3017: -- Summary: ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID Key: YARN-3017 URL: https://issues.apache.org/jira/browse/YARN-3017 Project:

[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.

2015-01-07 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2637: -- Attachment: YARN-2637.32.patch Check tests using absoluteCapacity for userAmLimit

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268887#comment-14268887 ] Hadoop QA commented on YARN-2637: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2637) maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268791#comment-14268791 ] Hadoop QA commented on YARN-2637: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3017) ContainerID in ResourceManager Log Has Slightly Different Format From AppAttemptID

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268853#comment-14268853 ] Rohith commented on YARN-3017: -- which version are you using? I donot see this behavior in

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Andrew Johnson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268449#comment-14268449 ] Andrew Johnson commented on YARN-2893: -- I'm seeing this error on a non-secure cluster.

[jira] [Commented] (YARN-1743) Decorate event transitions and the event-types with their behaviour

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268456#comment-14268456 ] Wangda Tan commented on YARN-1743: -- [~zjffdu], Thanks for working on this ticket, the

[jira] [Commented] (YARN-1743) Decorate event transitions and the event-types with their behaviour

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268465#comment-14268465 ] Hadoop QA commented on YARN-1743: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1743) Decorate event transitions and the event-types with their behaviour

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1743: - Labels: documentation (was: ) Decorate event transitions and the event-types with their behaviour

[jira] [Commented] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-07 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268506#comment-14268506 ] Chris K Wensel commented on YARN-3009: -- Feels as if the api is becoming conflated if

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268546#comment-14268546 ] Jian He commented on YARN-2997: --- ah, I think the problem that container statuses whose

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150107-1-full.patch Updated against latest trunk Create yarn cluster CLI

[jira] [Commented] (YARN-2936) YARNDelegationTokenIdentifier doesn't set proto.builder now

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268570#comment-14268570 ] Hudson commented on YARN-2936: -- FAILURE: Integrated in Hadoop-trunk-Commit #6825 (See

[jira] [Updated] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2786: - Attachment: YARN-2786-20150107-1-without-yarn.cmd.patch Create yarn cluster CLI to enable list node

[jira] [Updated] (YARN-2996) Refine some fs operations in FileSystemRMStateStore to improve performance

2015-01-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated YARN-2996: - Attachment: YARN-2996.004.patch Good idea Zhijie, update the patch. Refine some fs operations in

[jira] [Commented] (YARN-3010) Fix recent findbug issue in AbstractYarnScheduler

2015-01-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268587#comment-14268587 ] Yi Liu commented on YARN-3010: -- Thanks [~jianhe] and [~rohithsharma] Fix recent findbug

[jira] [Updated] (YARN-2996) Refine fs operations in FileSystemRMStateStore and few fixes

2015-01-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated YARN-2996: - Summary: Refine fs operations in FileSystemRMStateStore and few fixes (was: Refine some fs operations in

[jira] [Commented] (YARN-2880) Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268596#comment-14268596 ] Hudson commented on YARN-2880: -- FAILURE: Integrated in Hadoop-trunk-Commit #6826 (See

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268606#comment-14268606 ] Vinod Kumar Vavilapalli commented on YARN-160: -- Quick comments on the patch: -

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268623#comment-14268623 ] Vinod Kumar Vavilapalli commented on YARN-2893: --- That is very interesting. In

[jira] [Created] (YARN-3015) yarn classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
Chris Nauroth created YARN-3015: --- Summary: yarn classpath command should support same options as hadoop classpath. Key: YARN-3015 URL: https://issues.apache.org/jira/browse/YARN-3015 Project: Hadoop

[jira] [Commented] (YARN-3015) yarn classpath command should support same options as hadoop classpath.

2015-01-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268630#comment-14268630 ] Chris Nauroth commented on YARN-3015: - Thanks to [~aw] for reporting it. yarn

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268631#comment-14268631 ] Wangda Tan commented on YARN-2933: -- In addition to previously comment, I think we put

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268639#comment-14268639 ] Vinod Kumar Vavilapalli commented on YARN-2934: --- This seems like it is same

[jira] [Assigned] (YARN-3015) yarn classpath command should support same options as hadoop classpath.

2015-01-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3015: -- Assignee: Varun Saxena yarn classpath command should support same options as hadoop classpath.

[jira] [Commented] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268644#comment-14268644 ] Naganarasimha G R commented on YARN-3009: - Hi [~zjshen], Thanks for pointing

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-01-07 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12690672/YARN-2786-20150107-1-without-yarn.cmd.patch against trunk revision ef237bd. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color

[jira] [Created] (YARN-3016) (Refactoring) Merge internalAdd/Remove/ReplaceLabels to one method in CommonNodeLabelsManager

2015-01-07 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3016: Summary: (Refactoring) Merge internalAdd/Remove/ReplaceLabels to one method in CommonNodeLabelsManager Key: YARN-3016 URL: https://issues.apache.org/jira/browse/YARN-3016

[jira] [Commented] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268110#comment-14268110 ] Hadoop QA commented on YARN-3009: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268162#comment-14268162 ] Rohith commented on YARN-3013: -- AYS#containerLaunchedOnNode and AYS#killOrphanContainerOnNode

[jira] [Assigned] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-3013: Assignee: Rohith Findbugs warning aboutAbstractYarnScheduler.rmContext

[jira] [Updated] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3013: - Attachment: 0001-YARN-3013.patch Findbugs warning aboutAbstractYarnScheduler.rmContext

[jira] [Commented] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268179#comment-14268179 ] Rohith commented on YARN-3013: -- [~zjshen] kindly review analysis and patch Findbugs warning

[jira] [Resolved] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3013. --- Resolution: Duplicate Close it as the duplicate. Thanks for pointing it out. Findbugs warning

[jira] [Created] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3013: - Summary: Findbugs warning aboutAbstractYarnScheduler.rmContext Key: YARN-3013 URL: https://issues.apache.org/jira/browse/YARN-3013 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268160#comment-14268160 ] Billie Rinaldi commented on YARN-3009: -- bq. the nested Json structure will be mistaken

[jira] [Commented] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268171#comment-14268171 ] Rohith commented on YARN-3013: -- There will not be any possibility of deadlock by adding

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Andrew Johnson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268193#comment-14268193 ] Andrew Johnson commented on YARN-2893: -- I've also noticed that if multiple jobs are

[jira] [Commented] (YARN-3010) Fix recent findbug issue in AbstractYarnScheduler

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268188#comment-14268188 ] Rohith commented on YARN-3010: -- +1(non-binding) LGTM. Fix recent findbug issue in

[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2637: - Summary: maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Andrew Johnson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268183#comment-14268183 ] Andrew Johnson commented on YARN-2893: -- I am also encountering this same error. The

[jira] [Commented] (YARN-3013) Findbugs warning aboutAbstractYarnScheduler.rmContext

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268184#comment-14268184 ] Rohith commented on YARN-3013: -- Oho,I was not seen earlier!! This issue is duplicate of

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Andrew Johnson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268359#comment-14268359 ] Andrew Johnson commented on YARN-2893: -- No, it's at least 95% Scalding jobs.

[jira] [Updated] (YARN-3014) Changing labels on a host should update all NM's labels on that host

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3014: - Description: Admin can either specify labels on a host (by running {{yarn rmadmin

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

2015-01-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268403#comment-14268403 ] Jason Lowe commented on YARN-2902: -- Thanks for the patch, Varun! I think the patch will

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Andrew Johnson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268340#comment-14268340 ] Andrew Johnson commented on YARN-2893: -- [~jira.shegalov] This is always with Scalding

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268356#comment-14268356 ] Gera Shegalov commented on YARN-2893: - Is there a significant fraction of other type of

[jira] [Commented] (YARN-3010) Fix recent findbug issue in AbstractYarnScheduler

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268391#comment-14268391 ] Hudson commented on YARN-3010: -- FAILURE: Integrated in Hadoop-trunk-Commit #6823 (See

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268334#comment-14268334 ] Gera Shegalov commented on YARN-2893: - Hi [~ajsquared], what type of jobs are you

[jira] [Commented] (YARN-3003) Provide API for client to retrieve label to node mapping

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268382#comment-14268382 ] Wangda Tan commented on YARN-3003: -- Relationship between NMs and labels is more than a

[jira] [Created] (YARN-3014) Changing labels on a host should update all NM's labels on that host

2015-01-07 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3014: Summary: Changing labels on a host should update all NM's labels on that host Key: YARN-3014 URL: https://issues.apache.org/jira/browse/YARN-3014 Project: Hadoop YARN

[jira] [Assigned] (YARN-3014) Changing labels on a host should update all NM's labels on that host

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-3014: Assignee: Wangda Tan Changing labels on a host should update all NM's labels on that host

[jira] [Updated] (YARN-3014) Changing labels on a host should update all NM's labels on that host

2015-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3014: - Issue Type: Sub-task (was: Bug) Parent: YARN-2492 Changing labels on a host should update all

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268424#comment-14268424 ] Vinod Kumar Vavilapalli commented on YARN-2893: --- Is this in a secure cluster

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268670#comment-14268670 ] Chengbing Liu commented on YARN-2997: - Yes, a HashMap should be enough. I will upload a

[jira] [Commented] (YARN-2786) Create yarn cluster CLI to enable list node labels collection

2015-01-07 Thread Allen Wittenauer (JIRA)
-2786-20141103-1-without-yarn.cmd.patch, YARN-2786-20141104-1-full.patch, YARN-2786-20141104-1-without-yarn.cmd.patch, YARN-2786-20141104-2-full.patch, YARN-2786-20141104-2-without-yarn.cmd.patch, YARN-2786-20150107-1-full.patch, YARN-2786-20150107-1-without-yarn.cmd.patch With YARN-2778, we

[jira] [Updated] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengbing Liu updated YARN-2997: Attachment: YARN-2997.5.patch Update: use HashMap instead of LinkedHashMap. NM keeps sending

[jira] [Commented] (YARN-2996) Refine fs operations in FileSystemRMStateStore and few fixes

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268687#comment-14268687 ] Hadoop QA commented on YARN-2996: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-01-07 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268712#comment-14268712 ] Gera Shegalov commented on YARN-2934: - Yes it's related, but not exclusive to AM (try

[jira] [Commented] (YARN-2997) NM keeps sending finished containers to RM until app is finished

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268714#comment-14268714 ] Hadoop QA commented on YARN-2997: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-644) Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-644: - Issue Type: Sub-task (was: Bug) Parent: YARN-662 Basic null check is not

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268735#comment-14268735 ] Vinod Kumar Vavilapalli commented on YARN-3011: --- This is a part of YARN-662 -

[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications.

2015-01-07 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2637: -- Attachment: YARN-2637.31.patch See what happens when maxActiveApplications and

[jira] [Updated] (YARN-662) [Umbrella] Enforce required parameters for all the protocols

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-662: - Summary: [Umbrella] Enforce required parameters for all the protocols (was:

[jira] [Commented] (YARN-3016) (Refactoring) Merge internalAdd/Remove/ReplaceLabels to one method in CommonNodeLabelsManager

2015-01-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268736#comment-14268736 ] Sunil G commented on YARN-3016: --- HI [~wangda] Thanks for bringing up this. I have a doubt

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3011: -- Issue Type: Sub-task (was: Bug) Parent: YARN-662 NM dies because of

[jira] [Assigned] (YARN-644) Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer

2015-01-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-644: - Assignee: Varun Saxena Basic null check is not performed on passed in arguments before using them

[jira] [Commented] (YARN-2571) RM to support YARN registry

2015-01-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268752#comment-14268752 ] Vinod Kumar Vavilapalli commented on YARN-2571: --- Apologies for coming in

[jira] [Commented] (YARN-2978) ResourceManager crashes with NPE while getting queue info

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267748#comment-14267748 ] Hudson commented on YARN-2978: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2017 (See

[jira] [Commented] (YARN-2427) Add support for moving apps between queues in RM web services

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267747#comment-14267747 ] Hudson commented on YARN-2427: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2017 (See

[jira] [Updated] (YARN-2807) Option --forceactive not works as described in usage of yarn rmadmin -transitionToActive

2015-01-07 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2807: --- Attachment: YARN-2807.3.patch Removed trailing whitespaces. Option --forceactive not works

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-01-07 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated YARN-2934: Priority: Critical (was: Major) Improve handling of container's stderr

[jira] [Commented] (YARN-2807) Option --forceactive not works as described in usage of yarn rmadmin -transitionToActive

2015-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267858#comment-14267858 ] Hadoop QA commented on YARN-2807: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3012) Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

2015-01-07 Thread Dinh Hoang Mai (JIRA)
Dinh Hoang Mai created YARN-3012: Summary: Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing Key: YARN-3012 URL: https://issues.apache.org/jira/browse/YARN-3012 Project: Hadoop YARN

[jira] [Updated] (YARN-3012) Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

2015-01-07 Thread Dinh Hoang Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinh Hoang Mai updated YARN-3012: - Description: I have just started to work with Hadoop 2. After installing with basic configs, I

[jira] [Commented] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-07 Thread Chris K Wensel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267883#comment-14267883 ] Chris K Wensel commented on YARN-3009: -- First, it's a little odd to put a value in

[jira] [Updated] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2015-01-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-160: --- Attachment: apache-yarn-160.3.patch Uploaded a new patch - apache-yarn-160.3.patch. 1. rebase to trunk

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2015-01-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267938#comment-14267938 ] Allen Wittenauer commented on YARN-160: --- bq. RAM-2*HADOOP_HEAPSIZE

[jira] [Commented] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2015-01-07 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267962#comment-14267962 ] Mayank Bansal commented on YARN-2933: - Thanks [~wangda] for review. 1. Fixed, I should

[jira] [Updated] (YARN-2933) Capacity Scheduler preemption policy should only consider capacity without labels temporarily

2015-01-07 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2933: Attachment: YARN-2933-5.patch Updating patch. Thanks, Mayank Capacity Scheduler preemption policy

[jira] [Commented] (YARN-2996) Refine some fs operations in FileSystemRMStateStore to improve performance

2015-01-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267991#comment-14267991 ] Zhijie Shen commented on YARN-2996: --- Almost good to me. Just one nit: can we reuse

[jira] [Commented] (YARN-2230) Fix description of yarn.scheduler.maximum-allocation-vcores in yarn-default.xml (or code)

2015-01-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268020#comment-14268020 ] Hudson commented on YARN-2230: -- FAILURE: Integrated in Hadoop-trunk-Commit #6821 (See

[jira] [Commented] (YARN-3010) Fix recent findbug issue in AbstractYarnScheduler

2015-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268032#comment-14268032 ] Jian He commented on YARN-3010: --- lgtm Fix recent findbug issue in AbstractYarnScheduler

[jira] [Updated] (YARN-3009) TimelineWebServices always parses primary and secondary filters as numbers if first char is a number

2015-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3009: Attachment: YARN-3009.20150108-1.patch Attaching the patch TimelineWebServices always

[jira] [Commented] (YARN-3000) YARN_PID_DIR should be visible in yarn-env.sh

2015-01-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268050#comment-14268050 ] Rohith commented on YARN-3000: -- Thanks [~aw] for mentioning the lira id. I will close the

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2015-01-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267936#comment-14267936 ] Varun Vasudev commented on YARN-160: The findbugs warnings are unrelated to the patch.

[jira] [Updated] (YARN-3012) Hadoop 2.6.0: Basic error “starting MRAppMaster” after installing

2015-01-07 Thread Dinh Hoang Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinh Hoang Mai updated YARN-3012: - Environment: Ubuntu 64bit (was: CentOS 64bit) Hadoop 2.6.0: Basic error “starting MRAppMaster”

[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

2015-01-07 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2637: -- Attachment: YARN-2637.30.patch userAMLimit logic included as well, now with a test :-)

  1   2   >