[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

2013-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754441#comment-13754441 ] Junping Du commented on YARN-771: - bq. an API should be clear by itself. That's a good

[jira] [Updated] (YARN-771) AMRMClient support for resource blacklisting

2013-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-771: Attachment: YARN-771-v4.patch AMRMClient support for resource blacklisting

[jira] [Updated] (YARN-879) Fix tests w.r.t o.a.h.y.server.resourcemanager.Application

2013-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-879: Attachment: YARN-879-v3.patch Sync up patch with latest trunk branch. Can someone take a review on this?

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754494#comment-13754494 ] Hadoop QA commented on YARN-771: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-879) Fix tests w.r.t o.a.h.y.server.resourcemanager.Application

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754505#comment-13754505 ] Hadoop QA commented on YARN-879: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-707) Add user info in the YARN ClientToken

2013-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754580#comment-13754580 ] Hudson commented on YARN-707: - SUCCESS: Integrated in Hadoop-Yarn-trunk #317 (See

[jira] [Commented] (YARN-1080) Improve help message for $ yarn logs

2013-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754586#comment-13754586 ] Hudson commented on YARN-1080: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #317 (See

[jira] [Commented] (YARN-1080) Improve help message for $ yarn logs

2013-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754671#comment-13754671 ] Hudson commented on YARN-1080: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1507 (See

[jira] [Commented] (YARN-707) Add user info in the YARN ClientToken

2013-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754741#comment-13754741 ] Hudson commented on YARN-707: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1534 (See

[jira] [Commented] (YARN-896) Roll up for long lived YARN

2013-08-30 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754787#comment-13754787 ] Robert Joseph Evans commented on YARN-896: -- I agree that providing a good way

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755048#comment-13755048 ] Xuan Gong commented on YARN-1065: - [~bikassaha] Please ignore the YARN-1065.1.patch, please

[jira] [Created] (YARN-1127) reservation exchange and excess reservation is not working for capacity scheduler

2013-08-30 Thread Omkar Vinit Joshi (JIRA)
Omkar Vinit Joshi created YARN-1127: --- Summary: reservation exchange and excess reservation is not working for capacity scheduler Key: YARN-1127 URL: https://issues.apache.org/jira/browse/YARN-1127

[jira] [Updated] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1065: Attachment: YARN-1065.2.patch NM should provide AuxillaryService data to the container

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-08-30 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755089#comment-13755089 ] Omkar Vinit Joshi commented on YARN-957: uploading a patch which only fixes excess

[jira] [Updated] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-08-30 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-957: --- Attachment: YARN-957-20130830.1.patch Capacity Scheduler tries to reserve the memory more

[jira] [Commented] (YARN-1127) reservation exchange and excess reservation is not working for capacity scheduler

2013-08-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755090#comment-13755090 ] Bikas Saha commented on YARN-1127: -- Isnt this similar to a jira opened by you already? The

[jira] [Commented] (YARN-1127) reservation exchange and excess reservation is not working for capacity scheduler

2013-08-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755095#comment-13755095 ] Bikas Saha commented on YARN-1127: -- How is this different from YARN-957

[jira] [Updated] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-08-30 Thread Trevor Lorimer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Trevor Lorimer updated YARN-696: Attachment: YARN-696.diff Okay i'll take your word for it, uploading latest diff. The unit tests

[jira] [Assigned] (YARN-1128) FifoPolicy.computeShares throws NPE on empty list of Schedulables

2013-08-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-1128: -- Assignee: Karthik Kambatla FifoPolicy.computeShares throws NPE on empty list of

[jira] [Commented] (YARN-1127) reservation exchange and excess reservation is not working for capacity scheduler

2013-08-30 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755103#comment-13755103 ] Omkar Vinit Joshi commented on YARN-1127: - No as per Arun I am separating out

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755115#comment-13755115 ] Hadoop QA commented on YARN-957: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1129) Job hungs when any node is blacklisted after RMrestart

2013-08-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1129: -- Assignee: Zhijie Shen Job hungs when any node is blacklisted after RMrestart

[jira] [Commented] (YARN-896) Roll up for long lived YARN

2013-08-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754812#comment-13754812 ] Jason Lowe commented on YARN-896: - bq. Chris, feel free to file a JIRA for rolling of stdout

[jira] [Created] (YARN-1129) Job hungs when any node is blacklisted after RMrestart

2013-08-30 Thread yeshavora (JIRA)
yeshavora created YARN-1129: --- Summary: Job hungs when any node is blacklisted after RMrestart Key: YARN-1129 URL: https://issues.apache.org/jira/browse/YARN-1129 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755063#comment-13755063 ] Hadoop QA commented on YARN-1065: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1127) reservation exchange and excess reservation is not working for capacity scheduler

2013-08-30 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755110#comment-13755110 ] Bikas Saha commented on YARN-1127: -- Then please clarify this in the description or

[jira] [Updated] (YARN-1098) Separate out RM services into Always On and Active

2013-08-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1098: --- Attachment: yarn-1098-1.patch Uploading a patch along the lines of my previous commit. The

[jira] [Updated] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1065: Attachment: YARN-1065.3.patch NM should provide AuxillaryService data to the container

[jira] [Created] (YARN-1130) Improve the log flushing for tasks when mapred.userlog.limit.kb is set

2013-08-30 Thread Paul Han (JIRA)
Paul Han created YARN-1130: -- Summary: Improve the log flushing for tasks when mapred.userlog.limit.kb is set Key: YARN-1130 URL: https://issues.apache.org/jira/browse/YARN-1130 Project: Hadoop YARN

[jira] [Updated] (YARN-1130) Improve the log flushing for tasks when mapred.userlog.limit.kb is set

2013-08-30 Thread Paul Han (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Han updated YARN-1130: --- Description: When userlog limit is set with something like this: {code} property

[jira] [Created] (YARN-1131) $ yarn logs should return a message log aggregation is during progress if YARN application is running

2013-08-30 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created YARN-1131: - Summary: $ yarn logs should return a message log aggregation is during progress if YARN application is running Key: YARN-1131 URL:

[jira] [Created] (YARN-1132) QueueMetrics.java has wrong comments

2013-08-30 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created YARN-1132: --- Summary: QueueMetrics.java has wrong comments Key: YARN-1132 URL: https://issues.apache.org/jira/browse/YARN-1132 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1090) Job does not get into Pending State

2013-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755227#comment-13755227 ] Jian He commented on YARN-1090: --- bq. My understanding was that an application is Pending if

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755228#comment-13755228 ] Hadoop QA commented on YARN-1065: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-888) clean up POM dependencies

2013-08-30 Thread Timothy St. Clair (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755236#comment-13755236 ] Timothy St. Clair commented on YARN-888: Our current list of JIRA's can be found

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755031#comment-13755031 ] Hadoop QA commented on YARN-696: {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-1133) AMRMClient should be able to blacklist nodes, and specify them in AllocateRequest

2013-08-30 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1133: - Summary: AMRMClient should be able to blacklist nodes, and specify them in AllocateRequest Key: YARN-1133 URL: https://issues.apache.org/jira/browse/YARN-1133 Project:

[jira] [Commented] (YARN-1117) Improve help message for $ yarn applications and $yarn node

2013-08-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755253#comment-13755253 ] Vinod Kumar Vavilapalli commented on YARN-1117: --- Looks good, +1. Checking

[jira] [Commented] (YARN-1117) Improve help message for $ yarn applications and $yarn node

2013-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755265#comment-13755265 ] Hudson commented on YARN-1117: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4355 (See

[jira] [Resolved] (YARN-1133) AMRMClient should be able to blacklist nodes, and specify them in AllocateRequest

2013-08-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-1133. --- Resolution: Duplicate AMRMClient should be able to blacklist nodes, and specify them in

[jira] [Commented] (YARN-1116) Populate AMRMTokens back to AMRMTokenSecretManager after RM restarts

2013-08-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755278#comment-13755278 ] Jian He commented on YARN-1116: --- Looks like simply populating the password inside AMRMToken

[jira] [Updated] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1065: Attachment: YARN-1065.4.patch Fix -1 on findBug Modify the test case to test if environment variable is

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755303#comment-13755303 ] Hadoop QA commented on YARN-1065: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-771) AMRMClient support for resource blacklisting

2013-08-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755313#comment-13755313 ] Junping Du commented on YARN-771: - Thanks [~bikassaha] for review!

[jira] [Commented] (YARN-1116) Populate AMRMTokens back to AMRMTokenSecretManager after RM restarts

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755329#comment-13755329 ] Hadoop QA commented on YARN-1116: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1090) Job does not get into Pending State

2013-08-30 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755368#comment-13755368 ] Sandy Ryza commented on YARN-1090: -- Ah, ok, makes total sense Job does

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755382#comment-13755382 ] Xuan Gong commented on YARN-1065: - Thanks for the comments. Expose the ContainerManagerImpl

[jira] [Updated] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1065: Attachment: YARN-1065.5.patch NM should provide AuxillaryService data to the container

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755412#comment-13755412 ] Hadoop QA commented on YARN-1065: - {color:green}+1 overall{color}. Here are the results of