[jira] [Reopened] (YARN-1413) [YARN-321] AHS WebUI should server aggregated logs as well

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-1413: --- {code} + String logURL = containerReport.getLogUrl(); + logURL = getPartUrl(logURL, "log"); {cod

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866415#comment-13866415 ] Hadoop QA commented on YARN-1574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866411#comment-13866411 ] Karthik Kambatla commented on YARN-1574: Nice test, may be we can simplify it furth

[jira] [Updated] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1574: Attachment: YARN-1574.3.patch > When RM transit from Active to Standby, the same eventDispatcher should not

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866397#comment-13866397 ] Xuan Gong commented on YARN-1574: - bq. We should be careful and make sure all AlwaysOn serv

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1572: - Target Version/s: 2.4.0 > Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal > ---

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1572: - Component/s: scheduler > Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal >

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1572: - Affects Version/s: 2.2.0 > Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal > --

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1572: - Summary: Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal (was: Lower chance to hit NPE

[jira] [Assigned] (YARN-1572) Lower chance to hit NPE in allocateNodeLocal

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-1572: Assignee: Junping Du > Lower chance to hit NPE in allocateNodeLocal > -

[jira] [Commented] (YARN-1572) Lower chance to hit NPE in allocateNodeLocal

2014-01-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866384#comment-13866384 ] Junping Du commented on YARN-1572: -- Yes. It seems to be a YARN issue. I will take this. >

[jira] [Updated] (YARN-1579) ActiveRMInfoProto fields should be optional

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1579: --- Issue Type: Sub-task (was: Bug) Parent: YARN-149 > ActiveRMInfoProto fields should be

[jira] [Commented] (YARN-1568) Rename clusterid to clusterId in ActiveRMInfoProto

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866364#comment-13866364 ] Karthik Kambatla commented on YARN-1568: Thanks for the explanation, Vinod. I guess

[jira] [Created] (YARN-1579) ActiveRMInfoProto fields should be optional

2014-01-08 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-1579: -- Summary: ActiveRMInfoProto fields should be optional Key: YARN-1579 URL: https://issues.apache.org/jira/browse/YARN-1579 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1577: -- Affects Version/s: 2.4.0 > Unmanaged AM is broken because of YARN-1493 > ---

[jira] [Updated] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1577: -- Priority: Blocker (was: Major) > Unmanaged AM is broken because of YARN-1493 >

[jira] [Commented] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866339#comment-13866339 ] Jian He commented on YARN-1577: --- yup, marked as blocker > Unmanaged AM is broken because of

[jira] [Commented] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866335#comment-13866335 ] Zhijie Shen commented on YARN-1577: --- bq. We may need to introduce an attempt state report

[jira] [Commented] (YARN-1490) RM should optionally not kill all containers when an ApplicationMaster exits

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866333#comment-13866333 ] Hadoop QA commented on YARN-1490: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-1578) Fix how to handle ApplicationHistory about the container

2014-01-08 Thread Shinichi Yamashita (JIRA)
Shinichi Yamashita created YARN-1578: Summary: Fix how to handle ApplicationHistory about the container Key: YARN-1578 URL: https://issues.apache.org/jira/browse/YARN-1578 Project: Hadoop YARN

[jira] [Updated] (YARN-1578) Fix how to handle ApplicationHistory about the container

2014-01-08 Thread Shinichi Yamashita (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shinichi Yamashita updated YARN-1578: - Attachment: screenshot.png > Fix how to handle ApplicationHistory about the container > --

[jira] [Commented] (YARN-1345) RMServerUtils#createApplicationAttemptState needs to add the mapping for FINAL_SAVING

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866326#comment-13866326 ] Zhijie Shen commented on YARN-1345: --- bq. I think Jian He deliberately didn't add FINAL_SA

[jira] [Updated] (YARN-1490) RM should optionally not kill all containers when an ApplicationMaster exits

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1490: -- Attachment: YARN-1490.5.patch > RM should optionally not kill all containers when an ApplicationMaster exits > -

[jira] [Commented] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866308#comment-13866308 ] Alejandro Abdelnur commented on YARN-1577: -- this seems a serius regression, should

[jira] [Comment Edited] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866308#comment-13866308 ] Alejandro Abdelnur edited comment on YARN-1577 at 1/9/14 4:34 AM: ---

[jira] [Commented] (YARN-1567) In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866306#comment-13866306 ] Vinod Kumar Vavilapalli commented on YARN-1567: --- Empty queues or stopped queu

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866304#comment-13866304 ] Hadoop QA commented on YARN-1574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866301#comment-13866301 ] Vinod Kumar Vavilapalli commented on YARN-888: -- bq. We should normalize the lea

[jira] [Commented] (YARN-1568) Rename clusterid to clusterId in ActiveRMInfoProto

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866293#comment-13866293 ] Vinod Kumar Vavilapalli commented on YARN-1568: --- oh, there is a bit of religi

[jira] [Commented] (YARN-1490) RM should optionally not kill all containers when an ApplicationMaster exits

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866294#comment-13866294 ] Hadoop QA commented on YARN-1490: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1496) Protocol additions to allow moving apps between queues

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866288#comment-13866288 ] Vinod Kumar Vavilapalli commented on YARN-1496: --- 'ChangeApplicationQueue' see

[jira] [Commented] (YARN-1568) Rename clusterid to clusterId in ActiveRMInfoProto

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866289#comment-13866289 ] Karthik Kambatla commented on YARN-1568: bq. our convention is to mark all fields a

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866282#comment-13866282 ] Karthik Kambatla commented on YARN-1574: bq. I think that they are fine because all

[jira] [Commented] (YARN-1345) RMServerUtils#createApplicationAttemptState needs to add the mapping for FINAL_SAVING

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866281#comment-13866281 ] Vinod Kumar Vavilapalli commented on YARN-1345: --- I think [~jianhe] deliberate

[jira] [Updated] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1574: Attachment: YARN-1574.2.patch > When RM transit from Active to Standby, the same eventDispatcher should not

[jira] [Commented] (YARN-1166) YARN 'appsFailed' metric should be of type 'counter'

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866276#comment-13866276 ] Jian He commented on YARN-1166: --- @zhijie, last time I checked YARN-915 should be caused by th

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866271#comment-13866271 ] Hadoop QA commented on YARN-1574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1574: Attachment: YARN-1574.2.patch > When RM transit from Active to Standby, the same eventDispatcher should not

[jira] [Commented] (YARN-1166) YARN 'appsFailed' metric should be of type 'counter'

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866266#comment-13866266 ] Vinod Kumar Vavilapalli commented on YARN-1166: --- One comment other than Jian'

[jira] [Commented] (YARN-1490) RM should optionally not kill all containers when an ApplicationMaster exits

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866267#comment-13866267 ] Jian He commented on YARN-1490: --- bq. What about NMTokens? Imagine this. AM1 requests a contai

[jira] [Commented] (YARN-1490) RM should optionally not kill all containers when an ApplicationMaster exits

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866264#comment-13866264 ] Jian He commented on YARN-1490: --- Uploaded a new patch bq. Change it also transfer running c

[jira] [Updated] (YARN-1490) RM should optionally not kill all containers when an ApplicationMaster exits

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1490: -- Attachment: YARN-1490.4.patch Thanks Vinod for such detailed comments ! > RM should optionally not kill all c

[jira] [Commented] (YARN-1568) Rename clusterid to clusterId in ActiveRMInfoProto

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866254#comment-13866254 ] Vinod Kumar Vavilapalli commented on YARN-1568: --- Hey. I missed this before, b

[jira] [Created] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-01-08 Thread Jian He (JIRA)
Jian He created YARN-1577: - Summary: Unmanaged AM is broken because of YARN-1493 Key: YARN-1577 URL: https://issues.apache.org/jira/browse/YARN-1577 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Assigned] (YARN-1576) Allow setting RPC timeout in ApplicationClientProtocolPBClientImpl

2014-01-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-1576: Assignee: Sandy Ryza > Allow setting RPC timeout in ApplicationClientProtocolPBClientImpl >

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866162#comment-13866162 ] Alejandro Abdelnur commented on YARN-888: - Karthik, thanks for the verification. An

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866156#comment-13866156 ] Xuan Gong commented on YARN-1574: - bq. It is probably better to cast to Service instead of

[jira] [Created] (YARN-1576) Allow setting RPC timeout in ApplicationClientProtocolPBClientImpl

2014-01-08 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-1576: Summary: Allow setting RPC timeout in ApplicationClientProtocolPBClientImpl Key: YARN-1576 URL: https://issues.apache.org/jira/browse/YARN-1576 Project: Hadoop YARN

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866123#comment-13866123 ] Karthik Kambatla commented on YARN-888: --- Ran all Yarn tests locally without failures.

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866111#comment-13866111 ] Karthik Kambatla commented on YARN-1574: Approach looks reasonable. Comments: # It

[jira] [Updated] (YARN-1575) Public localizer crashes with "Localized unkown resource"

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1575: -- Issue Type: Sub-task (was: Bug) Parent: YARN-543 > Public localizer cra

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866098#comment-13866098 ] Xuan Gong commented on YARN-1574: - [~kkambatl] Could you take a look ? > When RM transit

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866089#comment-13866089 ] Hadoop QA commented on YARN-1574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-01-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1530: -- Attachment: application timeline design-20140108.pdf Attached is the designed

[jira] [Commented] (YARN-1567) In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866075#comment-13866075 ] Hadoop QA commented on YARN-1567: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1574: Attachment: YARN-1574.1.patch > When RM transit from Active to Standby, the same eventDispatcher should not

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866056#comment-13866056 ] Hadoop QA commented on YARN-1574: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-967: - Attachment: YARN-967.15.patch Created an updated patch that applies to the latest trunk. > [YARN-321] Comm

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866042#comment-13866042 ] Xuan Gong commented on YARN-1574: - +1 on option2. But I think that the resetDispatcher meth

[jira] [Updated] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1574: Attachment: YARN-1574.1.patch > When RM transit from Active to Standby, the same eventDispatcher should not

[jira] [Updated] (YARN-953) [YARN-321] Enable ResourceManager to write history data

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-953: - Attachment: YARN-953.9.patch Created an updated patch that applies to the latest trunk. > [YARN-321] Enabl

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866030#comment-13866030 ] Karthik Kambatla commented on YARN-888: --- Running all yarn tests locally to be on the s

[jira] [Updated] (YARN-1567) In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload

2014-01-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1567: - Attachment: YARN-1567-1.patch > In Fair Scheduler, allow empty queues to change between leaf and parent on

[jira] [Updated] (YARN-974) RMContainer should collect more useful information to be recorded in Application-History

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-974: - Attachment: YARN-974.5.patch Created an updated patch that applies to the latest trunk. > RMContainer shou

[jira] [Updated] (YARN-979) [YARN-321] Add more APIs related to ApplicationAttempt and Container in ApplicationHistoryProtocol

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-979: - Attachment: YARN-979.7.patch Created an updated patch that applies to the latest trunk. > [YARN-321] Add m

[jira] [Commented] (YARN-1345) RMServerUtils#createApplicationAttemptState needs to add the mapping for FINAL_SAVING

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866018#comment-13866018 ] Hadoop QA commented on YARN-1345: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13866017#comment-13866017 ] Alejandro Abdelnur commented on YARN-888: - I've run the resourcemanager and nodemana

[jira] [Updated] (YARN-1345) RMServerUtils#createApplicationAttemptState needs to add the mapping for FINAL_SAVING

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1345: -- Attachment: YARN-1345.1.patch Upload a patch that updates the commit: {quote} git-svn-id: https://svn.a

[jira] [Updated] (YARN-947) Defining the history data classes for the implementation of the reading/writing interface

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-947: - Attachment: YARN-947.9.patch Created an updated patch that applies to the latest trunk. With it, we don't

[jira] [Updated] (YARN-935) YARN-321 branch is broken due to applicationhistoryserver module's pom.xml

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-935: - Attachment: YARN-935.2.patch Created an updated patch that applies to the latest trunk. With it, we don't

[jira] [Updated] (YARN-1567) In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload

2014-01-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1567: - Summary: In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload

[jira] [Commented] (YARN-1567) In Fair Scheduler, allow empty leaf queues to become parent queues on allocation file reload

2014-01-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865958#comment-13865958 ] Sandy Ryza commented on YARN-1567: -- Test failure is unrelated > In Fair Scheduler, allow

[jira] [Commented] (YARN-1575) Public localizer crashes with "Localized unkown resource"

2014-01-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865956#comment-13865956 ] Jason Lowe commented on YARN-1575: -- I think there's a race condition in the public localiz

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865953#comment-13865953 ] Hadoop QA commented on YARN-888: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-1575) Public localizer crashes with "Localized unkown resource"

2014-01-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865949#comment-13865949 ] Jason Lowe commented on YARN-1575: -- This ultimately will bring down the NM later with this

[jira] [Created] (YARN-1575) Public localizer crashes with "Localized unkown resource"

2014-01-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-1575: Summary: Public localizer crashes with "Localized unkown resource" Key: YARN-1575 URL: https://issues.apache.org/jira/browse/YARN-1575 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-1138) yarn.application.classpath is set to point to $HADOOP_CONF_DIR etc., which does not work on Windows

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865927#comment-13865927 ] Hadoop QA commented on YARN-1138: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865905#comment-13865905 ] Arun C Murthy commented on YARN-1197: - I'd appreciate that, thanks [~sandyr]! > Suppor

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865847#comment-13865847 ] Hadoop QA commented on YARN-888: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (YARN-888) clean up POM dependencies

2014-01-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-888: Attachment: YARN-888.patch new patch adding missing hadoop-common test JARs in a few modules.

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865830#comment-13865830 ] Roman Shaposhnik commented on YARN-888: --- +1 > clean up POM dependencies > ---

[jira] [Commented] (YARN-1041) Protocol changes for RM to bind and notify a restarted AM of existing containers

2014-01-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865795#comment-13865795 ] Jian He commented on YARN-1041: --- bq. there's a lot of duplication across each scheduler's {{

[jira] [Updated] (YARN-1138) yarn.application.classpath is set to point to $HADOOP_CONF_DIR etc., which does not work on Windows

2014-01-08 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated YARN-1138: Attachment: YARN-1138.patch The default value for "yarn.application.classpath" is already properly defined

[jira] [Commented] (YARN-1567) In Fair Scheduler, allow empty leaf queues to become parent queues on allocation file reload

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865785#comment-13865785 ] Hadoop QA commented on YARN-1567: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865780#comment-13865780 ] Karthik Kambatla commented on YARN-1574: [~xgong], [~bikassaha] - what do you think

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865773#comment-13865773 ] Karthik Kambatla commented on YARN-1574: Good catch, [~xgong]. I see two ways of ha

[jira] [Updated] (YARN-1399) Allow users to annotate an application with multiple tags

2014-01-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1399: -- Assignee: (was: Zhijie Shen) Mark the ticket Unassigned as more than one may work on it. > Allow us

[jira] [Updated] (YARN-1567) In Fair Scheduler, allow empty leaf queues to become parent queues on allocation file reload

2014-01-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1567: - Attachment: YARN-1567.patch > In Fair Scheduler, allow empty leaf queues to become parent queues on > all

[jira] [Commented] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865741#comment-13865741 ] Xuan Gong commented on YARN-1574: - For example, we have two RMs, RM1 and RM2, and one NM. W

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-01-08 Thread Kendall Thrapp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865739#comment-13865739 ] Kendall Thrapp commented on YARN-415: - Thanks Andrey for all your work on this! I'm loo

[jira] [Created] (YARN-1574) When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once

2014-01-08 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-1574: --- Summary: When RM transit from Active to Standby, the same eventDispatcher should not be registered more than once Key: YARN-1574 URL: https://issues.apache.org/jira/browse/YARN-1574

[jira] [Assigned] (YARN-1015) FS should watch resource utilization of containers and allocate speculative containers if appropriate

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-1015: -- Assignee: (was: Karthik Kambatla) > FS should watch resource utilization of containe

[jira] [Assigned] (YARN-1003) Add a maxContainersPerNode config to the Fair Scheduler

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-1003: -- Assignee: (was: Karthik Kambatla) > Add a maxContainersPerNode config to the Fair Sc

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865691#comment-13865691 ] Karthik Kambatla commented on YARN-1399: bq. Adding a field to GetApplicationsReque

[jira] [Resolved] (YARN-1390) Provide a way to capture source of an application to be queried through REST or Java Client APIs

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1390. Resolution: Duplicate >From the progress on YARN-1399, it doesn't look like there will be an

[jira] [Resolved] (YARN-1460) Revisit YARN client connection configs

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1460. Resolution: Not A Problem YARN-1028 addresses all the ideas I had in mind. Closing this as "

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865674#comment-13865674 ] Karthik Kambatla commented on YARN-888: --- Ran tests in unmanaged-am-launcher locally wi

[jira] [Created] (YARN-1573) ZK store should pick a private password for root-node-acls

2014-01-08 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-1573: -- Summary: ZK store should pick a private password for root-node-acls Key: YARN-1573 URL: https://issues.apache.org/jira/browse/YARN-1573 Project: Hadoop YARN

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865653#comment-13865653 ] Hadoop QA commented on YARN-888: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-888) clean up POM dependencies

2014-01-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865642#comment-13865642 ] Steve Loughran commented on YARN-888: - This is a pretty big patch -though I see what it

  1   2   >