[jira] [Commented] (YARN-1027) Implement RMHAServiceProtocol

2013-09-05 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759973#comment-13759973 ] Bikas Saha commented on YARN-1027: -- The patch look clean overall. I would suggest keepin

[jira] [Updated] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2013-09-05 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-1156: Hadoop Flags: Reviewed > Change NodeManager AllocatedGB and AvailableGB metrics to show decimal

[jira] [Commented] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2013-09-05 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759842#comment-13759842 ] Akira AJISAKA commented on YARN-1156: - [~ozawa], thanks for your patch. +1, the workaro

[jira] [Commented] (YARN-1145) Potential file handle leak in aggregated logs web ui

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759830#comment-13759830 ] Hadoop QA commented on YARN-1145: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1145) Potential file handle leak in aggregated logs web ui

2013-09-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-1145: Attachment: YARN-1145.3.patch Modified the patch for closing the streams only on "return" fr

[jira] [Commented] (YARN-713) ResourceManager can exit unexpectedly if DNS is unavailable

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759790#comment-13759790 ] Hadoop QA commented on YARN-713: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759787#comment-13759787 ] Hadoop QA commented on YARN-1156: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-09-05 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759786#comment-13759786 ] Omkar Vinit Joshi commented on YARN-957: [~ste...@apache.org] will post an update pa

[jira] [Updated] (YARN-713) ResourceManager can exit unexpectedly if DNS is unavailable

2013-09-05 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-713: --- Attachment: YARN-713.09052013.1.patch > ResourceManager can exit unexpectedly if DNS is una

[jira] [Updated] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2013-09-05 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1156: - Attachment: YARN-1156.1.patch This is quick workaround to deal with this problem: changed the unit

[jira] [Commented] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759756#comment-13759756 ] Hadoop QA commented on YARN-1152: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759746#comment-13759746 ] Hadoop QA commented on YARN-978: {color:red}-1 overall{color}. Here are the results of test

[jira] [Updated] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-978: --- Attachment: YARN-978.4.patch Remove host, rpc_port, tracking url, and change FinalApplicationStatus to YarnApp

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759722#comment-13759722 ] Junping Du commented on YARN-311: - [~tucu00], would you help to review it again? Thx!

[jira] [Resolved] (YARN-489) Setter of xxxxPBImpl doesn't really set the collection, but append its items to an existing collection

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-489. -- Resolution: Duplicate The problem should be fixed together with YARN-609. > Setter of xx

[jira] [Updated] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2013-09-05 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-1156: Description: AllocatedGB and AvailableGB metrics are now integer type. If there are four times 500MB

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759681#comment-13759681 ] Karthik Kambatla commented on YARN-1098: I posted patches for YARN-1027; diff on to

[jira] [Updated] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1152: - Attachment: YARN-1152.txt Patch to move client token creation from RMAppImpl to RMAppAttemptImpl. Also a

[jira] [Updated] (YARN-1027) Implement RMHAServiceProtocol

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1027: --- Attachment: yarn-1027-including-yarn-1098-3.patch yarn-1027-3.patch Uploading

[jira] [Created] (YARN-1158) ResourceManager UI has application stdout missing if application stdout is not in the same directory as AppMaster stdout

2013-09-05 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created YARN-1158: - Summary: ResourceManager UI has application stdout missing if application stdout is not in the same directory as AppMaster stdout Key: YARN-1158 URL: https://issues.apac

[jira] [Updated] (YARN-1154) RM should check do reverse lookup of NM hostname on registration and disallow registration if lookup fails

2013-09-05 Thread yeshavora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yeshavora updated YARN-1154: Description: While new nodemanager is being added adding it in include file, RM should be able to do reverse

[jira] [Updated] (YARN-1154) RM should check do reverse lookup of NM hostname on registration and disallow registration if lookup fails

2013-09-05 Thread yeshavora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yeshavora updated YARN-1154: Description: While new nodemanager is being added (adding nodename in yarn include file), RM should be able

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759658#comment-13759658 ] Hadoop QA commented on YARN-1098: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-1157) ResourceManager UI has invalid tracking URL link for distributed shell application

2013-09-05 Thread Tassapol Athiapinya (JIRA)
Tassapol Athiapinya created YARN-1157: - Summary: ResourceManager UI has invalid tracking URL link for distributed shell application Key: YARN-1157 URL: https://issues.apache.org/jira/browse/YARN-1157

[jira] [Updated] (YARN-1155) RM should resolve hostnames/ips in include/exclude files to support matching against both hostnames and ips

2013-09-05 Thread yeshavora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yeshavora updated YARN-1155: Description: RM should be able to resolve both ips and host names from include and exclude files. (was: RM

[jira] [Updated] (YARN-1155) RM should resolve hostnames/ips in include/exclude files to support matching against both hostnames and ips

2013-09-05 Thread yeshavora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yeshavora updated YARN-1155: Description: RM should be able to support both hostnames and ips > RM should resolve hostnames/ips in i

[jira] [Updated] (YARN-1154) RM should check do reverse lookup of NM hostname on registration and disallow registration if lookup fails

2013-09-05 Thread yeshavora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yeshavora updated YARN-1154: Description: RM should be able to do reverse lookup when NM tries to register. NM registration should fail i

[jira] [Assigned] (YARN-1155) RM should resolve hostnames/ips in include/exclude files to support matching against both hostnames and ips

2013-09-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1155: --- Assignee: Xuan Gong > RM should resolve hostnames/ips in include/exclude files to support matching

[jira] [Assigned] (YARN-1154) RM should check do reverse lookup of NM hostname on registration and disallow registration if lookup fails

2013-09-05 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1154: --- Assignee: Xuan Gong > RM should check do reverse lookup of NM hostname on registration and disallo

[jira] [Created] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2013-09-05 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created YARN-1156: --- Summary: Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values Key: YARN-1156 URL: https://issues.apache.org/jira/browse/YARN-1156 Project: Hado

[jira] [Created] (YARN-1154) RM should check do reverse lookup of NM hostname on registration and disallow registration if lookup fails

2013-09-05 Thread yeshavora (JIRA)
yeshavora created YARN-1154: --- Summary: RM should check do reverse lookup of NM hostname on registration and disallow registration if lookup fails Key: YARN-1154 URL: https://issues.apache.org/jira/browse/YARN-1154

[jira] [Created] (YARN-1155) RM should resolve hostnames/ips in include/exclude files to support matching against both hostnames and ips

2013-09-05 Thread yeshavora (JIRA)
yeshavora created YARN-1155: --- Summary: RM should resolve hostnames/ips in include/exclude files to support matching against both hostnames and ips Key: YARN-1155 URL: https://issues.apache.org/jira/browse/YARN-1155

[jira] [Assigned] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-1152: Assignee: Jason Lowe > Invalid key to HMAC computation error when getting application report for

[jira] [Commented] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759576#comment-13759576 ] Jason Lowe commented on YARN-1152: -- Stack trace: {noformat} Problem accessing /proxy/appl

[jira] [Created] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-1152: Summary: Invalid key to HMAC computation error when getting application report for completed app attempt Key: YARN-1152 URL: https://issues.apache.org/jira/browse/YARN-1152 P

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759628#comment-13759628 ] Bikas Saha commented on YARN-1098: -- Does this patch behave well with the patch on YARN-102

[jira] [Commented] (YARN-713) ResourceManager can exit unexpectedly if DNS is unavailable

2013-09-05 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759601#comment-13759601 ] Omkar Vinit Joshi commented on YARN-713: Addressing NMToken and ContainerToken issue

[jira] [Updated] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1098: --- Attachment: yarn-1098-3.patch Patch along the lines of Bikas' comments. The patch introduces

[jira] [Created] (YARN-1153) CapacityScheduler queue elasticity is not working

2013-09-05 Thread Jian He (JIRA)
Jian He created YARN-1153: - Summary: CapacityScheduler queue elasticity is not working Key: YARN-1153 URL: https://issues.apache.org/jira/browse/YARN-1153 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759604#comment-13759604 ] Vinod Kumar Vavilapalli commented on YARN-1152: --- bq. One way to fix it is to

[jira] [Updated] (YARN-1152) Invalid key to HMAC computation error when getting application report for completed app attempt

2013-09-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1152: -- Target Version/s: 2.1.1-beta > Invalid key to HMAC computation error when ge

[jira] [Commented] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759436#comment-13759436 ] Hadoop QA commented on YARN-1070: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759443#comment-13759443 ] Bikas Saha commented on YARN-1098: -- I dont think Alejandro meant wrapping ResourceManager

[jira] [Commented] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759430#comment-13759430 ] Hadoop QA commented on YARN-910: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759547#comment-13759547 ] Bikas Saha commented on YARN-1098: -- bq. While this is definitely an improvement over my ea

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Commented] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759511#comment-13759511 ] Sandy Ryza commented on YARN-910: - Can we add in the initializeContainer doc exactly when th

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-09-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759358#comment-13759358 ] Vinod Kumar Vavilapalli commented on YARN-696: -- Yeah, it's not caused by your p

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759453#comment-13759453 ] Bikas Saha commented on YARN-540: - Most apps will not see the async API since they will use

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759480#comment-13759480 ] Karthik Kambatla commented on YARN-1098: s/not-entirely-idle/not-entirely-ideal

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759478#comment-13759478 ] Karthik Kambatla commented on YARN-1098: Thanks Bikas. bq. I dont think Alejandro

[jira] [Updated] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-910: Attachment: YARN-910.patch taking care of javac warning > Allow auxiliary se

[jira] [Commented] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759467#comment-13759467 ] Hadoop QA commented on YARN-910: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2013-09-05 Thread john lilley (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759475#comment-13759475 ] john lilley commented on YARN-1151: --- I didn't realize that auxiliary-services were in the

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759412#comment-13759412 ] Jason Lowe commented on YARN-540: - bq. Then RM will also need to somehow remember that unre

[jira] [Commented] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2013-09-05 Thread john lilley (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759388#comment-13759388 ] john lilley commented on YARN-1151: --- Discussion thread from user@ list: Please log a JIRA

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-09-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759424#comment-13759424 ] Sangjin Lee commented on YARN-1044: --- Ping? Could someone look at the proposed patch? Than

[jira] [Commented] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2013-09-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759411#comment-13759411 ] Vinod Kumar Vavilapalli commented on YARN-1151: --- The feature-request doesn't

[jira] [Created] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2013-09-05 Thread john lilley (JIRA)
john lilley created YARN-1151: - Summary: Ability to configure auxiliary services from HDFS-based JAR files Key: YARN-1151 URL: https://issues.apache.org/jira/browse/YARN-1151 Project: Hadoop YARN

[jira] [Updated] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1070: -- Attachment: YARN-1070.5.patch Fix the findbugs warning. > ContainerImpl State Machine:

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759384#comment-13759384 ] Jason Lowe commented on YARN-540: - Unless I'm missing something, it does require a behavior

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759408#comment-13759408 ] Karthik Kambatla commented on YARN-353: --- [~hitesh], when you get a chance, can you tak

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759401#comment-13759401 ] Vinod Kumar Vavilapalli commented on YARN-540: -- Hehe, race conditions :) bq. A

[jira] [Updated] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-910: Attachment: YARN-910.patch > Allow auxiliary services to listen for container starts and

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759395#comment-13759395 ] Jason Lowe commented on YARN-540: - Ah, after the RM restarts, the NM can notify the RM that

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759400#comment-13759400 ] Vinod Kumar Vavilapalli commented on YARN-540: -- Yes, we missed that. We either

[jira] [Commented] (YARN-1068) Add admin support for HA operations

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759258#comment-13759258 ] Karthik Kambatla commented on YARN-1068: That is correct - the patch depends on YAR

[jira] [Assigned] (YARN-910) Allow auxiliary services to listen for container starts and completions

2013-09-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur reassigned YARN-910: --- Assignee: Alejandro Abdelnur > Allow auxiliary services to listen for container sta

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759272#comment-13759272 ] Jian He commented on YARN-540: -- For that, we also don't need behavior change on AM side, since

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759268#comment-13759268 ] Jian He commented on YARN-540: -- bq. Is that behavior change being implemented in the YARN API

[jira] [Commented] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759283#comment-13759283 ] Hadoop QA commented on YARN-1070: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759163#comment-13759163 ] Karthik Kambatla commented on YARN-1098: [~bikassaha], [~vinodkv] and others: what

[jira] [Updated] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1070: -- Attachment: YARN-1070.4.patch Update the patch against the latest trunk. bq. Taking a step back, this a

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-09-05 Thread Trevor Lorimer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759204#comment-13759204 ] Trevor Lorimer commented on YARN-696: - Hi Vinod, So I will throw a BadRequestException

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759155#comment-13759155 ] Karthik Kambatla commented on YARN-1098: Thanks for the quick review, Alejandro. b

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Updated] (YARN-1119) Add ClusterMetrics checks to tho TestRMNodeTransitions tests

2013-09-05 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-1119: Assignee: Mit Desai > Add ClusterMetrics checks to tho TestRMNodeTransitions tests > ---

[jira] [Created] (YARN-1150) AmIPFilter needs better documentation and should be mentioned in writing an ApplicationMaster

2013-09-05 Thread Thomas Graves (JIRA)
Thomas Graves created YARN-1150: --- Summary: AmIPFilter needs better documentation and should be mentioned in writing an ApplicationMaster Key: YARN-1150 URL: https://issues.apache.org/jira/browse/YARN-1150

[jira] [Commented] (YARN-540) Race condition causing RM to potentially relaunch already unregistered AMs on RM restart

2013-09-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759081#comment-13759081 ] Jason Lowe commented on YARN-540: - bq. Once work-preserving restart is implemented, this jir

[jira] [Commented] (YARN-1145) Potential file handle leak in aggregated logs web ui

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759070#comment-13759070 ] Hadoop QA commented on YARN-1145: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759062#comment-13759062 ] Hudson commented on YARN-1065: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1540 (See [htt

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759063#comment-13759063 ] Hudson commented on YARN-957: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1540 (See [https:

[jira] [Reopened] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-09-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened YARN-957: - this breaks the branch-2 build {code} [INFO] --

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759045#comment-13759045 ] Hudson commented on YARN-957: - FAILURE: Integrated in Hadoop-Hdfs-trunk #1513 (See [https://bui

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759044#comment-13759044 ] Hudson commented on YARN-1065: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1513 (See [https://

[jira] [Commented] (YARN-707) Add user info in the YARN ClientToken

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758999#comment-13758999 ] Hudson commented on YARN-707: - FAILURE: Integrated in Hadoop-Hdfs-0.23-Build #721 (See [https:/

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2013-09-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758985#comment-13758985 ] Steve Loughran commented on YARN-913: - I think YARN-1143 might be relevant here: restric

[jira] [Commented] (YARN-1065) NM should provide AuxillaryService data to the container

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758979#comment-13758979 ] Hudson commented on YARN-1065: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #323 (See [https://b

[jira] [Commented] (YARN-957) Capacity Scheduler tries to reserve the memory more than what node manager reports.

2013-09-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758980#comment-13758980 ] Hudson commented on YARN-957: - SUCCESS: Integrated in Hadoop-Yarn-trunk #323 (See [https://buil

[jira] [Commented] (YARN-1143) Restrict the names that apps and types can have

2013-09-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758978#comment-13758978 ] Steve Loughran commented on YARN-1143: -- thinking about this some more, I'd like the na

[jira] [Commented] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758895#comment-13758895 ] Hadoop QA commented on YARN-292: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-1068) Add admin support for HA operations

2013-09-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758893#comment-13758893 ] Alejandro Abdelnur commented on YARN-1068: -- the patch seems to depend on another p

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758892#comment-13758892 ] Alejandro Abdelnur commented on YARN-1098: -- ResourceManager: the ActiveServices sh

[jira] [Updated] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-292: - Attachment: YARN-292.4.patch A new patch against the latest trunk is uploaded. I added the test cases in it

[jira] [Commented] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13758875#comment-13758875 ] Hadoop QA commented on YARN-1098: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1098) Separate out RM services into "Always On" and "Active"

2013-09-05 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1098: --- Attachment: yarn-1098-2.patch Patch along the lines of Bikas' suggestion. Highlights: # Move