[jira] [Created] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
tu nguyen khac created YARN-5178: Summary: yarn application never can be killed when failover resource manager Key: YARN-5178 URL: https://issues.apache.org/jira/browse/YARN-5178 Project: Hadoop YARN

[jira] [Updated] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tu nguyen khac updated YARN-5178: - Attachment: rs1.zip RS1 log > yarn application never can be killed when failover resource manager

[jira] [Commented] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305163#comment-15305163 ] tu nguyen khac commented on YARN-5178: -- Sorry Jun Gong, it 's my mistake , i didn't stop cluster to

[jira] [Updated] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tu nguyen khac updated YARN-5178: - Attachment: rs2.zip Rs2 log > yarn application never can be killed when failover resource manager

[jira] [Comment Edited] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305163#comment-15305163 ] tu nguyen khac edited comment on YARN-5178 at 5/28/16 4:56 AM: --- Sorry Jun

[jira] [Comment Edited] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305163#comment-15305163 ] tu nguyen khac edited comment on YARN-5178 at 5/28/16 4:55 AM: --- Sorry Jun

[jira] [Comment Edited] (YARN-5178) yarn application never can be killed when failover resource manager

2016-05-27 Thread tu nguyen khac (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305163#comment-15305163 ] tu nguyen khac edited comment on YARN-5178 at 5/28/16 5:04 AM: --- Sorry Jun

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305181#comment-15305181 ] Hadoop QA commented on YARN-5111: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305186#comment-15305186 ] Sangjin Lee commented on YARN-5111: --- +1 on the patch. I tested it with a pseudo-distributed setup, and I

[jira] [Commented] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305064#comment-15305064 ] Hudson commented on YARN-5117: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9881 (See

[jira] [Commented] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305058#comment-15305058 ] Arun Suresh commented on YARN-5117: --- Thanks for the fix [~kkaranasos] !! +1, LGTM >

[jira] [Updated] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5117: - Attachment: YARN-5117.003.patch Getting rid of the {{waitForContainerState}} in

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-05-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Attachment: YARN-5077.006.patch > Fix FSLeafQueue#getFairShare() for queues with weight 0.0 >

[jira] [Commented] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-05-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305000#comment-15305000 ] Yufei Gu commented on YARN-5077: Uploaded patch 006 to update the way we calculate maxAMShare. > Fix

[jira] [Comment Edited] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-05-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305000#comment-15305000 ] Yufei Gu edited comment on YARN-5077 at 5/27/16 11:49 PM: -- Uploaded patch 006 to

[jira] [Updated] (YARN-5164) CapacityOvertimePolicy does not take advantaged of plan RLE

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5164: --- Attachment: YARN-5164.1.patch > CapacityOvertimePolicy does not take advantaged of plan RLE >

[jira] [Commented] (YARN-4271) Make the NodeManager's health checker service pluggable

2016-05-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305017#comment-15305017 ] Subru Krishnan commented on YARN-4271: -- [~rkanter] (cc: [~rchiang]), when we originally opened the

[jira] [Commented] (YARN-5164) CapacityOvertimePolicy does not take advantaged of plan RLE

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305014#comment-15305014 ] Carlo Curino commented on YARN-5164: Given some convo with [~chris.douglas] there might be a workaround

[jira] [Comment Edited] (YARN-5164) CapacityOvertimePolicy does not take advantaged of plan RLE

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305014#comment-15305014 ] Carlo Curino edited comment on YARN-5164 at 5/28/16 12:12 AM: -- Given some

[jira] [Commented] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305023#comment-15305023 ] Hadoop QA commented on YARN-5117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305029#comment-15305029 ] Hadoop QA commented on YARN-5105: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5117: - Attachment: YARN-5117.004.patch Fixing checkstyle. > QueuingContainerManager does

[jira] [Commented] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305048#comment-15305048 ] Hadoop QA commented on YARN-5077: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5177) Make Node-Manager Download-Resource Component extensible.

2016-05-27 Thread Emeka (JIRA)
Emeka created YARN-5177: --- Summary: Make Node-Manager Download-Resource Component extensible. Key: YARN-5177 URL: https://issues.apache.org/jira/browse/YARN-5177 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305055#comment-15305055 ] Hadoop QA commented on YARN-5117: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5170) Eliminate singleton converters and static method access

2016-05-27 Thread Joep Rottinghuis (JIRA)
Joep Rottinghuis created YARN-5170: -- Summary: Eliminate singleton converters and static method access Key: YARN-5170 URL: https://issues.apache.org/jira/browse/YARN-5170 Project: Hadoop YARN

[jira] [Updated] (YARN-5170) Eliminate singleton converters and static method access

2016-05-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5170: --- Attachment: YARN-5170-YARN-2928.01.patch Attaching (incomplete) WIP patch 01 to show

[jira] [Commented] (YARN-5141) Get Container logs for the Running application from Yarn Logs CommandLine

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303772#comment-15303772 ] Hadoop QA commented on YARN-5141: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5130) Mark ContainerStatus and NodeReport as evolving

2016-05-27 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-5130: Attachment: YARN-5130.001.patch > Mark ContainerStatus and NodeReport as evolving >

[jira] [Commented] (YARN-3368) [Umbrella] YARN web UI: Next generation

2016-05-27 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304095#comment-15304095 ] Kai Sasaki commented on YARN-3368: -- [~sunilg] Thank you so much. After I launched resourcemanager on

[jira] [Commented] (YARN-5166) javadoc:javadoc goal fails on hadoop-yarn-client

2016-05-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304128#comment-15304128 ] Hudson commented on YARN-5166: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9877 (See

[jira] [Commented] (YARN-5130) Mark ContainerStatus and NodeReport as evolving

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304036#comment-15304036 ] Hadoop QA commented on YARN-5130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4987) Read cache concurrency issue between read and evict in EntityGroupFS timeline store

2016-05-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304102#comment-15304102 ] Hudson commented on YARN-4987: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9876 (See

[jira] [Commented] (YARN-5166) javadoc:javadoc goal fails on hadoop-yarn-client

2016-05-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304099#comment-15304099 ] Akira AJISAKA commented on YARN-5166: - Thanks [~boky01] for reporting this and providing the patch. +1,

[jira] [Assigned] (YARN-5130) Mark ContainerStatus and NodeReport as evolving

2016-05-27 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-5130: --- Assignee: Gergely Novák > Mark ContainerStatus and NodeReport as evolving >

[jira] [Commented] (YARN-5141) Get Container logs for the Running application from Yarn Logs CommandLine

2016-05-27 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303913#comment-15303913 ] Varun Vasudev commented on YARN-5141: - [~xgong] - patch looks good. Please fix the checkstyle issue. >

[jira] [Commented] (YARN-5130) Mark ContainerStatus and NodeReport as evolving

2016-05-27 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304020#comment-15304020 ] Gergely Novák commented on YARN-5130: - Added patch for [~ste...@apache.org]'s suggestion. > Mark

[jira] [Commented] (YARN-5166) javadoc:javadoc goal fails on hadoop-yarn-client

2016-05-27 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303833#comment-15303833 ] Andras Bokor commented on YARN-5166: [~ajisakaa], It is similar to YARN-4294 and YARN-4300. The

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303914#comment-15303914 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304215#comment-15304215 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-05-27 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5007: --- Attachment: (was: YARN-5007.01.patch) > MiniYarnCluster contains deprecated constructor which is

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5171: -- Assignee: Inigo Goiri > Extend DistributedSchedulerProtocol to notify RM of containers allocated by >

[jira] [Updated] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5127: Attachment: YARN-5127.005.patch > Expose ExecutionType in Container api record >

[jira] [Created] (YARN-5172) Update yarn daemonlog documentation due to HADOOP-12847

2016-05-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created YARN-5172: - Summary: Update yarn daemonlog documentation due to HADOOP-12847 Key: YARN-5172 URL: https://issues.apache.org/jira/browse/YARN-5172 Project: Hadoop YARN

[jira] [Created] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-05-27 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5171: - Summary: Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node Key: YARN-5171 URL: https://issues.apache.org/jira/browse/YARN-5171 Project:

[jira] [Commented] (YARN-5169) most YARN events have timestamp of -1

2016-05-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304349#comment-15304349 ] Sangjin Lee commented on YARN-5169: --- I'd also point out there is already some code in the timeline

[jira] [Created] (YARN-5173) Enable Token Support for AHSClient

2016-05-27 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created YARN-5173: - Summary: Enable Token Support for AHSClient Key: YARN-5173 URL: https://issues.apache.org/jira/browse/YARN-5173 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Updated] (YARN-5141) Get Container logs for the Running application from Yarn Logs CommandLine

2016-05-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5141: Attachment: YARN-5141.2.patch > Get Container logs for the Running application from Yarn Logs CommandLine >

[jira] [Commented] (YARN-5141) Get Container logs for the Running application from Yarn Logs CommandLine

2016-05-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304390#comment-15304390 ] Xuan Gong commented on YARN-5141: - Thanks for the review. Attached a new patch to fix the checkstyle issue.

[jira] [Resolved] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5127. --- Resolution: Fixed > Expose ExecutionType in Container api record >

[jira] [Comment Edited] (YARN-5169) most YARN events have timestamp of -1

2016-05-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304555#comment-15304555 ] Li Lu edited comment on YARN-5169 at 5/27/16 6:51 PM: -- Thanks [~sjlee0] for raising

[jira] [Reopened] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5127: --- > Expose ExecutionType in Container api record > > >

[jira] [Commented] (YARN-5169) most YARN events have timestamp of -1

2016-05-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304555#comment-15304555 ] Li Lu commented on YARN-5169: - Thanks [~sjlee0] for raising this issue! I noticed that in RM's

[jira] [Commented] (YARN-5167) Escaping occurences of encodedValues

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304596#comment-15304596 ] Varun Saxena commented on YARN-5167: This we will target for 1st milestone ? Personally I think we can.

[jira] [Comment Edited] (YARN-5167) Escaping occurences of encodedValues

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304596#comment-15304596 ] Varun Saxena edited comment on YARN-5167 at 5/27/16 7:16 PM: - This we will

[jira] [Commented] (YARN-5170) Eliminate singleton converters and static method access

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304588#comment-15304588 ] Varun Saxena commented on YARN-5170: Removal of static methods is a good idea. Especially the methods

[jira] [Commented] (YARN-5170) Eliminate singleton converters and static method access

2016-05-27 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304653#comment-15304653 ] Joep Rottinghuis commented on YARN-5170: General concern with singletons that they start out

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-05-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5171: - Issue Type: Sub-task (was: Bug) Parent: YARN-4742 > Extend

[jira] [Commented] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-05-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304548#comment-15304548 ] Xuan Gong commented on YARN-5088: - Thanks for the view. Attached a new patch to address the latest comments

[jira] [Comment Edited] (YARN-5170) Eliminate singleton converters and static method access

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304588#comment-15304588 ] Varun Saxena edited comment on YARN-5170 at 5/27/16 7:10 PM: - Removal of static

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-05-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304421#comment-15304421 ] Konstantinos Karanasos commented on YARN-5171: -- Thanks for starting this [~elgoiri] and

[jira] [Created] (YARN-5174) add documentation on needing to add hbase-site.xml on YARN cluster

2016-05-27 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-5174: - Summary: add documentation on needing to add hbase-site.xml on YARN cluster Key: YARN-5174 URL: https://issues.apache.org/jira/browse/YARN-5174 Project: Hadoop YARN

[jira] [Updated] (YARN-5088) Improve "yarn log" command-line to read the last K bytes for the log files

2016-05-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5088: Attachment: YARN-5088.3.patch > Improve "yarn log" command-line to read the last K bytes for the log files >

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304792#comment-15304792 ] Hudson commented on YARN-5127: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9879 (See

[jira] [Created] (YARN-5175) Simplify the delegation token renewal management for YARN localization and log-aggregation

2016-05-27 Thread Jian He (JIRA)
Jian He created YARN-5175: - Summary: Simplify the delegation token renewal management for YARN localization and log-aggregation Key: YARN-5175 URL: https://issues.apache.org/jira/browse/YARN-5175 Project:

[jira] [Updated] (YARN-5175) Simplify the delegation token renewal management for YARN localization and log-aggregation

2016-05-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5175: -- Description: Increasingly, this DelegationTokenRenewer class for renewing expiring token for localization and

[jira] [Commented] (YARN-5169) most YARN events have timestamp of -1

2016-05-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304844#comment-15304844 ] Li Lu commented on YARN-5169: - Thanks [~sjlee0]! bq. Are event timestamps for consumption by the timeline

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304659#comment-15304659 ] Varun Saxena commented on YARN-5109: Thanks [~sjlee0] and [~jrottinghuis] for the review and commit.

[jira] [Commented] (YARN-4958) The file localization process should allow for wildcards to reduce the application footprint in the state store

2016-05-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304675#comment-15304675 ] Sangjin Lee commented on YARN-4958: --- Sorry [~templedf], haven't had cycles to get back to this one. I'll

[jira] [Commented] (YARN-5169) most YARN events have timestamp of -1

2016-05-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304689#comment-15304689 ] Sangjin Lee commented on YARN-5169: --- Thanks for your comments [~gtCarrera9]! I agree that using

[jira] [Comment Edited] (YARN-5169) most YARN events have timestamp of -1

2016-05-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304689#comment-15304689 ] Sangjin Lee edited comment on YARN-5169 at 5/27/16 8:11 PM: Thanks for your

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304693#comment-15304693 ] Hadoop QA commented on YARN-5127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304716#comment-15304716 ] Hadoop QA commented on YARN-5127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-05-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4837: -- Attachment: YARN-4837-20160527.txt Updated patch fixing the conflicts. Can't

[jira] [Updated] (YARN-5165) NoOvercommitPolicy does not take advantage of RLE representation of plan

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5165: --- Attachment: YARN-5165.1.patch > NoOvercommitPolicy does not take advantage of RLE representation of

[jira] [Commented] (YARN-5164) CapacityOvertimePolicy does not take advantaged of plan RLE

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304849#comment-15304849 ] Carlo Curino commented on YARN-5164: Thinking more about this, it is non-trivial to RLE-ify this

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-05-27 Thread Hadoop QA (JIRA)
/attachment/12806717/YARN-4837-20160527.txt | | JIRA Issue | YARN-4837 | | Optional Tests | asflicense compile javac javadoc mvninstall mvnsite unit findbugs checkstyle cc xml | | uname | Linux 6940f217cc0e 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64

[jira] [Commented] (YARN-5165) NoOvercommitPolicy does not take advantage of RLE representation of plan

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304854#comment-15304854 ] Carlo Curino commented on YARN-5165: The attached patch leverages the

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304768#comment-15304768 ] Arun Suresh commented on YARN-5127: --- +1, Thanks for the patch [~hrsharma] Will fix the remaining

[jira] [Updated] (YARN-5164) CapacityOvertimePolicy does not take advantaged of plan RLE

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5164: --- Attachment: YARN-5164-example.pdf > CapacityOvertimePolicy does not take advantaged of plan RLE >

[jira] [Commented] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

2016-05-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304685#comment-15304685 ] Vinod Kumar Vavilapalli commented on YARN-5098: --- Fix checkstyle and unit test issues. The

[jira] [Updated] (YARN-5165) NoOvercommitPolicy does not take advantage of RLE representation of plan

2016-05-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5165: --- Attachment: YARN-5165.2.patch > NoOvercommitPolicy does not take advantage of RLE representation of

[jira] [Updated] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5105: --- Attachment: YARN-5105-YARN-2928.04.patch > entire time series is returned for YARN container system

[jira] [Updated] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5105: --- Attachment: (was: YARN-5105-YARN-2928.04.patch) > entire time series is returned for YARN

[jira] [Updated] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5117: - Attachment: YARN-5117.002.patch Adding the proper file. > QueuingContainerManager

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304978#comment-15304978 ] Hadoop QA commented on YARN-5105: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304990#comment-15304990 ] Hadoop QA commented on YARN-5117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

2016-05-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304889#comment-15304889 ] Jian He commented on YARN-5098: --- bq. Overall, I think we can simplify this code i created YARN-5175 bq. Why

[jira] [Updated] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5105: --- Attachment: YARN-5105-YARN-2928.04.patch > entire time series is returned for YARN container system

[jira] [Created] (YARN-5176) More test cases for queuing of containers at the NM

2016-05-27 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5176: Summary: More test cases for queuing of containers at the NM Key: YARN-5176 URL: https://issues.apache.org/jira/browse/YARN-5176 Project: Hadoop YARN

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304909#comment-15304909 ] Hadoop QA commented on YARN-5105: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5117: - Attachment: (was: YARN-5117.002.patch) > QueuingContainerManager does not

[jira] [Commented] (YARN-5111) YARN container system metrics are not aggregated to application

2016-05-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304942#comment-15304942 ] Li Lu commented on YARN-5111: - Thanks [~Naganarasimha]! I tried the patch and I can see from the posted

[jira] [Commented] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304953#comment-15304953 ] Hadoop QA commented on YARN-5098: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5105) entire time series is returned for YARN container system metrics (CPU and memory)

2016-05-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304977#comment-15304977 ] Hadoop QA commented on YARN-5105: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4007) Add support for different network setups when launching the docker container

2016-05-27 Thread Zhongyue Luo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303619#comment-15303619 ] Zhongyue Luo commented on YARN-4007: I would be nice, if using bridge mode, the admin can specify a

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-05-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303624#comment-15303624 ] Rohith Sharma K S commented on YARN-4837: - [~leftnoteasy] / [~vinodkv] can I go ahead and commit

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-05-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303639#comment-15303639 ] Rohith Sharma K S commented on YARN-4837: - Looks like need to rebase for trunk too!! Some files are

[jira] [Commented] (YARN-4007) Add support for different network setups when launching the docker container

2016-05-27 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303629#comment-15303629 ] Sidharta Seethana commented on YARN-4007: - Should we continue this discussion on YARN-5168 ? I'll

[jira] [Commented] (YARN-5089) Improve "yarn log" command-line "logFiles" option to support regex

2016-05-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303653#comment-15303653 ] Xuan Gong commented on YARN-5089: - Thanks for the review. Varun. I have committed the patch to

  1   2   >