[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313538#comment-15313538 ] Hadoop QA commented on YARN-4308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313524#comment-15313524 ] Hadoop QA commented on YARN-5189: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4308: -- Attachment: 0007-YARN-4308.patch [~templedf], Thank you very much. Extremely sorry for that debug log, my bad.

[jira] [Commented] (YARN-1815) Work preserving recovery of Unmanged AMs

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313454#comment-15313454 ] Hadoop QA commented on YARN-1815: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1815) Work preserving recovery of Unmanged AMs

2016-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-1815: - Attachment: YARN-1815-v6.patch Thanks [~jianhe]e for the thoughtful feedback. I have incorporated

[jira] [Issue Comment Deleted] (YARN-4887) AM-RM protocol changes for identifying resource-requests explicitly

2016-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4887: - Comment: was deleted (was: Thanks [~jianhe] for the thoughtful feedback. I have incorporated all

[jira] [Updated] (YARN-4887) AM-RM protocol changes for identifying resource-requests explicitly

2016-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4887: - Attachment: (was: YARN-1815-v6.patch) > AM-RM protocol changes for identifying

[jira] [Updated] (YARN-4887) AM-RM protocol changes for identifying resource-requests explicitly

2016-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4887: - Attachment: YARN-1815-v6.patch Thanks [~jianhe] for the thoughtful feedback. I have incorporated

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313387#comment-15313387 ] Sangjin Lee commented on YARN-5189: --- I see 2 unit tests switching over from filesystem to hbase, but they

[jira] [Commented] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313378#comment-15313378 ] Hadoop QA commented on YARN-5080: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313351#comment-15313351 ] Li Lu commented on YARN-5189: - Thanks for the work [~jrottinghuis] and [~sjlee0]! I took a look at the most

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313327#comment-15313327 ] Konstantinos Karanasos commented on YARN-5171: -- bq. number of code changes is less.. isolated

[jira] [Commented] (YARN-5167) Escaping occurences of encodedValues

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313325#comment-15313325 ] Sangjin Lee commented on YARN-5167: --- One tricky part about the new approach is to ensure we handle the

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313323#comment-15313323 ] Hadoop QA commented on YARN-5189: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313320#comment-15313320 ] Hadoop QA commented on YARN-5191: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313317#comment-15313317 ] Hadoop QA commented on YARN-5189: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313313#comment-15313313 ] Arun Suresh commented on YARN-5171: --- bq. why not call the existing allocate method in the RM, check

[jira] [Commented] (YARN-5167) Escaping occurences of encodedValues

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313290#comment-15313290 ] Sangjin Lee commented on YARN-5167: --- OK, I've hit a snag with this idea. Initially we thought that we

[jira] [Updated] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5191: Attachment: YARN-5191.4.patch > Rename the “download=true” option for getLogs in NMWebServices and >

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313245#comment-15313245 ] Konstantinos Karanasos commented on YARN-5171: -- Thanks for the patch, [~elgoiri]! I am on the

[jira] [Updated] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5191: Attachment: YARN-5191.3.patch > Rename the “download=true” option for getLogs in NMWebServices and >

[jira] [Updated] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

2016-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5080: Attachment: YARN-5080.3.patch > Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM >

[jira] [Commented] (YARN-5197) RM leaks containers if running container disappears from node update

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313244#comment-15313244 ] Hadoop QA commented on YARN-5197: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5080) Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM

2016-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5080: Attachment: YARN-5080.2.patch > Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM >

[jira] [Commented] (YARN-5137) Make DiskChecker pluggable

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313241#comment-15313241 ] Hadoop QA commented on YARN-5137: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313229#comment-15313229 ] Hadoop QA commented on YARN-5077: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2016-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5139: - Attachment: wip-2.YARN-5139.patch An update of WIP patch (wip-2): - Added implementation of

[jira] [Updated] (YARN-5197) RM leaks containers if running container disappears from node update

2016-06-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5197: - Attachment: YARN-5197.001.patch RMNodeImpl checks the list of running containers on the node against

[jira] [Commented] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313161#comment-15313161 ] Hadoop QA commented on YARN-5098: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5197) RM leaks containers if running container disappears from node update

2016-06-02 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-5197: Summary: RM leaks containers if running container disappears from node update Key: YARN-5197 URL: https://issues.apache.org/jira/browse/YARN-5197 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-5137) Make DiskChecker pluggable

2016-06-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311497#comment-15311497 ] Yufei Gu edited comment on YARN-5137 at 6/2/16 9:46 PM: Patch 001 includes: - Add

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313134#comment-15313134 ] Daniel Templeton commented on YARN-4308: Thanks for adding the test, [~sunilg]. Looks generally

[jira] [Commented] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313121#comment-15313121 ] Siddharth Seth commented on YARN-5193: -- bq. I don't think long-running necessarily means low container

[jira] [Commented] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2016-06-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313075#comment-15313075 ] Jason Lowe commented on YARN-5193: -- I don't think long-running necessarily means low container churn,

[jira] [Updated] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

2016-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5098: -- Attachment: YARN-5098.3.patch fixed the long lines. the warning about whitespace is invalid. that line does not

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-06-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Attachment: YARN-5077.007.patch > Fix FSLeafQueue#getFairShare() for queues with weight 0.0 >

[jira] [Commented] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

2016-06-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313047#comment-15313047 ] Yufei Gu commented on YARN-5077: [~kasha], you are right. It might be a livelock here. We can use all the

[jira] [Commented] (YARN-5195) RM crashed with NPE while handling APP_ATTEMPT_REMOVED event

2016-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312989#comment-15312989 ] Wangda Tan commented on YARN-5195: -- Investigated this issue, this only happens when async scheduling

[jira] [Updated] (YARN-5195) RM crashed with NPE while handling APP_ATTEMPT_REMOVED event

2016-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5195: - Priority: Major (was: Critical) > RM crashed with NPE while handling APP_ATTEMPT_REMOVED event >

[jira] [Updated] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-5189: -- Attachment: YARN-5189-YARN-2928.05.patch > Make HBaseTimeline[Reader|Writer]Impl default and move

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312964#comment-15312964 ] Sangjin Lee commented on YARN-5189: --- Thanks for updating the patch [~jrottinghuis]! I think it's pretty

[jira] [Commented] (YARN-5190) Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312954#comment-15312954 ] Hadoop QA commented on YARN-5190: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5196) Command to refresh cache without having to restart the cluster

2016-06-02 Thread Prasad Wagle (JIRA)
Prasad Wagle created YARN-5196: -- Summary: Command to refresh cache without having to restart the cluster Key: YARN-5196 URL: https://issues.apache.org/jira/browse/YARN-5196 Project: Hadoop YARN

[jira] [Commented] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312883#comment-15312883 ] Hadoop QA commented on YARN-5191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5190) Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl

2016-06-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5190: - Attachment: YARN-5190-v2.patch Thanks [~jianhe] for review and comments! v2 patch incorporate your

[jira] [Commented] (YARN-5190) Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl

2016-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312850#comment-15312850 ] Jian He commented on YARN-5190: --- looks good, only minor comments on the format: is below slightly better,

[jira] [Commented] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2016-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312822#comment-15312822 ] Siddharth Seth commented on YARN-5193: -- Log rolling should help. I'm yet to try it out. Do you happen

[jira] [Commented] (YARN-1815) Work preserving recovery of Unmanged AMs

2016-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312813#comment-15312813 ] Jian He commented on YARN-1815: --- Thanks Subru ! looks good overall, few comments on the patch: - Because of

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312807#comment-15312807 ] Hadoop QA commented on YARN-5171: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5191: Attachment: YARN-5191.2.patch > Rename the “download=true” option for getLogs in NMWebServices and >

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312797#comment-15312797 ] Hadoop QA commented on YARN-5124: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-5195) RM crashed with NPE while handling APP_ATTEMPT_REMOVED event

2016-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-5195: Assignee: Wangda Tan > RM crashed with NPE while handling APP_ATTEMPT_REMOVED event >

[jira] [Issue Comment Deleted] (YARN-5195) RM crashed with NPE while handling APP_ATTEMPT_REMOVED event

2016-06-02 Thread Karam Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karam Singh updated YARN-5195: -- Comment: was deleted (was: cc [~gp.leftnoteasy]) > RM crashed with NPE while handling

[jira] [Commented] (YARN-5195) RM crashed with NPE while handling APP_ATTEMPT_REMOVED event

2016-06-02 Thread Karam Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312725#comment-15312725 ] Karam Singh commented on YARN-5195: --- cc [~gp.leftnoteasy] > RM crashed with NPE while handling

[jira] [Created] (YARN-5195) RM crashed with NPE while handling APP_ATTEMPT_REMOVED event

2016-06-02 Thread Karam Singh (JIRA)
Karam Singh created YARN-5195: - Summary: RM crashed with NPE while handling APP_ATTEMPT_REMOVED event Key: YARN-5195 URL: https://issues.apache.org/jira/browse/YARN-5195 Project: Hadoop YARN

[jira] [Commented] (YARN-5190) Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312706#comment-15312706 ] Hadoop QA commented on YARN-5190: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312672#comment-15312672 ] Wangda Tan commented on YARN-4844: -- Latest patch should be fine. Javac is caused by known JDK bug which I

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: (was: YARN-5171.003.patch) > Extend DistributedSchedulerProtocol to notify RM of

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312630#comment-15312630 ] Arun Suresh commented on YARN-5171: --- [~elgoiri], I don't think you are decrementing

[jira] [Comment Edited] (YARN-5190) Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorIm

2016-06-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311496#comment-15311496 ] Junping Du edited comment on YARN-5190 at 6/2/16 4:31 PM: -- Discussed offline with

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312620#comment-15312620 ] Hadoop QA commented on YARN-5171: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.003.patch Fixing compilation issues and style. > Extend

[jira] [Updated] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5189: --- Attachment: YARN-5189-YARN-2928.04.patch Oops, missed the property rename in yarn-default.xml

[jira] [Updated] (YARN-5190) Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl

2016-06-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5190: - Summary: Registering/unregistering container metrics triggered by ContainerEvent and

[jira] [Updated] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-5189: --- Attachment: YARN-5189-YARN-2928.03.patch Uploading YARN-5189-YARN-2928.03.patch Fixed

[jira] [Commented] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312557#comment-15312557 ] Hudson commented on YARN-5180: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9900 (See

[jira] [Updated] (YARN-5190) Race condition in registering container metrics cause uncaught exception in ContainerMonitorImpl

2016-06-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5190: - Attachment: YARN-5190.patch Attach the patch to fix three issues mentioned above with unit test. > Race

[jira] [Commented] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312559#comment-15312559 ] Arun Suresh commented on YARN-5180: --- Committed this to trunk and branch-2 Thanks [~kkaranasos] and

[jira] [Commented] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312561#comment-15312561 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312540#comment-15312540 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-4742 > Allow ResourceRequest to specify an

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Summary: Allow ResourceRequest to specify an enforceExecutionType flag (was: Allow ResourceRequest to

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Summary: Allow ResourceRequest to specify enforceExecutionType flag (was: Add ensureExecutionType

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312536#comment-15312536 ] Hadoop QA commented on YARN-5124: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312460#comment-15312460 ] Hadoop QA commented on YARN-5180: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5191) Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices

2016-06-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312423#comment-15312423 ] Varun Vasudev commented on YARN-5191: - Thanks for the patch Xuan. Couple of things - # We should

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312391#comment-15312391 ] Sunil G commented on YARN-4308: --- I will fix the warning and checkstyle issue after a round of review with a

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312333#comment-15312333 ] Hadoop QA commented on YARN-4308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4953) Delete completed container log folder when rolling log aggregation is enabled

2016-06-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312317#comment-15312317 ] Jason Lowe commented on YARN-4953: -- Sorry for missing this earlier. As I mentioned on YARN-5193, log

[jira] [Commented] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2016-06-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312315#comment-15312315 ] Jason Lowe commented on YARN-5193: -- Main thing to watch out for here is additional load to the namenode.

[jira] [Updated] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4308: -- Attachment: 0006-YARN-4308.patch I guess I missed one file in earlier patch. Reattaching an updated patch. >

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312258#comment-15312258 ] Hadoop QA commented on YARN-5124: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.008.patch > Modify AMRMClient to set the ExecutionType in the ResourceRequest >

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312247#comment-15312247 ] Hadoop QA commented on YARN-4308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124_YARN-5180_combined.008.patch Rebasing against latest YARN-5180 patch and kicking

[jira] [Updated] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

2016-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4308: -- Attachment: 0005-YARN-4308.patch Hi [~templedf] [~Naganarasimha Garla] I have added a test case to check

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.007.patch Thanks [~kasha] Oh well.. as per popular demand, changing the name to

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311899#comment-15311899 ] Hadoop QA commented on YARN-5189: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2016-06-02 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311880#comment-15311880 ] Rohith Sharma K S commented on YARN-5193: - Looking into this JIRA, currently log rolling can be

[jira] [Commented] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311852#comment-15311852 ] Karthik Kambatla commented on YARN-5180: +1. I am not particular, but I too like enforce over

[jira] [Created] (YARN-5194) Avoid adding yarn-site to all Configuration instances created by the JVM

2016-06-02 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-5194: Summary: Avoid adding yarn-site to all Configuration instances created by the JVM Key: YARN-5194 URL: https://issues.apache.org/jira/browse/YARN-5194 Project: Hadoop

[jira] [Created] (YARN-5193) For long running services, aggregate logs when a container completes instead of when the app completes

2016-06-02 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-5193: Summary: For long running services, aggregate logs when a container completes instead of when the app completes Key: YARN-5193 URL:

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311807#comment-15311807 ] Sangjin Lee commented on YARN-5189: --- On the patch itself, I found several more places where we need to

[jira] [Commented] (YARN-5189) Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl

2016-06-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311806#comment-15311806 ] Sangjin Lee commented on YARN-5189: --- {quote} Do you mean we should actually have the name of the Impl

[jira] [Commented] (YARN-5156) YARN_CONTAINER_FINISHED of YARN_CONTAINERs will always have running state

2016-06-02 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311802#comment-15311802 ] Varun Saxena commented on YARN-5156: [~vrushalic], thanks for the patch. Regarding the patch, I do not