[jira] [Commented] (YARN-4216) Container logs not shown for newly assigned containers after NM recovery

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005159#comment-15005159 ] Hadoop QA commented on YARN-4216: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-996) REST API support for node resource configuration

2015-11-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reassigned YARN-996: --- Assignee: Tsuyoshi Ozawa (was: Kenji Kikushima) > REST API support for node resource configura

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005152#comment-15005152 ] Sangjin Lee commented on YARN-4350: --- The entire test times out in about 15 minutes. {nof

[jira] [Updated] (YARN-4216) Container logs not shown for newly assigned containers after NM recovery

2015-11-13 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4216: --- Attachment: 0001-YARN-4216.patch Attaching patch for review > Container logs not shown for new

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005120#comment-15005120 ] Sangjin Lee commented on YARN-4350: --- It times out (after 15 minutes) consistently for me

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-13 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005097#comment-15005097 ] Inigo Goiri commented on YARN-3980: --- We are failing miserably with the mini cluster. Do y

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005090#comment-15005090 ] Naganarasimha G R commented on YARN-4183: - Yes, [~sjlee0] & [~gtCarrera], There are

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005098#comment-15005098 ] Naganarasimha G R commented on YARN-4183: - bq. As far as i view it *"yarn.timeline-

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005084#comment-15005084 ] Li Lu commented on YARN-4183: - Sure. We can distribute the work and check them out. I can help

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005070#comment-15005070 ] Naganarasimha G R commented on YARN-4350: - Hi [~sjlee0] One more query, Wanted to k

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005065#comment-15005065 ] Brahma Reddy Battula commented on YARN-4354: [~jlowe] Nice catch.+1 (non-bindin

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005055#comment-15005055 ] Naganarasimha G R commented on YARN-2859: - +1, after applying Addendum patch, Tests

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005053#comment-15005053 ] Naganarasimha G R commented on YARN-2859: - It should resolve as i first fixed with

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005052#comment-15005052 ] Sangjin Lee commented on YARN-4183: --- This is still very much an open-ended discussion. I

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005047#comment-15005047 ] Li Lu commented on YARN-4183: - bq. Also, if 1.5 is meant to include 1, then we can limit suppor

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005045#comment-15005045 ] Sangjin Lee commented on YARN-2859: --- Could you also check if this resolves the timeout is

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005031#comment-15005031 ] Naganarasimha G R commented on YARN-2859: - Dint see these messages, analyzed and fi

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005032#comment-15005032 ] Naganarasimha G R commented on YARN-2859: - Dint see these messages, analyzed and fi

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005021#comment-15005021 ] Sangjin Lee commented on YARN-4183: --- {quote} +1. I don't see a fundamental challenge to s

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005006#comment-15005006 ] Hadoop QA commented on YARN-2859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004995#comment-15004995 ] Naganarasimha G R commented on YARN-2859: - Thanks for informing [~sjlee0], May be t

[jira] [Updated] (YARN-4219) New levelDB cache storage for timeline v1.5

2015-11-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4219: Attachment: YARN-4219-YARN-4265.002.patch > New levelDB cache storage for timeline v1.5 > ---

[jira] [Commented] (YARN-4219) New levelDB cache storage for timeline v1.5

2015-11-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004988#comment-15004988 ] Li Lu commented on YARN-4219: - I noticed one problem for the current ATS v1.5's caching policy

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004983#comment-15004983 ] Naganarasimha G R commented on YARN-4350: - hi [~sjlee0], Yeah you are right ! I gue

[jira] [Updated] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2859: -- Attachment: YARN-2859-addendum.txt It's unfortunate that Jenkins doesn't run depe

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004972#comment-15004972 ] Sangjin Lee commented on YARN-4350: --- What I suspect is that maybe in our code (YARN-2928

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004969#comment-15004969 ] Sangjin Lee commented on YARN-4350: --- As I mentioned in YARN-2859, I'm not sure if that is

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004967#comment-15004967 ] Sangjin Lee commented on YARN-2859: --- Thanks for looking [~Naganarasimha]. But I'm not sur

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004962#comment-15004962 ] Li Lu commented on YARN-4183: - bq. With v.2 and especially early on with v.2, it would be rathe

[jira] [Reopened] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reopened YARN-2859: --- Reopening the JIRA to look at the issue. > ApplicationHistoryServer binds to defau

[jira] [Commented] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004954#comment-15004954 ] Sangjin Lee commented on YARN-4183: --- This is also somewhat relevant to YARN-4356. (*yarn

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004939#comment-15004939 ] Naganarasimha G R commented on YARN-2859: - oops fix would be {code} String hostna

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004933#comment-15004933 ] Naganarasimha G R commented on YARN-2859: - Missed to mention that its visible when

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-11-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004923#comment-15004923 ] Naganarasimha G R commented on YARN-2859: - [~sjlee0] as you mentioned in YARN-4350,

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004908#comment-15004908 ] Eric Payne commented on YARN-4354: -- +1 Thanks Jason for catching and fixing this. I also

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004887#comment-15004887 ] Joep Rottinghuis commented on YARN-4053: In further discussion with [~sjlee0] it ma

[jira] [Assigned] (YARN-4353) Provide short circuit user group mapping for NM/AM

2015-11-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-4353: -- Assignee: Daniel Templeton > Provide short circuit user group mapping for NM/AM > --

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004842#comment-15004842 ] Joep Rottinghuis commented on YARN-4053: Now that I'm looking at it again in detail

[jira] [Updated] (YARN-4348) ZKRMStateStore.syncInternal should wait for zkResyncWaitTime instead of zkSessionTimeout

2015-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4348: -- Attachment: YARN-4348.001.patch upload same patch to kick jenkins > ZKRMStateStore.syncInternal should wait for

[jira] [Assigned] (YARN-4355) NPE while processing localizer heartbeat

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-4355: -- Assignee: Varun Saxena > NPE while processing localizer heartbeat >

[jira] [Updated] (YARN-4287) Capacity Scheduler: Rack Locality improvement

2015-11-13 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-4287: - Attachment: YARN-4287-minimal-v4-branch-2.7.patch 2.7 version of patch. > Capacity Scheduler: Rack

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004755#comment-15004755 ] Varun Saxena commented on YARN-4354: +1, patch LGTM > Public resource localization fai

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004739#comment-15004739 ] Hadoop QA commented on YARN-4354: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004727#comment-15004727 ] Varun Saxena commented on YARN-4053: bq. Would it be safe to always assume a long conve

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004714#comment-15004714 ] Varun Saxena commented on YARN-4356: That's quite a comprehensive list. I was wonderin

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-13 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004692#comment-15004692 ] Inigo Goiri commented on YARN-3980: --- Give us a couple hours. If it's not done by today we

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004686#comment-15004686 ] Karthik Kambatla commented on YARN-3980: I believe we are waiting for the test to b

[jira] [Updated] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4354: - Attachment: YARN-4354.002.patch Fix for unit test failure. > Public resource localization fails with NPE >

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004661#comment-15004661 ] Sangjin Lee commented on YARN-4356: --- This is the rough note I jotted down while going ove

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004631#comment-15004631 ] Hadoop QA commented on YARN-4354: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-11-13 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-4356: - Summary: ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off Key: YARN-4356 URL: https://issues.apache.org/jira/browse/YARN-4356 Proj

[jira] [Updated] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4354: - Attachment: YARN-4354.001.patch Patch that implements the visibility check to avoid executing the logic for

[jira] [Assigned] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-4354: Assignee: Jason Lowe > Public resource localization fails with NPE > ---

[jira] [Commented] (YARN-4353) Provide short circuit user group mapping for NM/AM

2015-11-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004558#comment-15004558 ] Vinod Kumar Vavilapalli commented on YARN-4353: --- [~templedf], added you to th

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004550#comment-15004550 ] Joep Rottinghuis commented on YARN-4053: Patch looks good. The converter approach l

[jira] [Resolved] (YARN-1336) [Umbrella] Work-preserving nodemanager restart

2015-11-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-1336. --- Resolution: Fixed Though there are a couple of improvements left to take care o

[jira] [Updated] (YARN-1336) [Umbrella] Work-preserving nodemanager restart

2015-11-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1336: -- Summary: [Umbrella] Work-preserving nodemanager restart (was: Work-preserving no

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004506#comment-15004506 ] Hadoop QA commented on YARN-3367: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004503#comment-15004503 ] Varun Saxena commented on YARN-4354: Makes sense. Better to be safe and have an explici

[jira] [Commented] (YARN-4355) NPE while processing localizer heartbeat

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004480#comment-15004480 ] Jason Lowe commented on YARN-4355: -- Stacktrace: {noformat} java.lang.NullPointerException

[jira] [Created] (YARN-4355) NPE while processing localizer heartbeat

2015-11-13 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4355: Summary: NPE while processing localizer heartbeat Key: YARN-4355 URL: https://issues.apache.org/jira/browse/YARN-4355 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4200: -- Labels: yarn-2928-1st-milestone (was: ) > Refactor reader classes in storage to nest under hbase specifi

[jira] [Updated] (YARN-3959) Store application related configurations in Timeline Service v2

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3959: -- Labels: yarn-2928-1st-milestone (was: ) > Store application related configurations in Timeline Service v

[jira] [Updated] (YARN-3907) create the flow-version table

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3907: -- Labels: yarn-2928-1st-milestone (was: ) > create the flow-version table > -

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004462#comment-15004462 ] Jason Lowe commented on YARN-4354: -- Looks like this can cause nodemanagers to crash as wel

[jira] [Updated] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3367: -- Labels: yarn-2928-1st-milestone (was: ) > Replace starting a separate thread for post entity with event

[jira] [Commented] (YARN-4344) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

2015-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004455#comment-15004455 ] Wangda Tan commented on YARN-4344: -- Good catch, [~vvasudev]! Fix looks good to me, as comm

[jira] [Updated] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4354: -- Target Version/s: 2.7.2, 2.7.3 (was: 2.7.3) Marking this as a blocker for 2.7.2.

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004428#comment-15004428 ] Wangda Tan commented on YARN-3980: -- Thanks for update [~elgoiri], patch looks good to me.

[jira] [Updated] (YARN-3150) [Documentation] Documenting the timeline service v2

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3150: -- Labels: yarn-2928-1st-milestone (was: ) > [Documentation] Documenting the timeline service v2 >

[jira] [Updated] (YARN-3461) Consolidate flow name/version/run defaults

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3461: -- Labels: yarn-2928-1st-milestone (was: ) > Consolidate flow name/version/run defaults > -

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004421#comment-15004421 ] Varun Saxena commented on YARN-4354: [~jlowe], I think you are correct. Below code adde

[jira] [Updated] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3816: -- Labels: yarn-2928-1st-milestone (was: ) > [Aggregation] App-level aggregation and accumulation for YARN

[jira] [Updated] (YARN-3863) Enhance filters in TimelineReader

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3863: -- Labels: yarn-2928-1st-milestone (was: ) > Enhance filters in TimelineReader > --

[jira] [Updated] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3862: -- Labels: yarn-2928-1st-milestone (was: ) > Decide which contents to retrieve and send back in response in

[jira] [Updated] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4053: -- Labels: yarn-2928-1st-milestone (was: ) > Change the way metric values are stored in HBase Storage > ---

[jira] [Updated] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3995: -- Labels: yarn-2928-1st-milestone (was: ) > Some of the NM events are not getting published due race condi

[jira] [Updated] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4062: -- Labels: yarn-2928-1st-milestone (was: ) > Add the flush and compaction functionality via coprocessors an

[jira] [Updated] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4097: -- Labels: yarn-2928-1st-milestone (was: ) > Create POC timeline web UI with new YARN web UI framework > --

[jira] [Updated] (YARN-4239) Flow page for Web UI

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4239: -- Labels: yarn-2928-1st-milestone (was: ) > Flow page for Web UI > > >

[jira] [Updated] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2015-11-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4238: -- Labels: yarn-2928-1st-milestone (was: ) > createdTime and modifiedTime is not reported while publishing

[jira] [Updated] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4354: - Attachment: YARN-4354-unittest.patch Attaching a unit test I hacked together that demonstrates the problem

[jira] [Commented] (YARN-4226) Make capacity scheduler queue's preemption status REST API consistent with GUI

2015-11-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004297#comment-15004297 ] Eric Payne commented on YARN-4226: -- Since the {{preemptionDisabled}} tag has already shipp

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004157#comment-15004157 ] Jason Lowe commented on YARN-4354: -- I believe this was caused by YARN-2902. A resource wa

[jira] [Commented] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004143#comment-15004143 ] Jason Lowe commented on YARN-4354: -- Sample stacktrace: {noformat} java.util.concurrent.Rej

[jira] [Created] (YARN-4354) Public resource localization fails with NPE

2015-11-13 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4354: Summary: Public resource localization fails with NPE Key: YARN-4354 URL: https://issues.apache.org/jira/browse/YARN-4354 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4344) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

2015-11-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004024#comment-15004024 ] Varun Vasudev commented on YARN-4344: - The test failures are unrelated to the patch. >

[jira] [Commented] (YARN-4344) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003979#comment-15003979 ] Hadoop QA commented on YARN-4344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4301) NM disk health checker should have a timeout

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003862#comment-15003862 ] Hadoop QA commented on YARN-4301: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4344) NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations

2015-11-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4344: Attachment: YARN-4344.002.patch Thanks for the feedback everyone. I've uploaded a new patch to use th

[jira] [Updated] (YARN-4301) NM disk health checker should have a timeout

2015-11-13 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akihiro Suda updated YARN-4301: --- Attachment: YARN-4301-1.patch Attached {{YARN-4301-1.patch}}. If I can get positive reviews for the pat

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003690#comment-15003690 ] Varun Saxena commented on YARN-4053: Updating a renamed patch file so that QA build can

[jira] [Updated] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4053: --- Attachment: (was: YARN-4053-YARN-2928.03.patch) > Change the way metric values are stored in HBase

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-11-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003688#comment-15003688 ] Hadoop QA commented on YARN-4053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||