[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-016.patch patch -016: includes registry cli patch (-002) of YARN-2616 Add a

[jira] [Commented] (YARN-2616) Add CLI client to the registry to list/view entries

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155530#comment-14155530 ] Steve Loughran commented on YARN-2616: -- the patch I just posted doesn't {{stop()}} the

[jira] [Commented] (YARN-2616) Add CLI client to the registry to list/view entries

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155624#comment-14155624 ] Steve Loughran commented on YARN-2616: -- features of 003 patch # registry instance

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153697#comment-14153697 ] Steve Loughran commented on YARN-913: - A couple of offline comments from sanjay radia #

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153735#comment-14153735 ] Steve Loughran commented on YARN-913: - w.r.t first comment. putting path in the registry

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153740#comment-14153740 ] Steve Loughran commented on YARN-913: - w.r.t [~aw]'s comments: bq. If a client needs to

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153745#comment-14153745 ] Steve Loughran commented on YARN-913: - [~aw]: new constant for you+ javadocs: {code}

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14153748#comment-14153748 ] Steve Loughran commented on YARN-913: - Oh, and I renamed the field: {code} /** *

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-014.patch Updated patch # comments renames the {{HOSTNAME_PATTERN}} field (for

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-013.patch patch -013; adds way more diagnostics into the exception text, to help

[jira] [Created] (YARN-2616) Add CLI client to the registry to list/view entries

2014-09-28 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2616: Summary: Add CLI client to the registry to list/view entries Key: YARN-2616 URL: https://issues.apache.org/jira/browse/YARN-2616 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148951#comment-14148951 ] Steve Loughran commented on YARN-913: - Distributed shell test *appears* to be YARN-2607,

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-011.patch Print out detailed diags (inc ACLs) on permissions problems during

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-012.patch tightened down code, docs, javadocs, move classes around to psitions

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-010.patch This patch doesn't look at why yesterday's jenkin tests failed, so if

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-009.patch Revised patch A key change is * support for kerberos digest (id:pass)

[jira] [Commented] (YARN-2465) Make YARN unit tests work when pseudo distributed cluster is running

2014-09-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146722#comment-14146722 ] Steve Loughran commented on YARN-2465: -- Application history server comes up hard coded

[jira] [Created] (YARN-2597) MiniYARNCluster doesn't propagate reason for AHS not starting

2014-09-24 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2597: Summary: MiniYARNCluster doesn't propagate reason for AHS not starting Key: YARN-2597 URL: https://issues.apache.org/jira/browse/YARN-2597 Project: Hadoop YARN

[jira] [Commented] (YARN-2597) MiniYARNCluster doesn't propagate reason for AHS not starting

2014-09-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146726#comment-14146726 ] Steve Loughran commented on YARN-2597: -- Without the patch {code}

[jira] [Updated] (YARN-2597) MiniYARNCluster doesn't propagate reason for AHS not starting

2014-09-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2597: - Attachment: YARN-2597-001.patch propagates failure cause on AHS startup failure MiniYARNCluster

[jira] [Commented] (YARN-2554) Slider AM Web UI is inaccessible if HTTPS/SSL is specified as the HTTP policy

2014-09-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143495#comment-14143495 ] Steve Loughran commented on YARN-2554: -- Vinod, this patch is independent of kerberos,

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142086#comment-14142086 ] Steve Loughran commented on YARN-913: - bq. I have some concern around 'naked'

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142090#comment-14142090 ] Steve Loughran commented on YARN-913: - Oh, one more thing, that

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-006.patch patch --006; fixes dshell test. No idea why the others are failing,

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140472#comment-14140472 ] Steve Loughran commented on YARN-913: - test result is spurious: the build was cancelled.

[jira] [Commented] (YARN-1143) Restrict the names that apps and types can have

2014-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14140597#comment-14140597 ] Steve Loughran commented on YARN-1143: -- I don't think we need to do this except for

[jira] [Resolved] (YARN-1143) Restrict the names that apps and types can have

2014-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-1143. -- Resolution: Won't Fix Fix Version/s: 2.6.0 Restrict the names that apps and types can

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-007.patch Should fix Jenkins builds: javadocs, tests and findbugs, leaving only

[jira] [Created] (YARN-2571) RM to support YARN registry

2014-09-19 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2571: Summary: RM to support YARN registry Key: YARN-2571 URL: https://issues.apache.org/jira/browse/YARN-2571 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-008.patch -008 patch # fixes last lurking findbug # includes the registry site

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-003.patch Updated patch with ACL build-up for system permissions on secure

[jira] [Commented] (YARN-2562) ContainerId@toString() is unreadable for epoch 0 after YARN-2182

2014-09-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136993#comment-14136993 ] Steve Loughran commented on YARN-2562: -- +1 for text making it clear what the values

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-003.patch assuming this patch builds (it does appear to locally), this patch #

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-002.patch Patch -002 # adds persistence policy # {{RegistryOperationsService}}

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-09-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119816#comment-14119816 ] Steve Loughran commented on YARN-611: - Looks good to me, though someone who understands

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: 2014-09-03_Proposed_YARN_Service_Registry.pdf Here's the registry proposal Sanjay and I

[jira] [Resolved] (YARN-2086) AmIpFilter to support REST APIs

2014-09-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-2086. -- Resolution: Won't Fix you can't open the filter and keep the AM secure ... the only secure

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-09-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-001.patch YARN 913 registry, patch 001 Features # ZK based registry YARN

[jira] [Updated] (YARN-2392) add more diags about app retry limits on AM failures

2014-09-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2392: - Attachment: YARN-2392-002.patch patch against migrated git trunk add more diags about app retry

[jira] [Commented] (YARN-2487) Need to support timeout of AM When no containers are assigned to it for a defined period

2014-09-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118228#comment-14118228 ] Steve Loughran commented on YARN-2487: -- link to YARN-624; gang scheduling problem

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-08-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Component/s: resourcemanager Target Version/s: 2.6.0 Affects Version/s: (was:

[jira] [Commented] (YARN-728) Yarn and MR default classpath are wrong on Windows

2014-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105882#comment-14105882 ] Steve Loughran commented on YARN-728: - marking as a duplicate of the (fixed) YARN-1138

[jira] [Commented] (YARN-1554) add an env variable for the YARN AM classpath

2014-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105885#comment-14105885 ] Steve Loughran commented on YARN-1554: -- ..it's a proposed solution to YARN-973 : that

[jira] [Commented] (YARN-675) In YarnClient, pull AM logs on AM container failure

2014-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090501#comment-14090501 ] Steve Loughran commented on YARN-675: - This is dangerous if the logs are more than a few

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

2014-08-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090502#comment-14090502 ] Steve Loughran commented on YARN-2392: -- ...there's no tests here as there is nothing

[jira] [Created] (YARN-2392) add more diags about app retry limits on AM failures

2014-08-07 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2392: Summary: add more diags about app retry limits on AM failures Key: YARN-2392 URL: https://issues.apache.org/jira/browse/YARN-2392 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-2392) add more diags about app retry limits on AM failures

2014-08-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2392: - Attachment: YARN-2392-001.patch Patch fixes spaces, and when global limit != local, when an app

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086291#comment-14086291 ] Steve Loughran commented on YARN-611: - Looking at the code in a bit more detail # the

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082195#comment-14082195 ] Steve Loughran commented on YARN-611: - It looks OK to me, though I don't know YARN's

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-08-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082252#comment-14082252 ] Steve Loughran commented on YARN-796: - I'm not going to comment on the current

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054667#comment-14054667 ] Steve Loughran commented on YARN-2242: -- thinking about this, one thing I'd like for my

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053744#comment-14053744 ] Steve Loughran commented on YARN-2242: -- +1 for retaining/propagating as much

[jira] [Commented] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-07-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049758#comment-14049758 ] Steve Loughran commented on YARN-2139: -- looks a good first draft # unless this does

[jira] [Updated] (YARN-2065) AM cannot create new containers after restart-NM token from previous attempt used

2014-07-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2065: - Attachment: YARN-2065-003.patch correction: this is the version that compiles against trunk.

[jira] [Commented] (YARN-2065) AM cannot create new containers after restart-NM token from previous attempt used

2014-07-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050521#comment-14050521 ] Steve Loughran commented on YARN-2065: -- With Jenkins happy, I'm +1 on this patch; it

[jira] [Commented] (YARN-1565) Add a way for YARN clients to get critical YARN system properties from the RM

2014-07-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048704#comment-14048704 ] Steve Loughran commented on YARN-1565: -- I think this should be part of the REST API

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2014-06-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: YARN-679-003.patch Revised patch # uses reflection to load the HDFS and YARN

[jira] [Commented] (YARN-2065) AM cannot create new containers after restart-NM token from previous attempt used

2014-06-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047111#comment-14047111 ] Steve Loughran commented on YARN-2065: -- I'll try to run my code against this patch

[jira] [Updated] (YARN-2065) AM cannot create new containers after restart-NM token from previous attempt used

2014-06-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2065: - Attachment: YARN-2065-002.patch This is the previous patch, in sync with trunk AM cannot create

[jira] [Updated] (YARN-2223) NPE on ResourceManager recover

2014-06-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2223: - Environment: JDK 8u5 NPE on ResourceManager recover --

[jira] [Commented] (YARN-1727) provide (async) application lifecycle events to management tools

2014-06-25 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044003#comment-14044003 ] Steve Loughran commented on YARN-1727: -- Yes, this can and should be appilcation

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042370#comment-14042370 ] Steve Loughran commented on YARN-1039: -- bq. We need to have another flag to indicate

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2014-06-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042910#comment-14042910 ] Steve Loughran commented on YARN-614: - I like this, but need to note one thing: our AM

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041105#comment-14041105 ] Steve Loughran commented on YARN-1039: -- I see. I'd assume that the service flag would

[jira] [Commented] (YARN-2190) Provide a Windows container executor that can limit memory and CPU

2014-06-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039973#comment-14039973 ] Steve Loughran commented on YARN-2190: -- # what would the implications for the move

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039976#comment-14039976 ] Steve Loughran commented on YARN-1039: -- # I'd make the long-lived flag a container

[jira] [Commented] (YARN-941) RM Should have a way to update the tokens it has for a running application

2014-06-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037828#comment-14037828 ] Steve Loughran commented on YARN-941: - [~vanzin], the issue here is that the AMRM token

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

2014-06-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038041#comment-14038041 ] Steve Loughran commented on YARN-1039: -- marking as depended on by YARN-896. I would

[jira] [Commented] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-06-11 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14027820#comment-14027820 ] Steve Loughran commented on YARN-2139: -- well, I am happy to be wrong here. I was of

[jira] [Commented] (YARN-2139) Add support for disk IO isolation/scheduling for containers

2014-06-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14027357#comment-14027357 ] Steve Loughran commented on YARN-2139: -- I don't think I was clear enough, sorry HDFS

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2014-06-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14020769#comment-14020769 ] Steve Loughran commented on YARN-679: - some of the compiler warning are about use of

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2014-06-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: YARN-679-002.patch This (big) patch provides the service launcher with # a

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2014-06-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: org.apache.hadoop.servic...mon 3.0.0-SNAPSHOT API).pdf This is the package javadoc add

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2014-06-06 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: YARN-679-002.patch add an entry point that can start any Yarn service

[jira] [Created] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2014-06-05 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2127: Summary: Move YarnUncaughtExceptionHandler into Hadoop common Key: YARN-2127 URL: https://issues.apache.org/jira/browse/YARN-2127 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2127) Move YarnUncaughtExceptionHandler into Hadoop common

2014-06-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019165#comment-14019165 ] Steve Loughran commented on YARN-2127: -- I can incorporate this into YARN-679 easily

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2014-06-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Priority: Major (was: Minor) Affects Version/s: 2.4.0 add an entry point that can

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2014-06-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017618#comment-14017618 ] Steve Loughran commented on YARN-679: - This turns out to be useful both client-side and

[jira] [Updated] (YARN-1564) add some basic workflow YARN services

2014-06-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-1564: - Attachment: YARN-1564-001.patch Here is a package containing the set of workflow yarn services

[jira] [Resolved] (YARN-804) mark AbstractService init/start/stop methods as final

2014-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-804. - Resolution: Won't Fix I don't think we can fix this while mocking is used to test some aspects of

[jira] [Commented] (YARN-741) Mark yarn.service package as public unstable

2014-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015298#comment-14015298 ] Steve Loughran commented on YARN-741: - fixed in YARN-825 Mark yarn.service package as

[jira] [Resolved] (YARN-741) Mark yarn.service package as public unstable

2014-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-741. - Resolution: Duplicate Mark yarn.service package as public unstable

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2014-05-28 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010906#comment-14010906 ] Steve Loughran commented on YARN-2092: -- # code using Apache Curator was one -in YARN

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2014-05-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007269#comment-14007269 ] Steve Loughran commented on YARN-2092: -- I think this should be a wontfix, as the

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2014-05-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14005718#comment-14005718 ] Steve Loughran commented on YARN-2092: -- This seems like from the HADOOP-10104 patch.

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2014-05-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14005804#comment-14005804 ] Steve Loughran commented on YARN-2092: -- I should add that the underlying issue is that

[jira] [Commented] (YARN-2082) Support for alternative log aggregation mechanism

2014-05-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14004478#comment-14004478 ] Steve Loughran commented on YARN-2082: -- we do have log issues in long-lived apps, but

[jira] [Created] (YARN-2084) YARN to support REST APIs in AMs

2014-05-21 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2084: Summary: YARN to support REST APIs in AMs Key: YARN-2084 URL: https://issues.apache.org/jira/browse/YARN-2084 Project: Hadoop YARN Issue Type: New Feature

[jira] [Created] (YARN-2085) GenericExceptionHandler can't report into TEXT/PLAIN responses

2014-05-21 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2085: Summary: GenericExceptionHandler can't report into TEXT/PLAIN responses Key: YARN-2085 URL: https://issues.apache.org/jira/browse/YARN-2085 Project: Hadoop YARN

[jira] [Created] (YARN-2086) AmIpFilter to support REST APIs

2014-05-21 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2086: Summary: AmIpFilter to support REST APIs Key: YARN-2086 URL: https://issues.apache.org/jira/browse/YARN-2086 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-2087) YARN proxy doesn't relay verbs other than GET

2014-05-21 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2087: Summary: YARN proxy doesn't relay verbs other than GET Key: YARN-2087 URL: https://issues.apache.org/jira/browse/YARN-2087 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2084) YARN to support REST APIs in AMs

2014-05-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14004609#comment-14004609 ] Steve Loughran commented on YARN-2084: -- Note that for Slider we worked around the

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-05-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001563#comment-14001563 ] Steve Loughran commented on YARN-1372: -- how long is AM restart likely to take? Should

[jira] [Commented] (YARN-941) RM Should have a way to update the tokens it has for a running application

2014-05-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998704#comment-13998704 ] Steve Loughran commented on YARN-941: - We've been doing AM restart, and seen some token

[jira] [Created] (YARN-2065) AM cannot create new containers after restart-NM token from previous attempt used

2014-05-16 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-2065: Summary: AM cannot create new containers after restart-NM token from previous attempt used Key: YARN-2065 URL: https://issues.apache.org/jira/browse/YARN-2065

[jira] [Commented] (YARN-2053) Slider AM fails to restart

2014-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997461#comment-13997461 ] Steve Loughran commented on YARN-2053: -- {code} {noformat} 14/05/10 17:02:17 INFO

[jira] [Updated] (YARN-2053) Slider AM fails to restart: NPE in

2014-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2053: - Summary: Slider AM fails to restart: NPE in (was: Slider AM fails to restart) Slider AM fails

[jira] [Updated] (YARN-2053) Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts

2014-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2053: - Summary: Slider AM fails to restart: NPE in

[jira] [Commented] (YARN-2053) Slider AM fails to restart

2014-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997459#comment-13997459 ] Steve Loughran commented on YARN-2053: -- Note that this AM requests container retention

[jira] [Updated] (YARN-2053) Slider AM fails to restart

2014-05-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2053: - Description: Slider AppMaster restart fails with the following: {code}

<    4   5   6   7   8   9   10   11   12   >