Re: [DISCUSS] Next Steps for Slider & First-Class Services in YARN (YARN-4692)

The proposal makes sense to me. Given the relative maturity of the code and the overlap in functionality and requirements, it would make sense to proceed with Slider as the basis for the long running service support. > On Mar 16, 2016, at 10:58 PM, Josh Elser wrote: > >

Re: Long running applications in a non-Kerberos cluster?

ized production environment. Thanks again everyone. Tim On Mar 9, 2016 8:59 AM, "Jon Maron"<jma...@hortonworks.com<mailto:jma...@hortonworks.com>> wrote: On Mar 8, 2016, at 11:36 PM, Tim I<t...@timisrael.com<mailto:t...@timisrael.com>> wrote: Hi Josh,

Re: Long running applications in a non-Kerberos cluster?

> On Mar 8, 2016, at 11:36 PM, Tim I wrote: > > Hi Josh, > Basically anything with a kerberos ticket could no longer could communicate > with anything else after 7 days due to the default config for the kerberos > server : > renew_lifetime = 7d > > The delegation token I

Re: Global Allocated Ports Pool

cified range. The setting would more than likely have the form of: "site.server.port": “${JETTY_SERVER.ALLOCATED_PORT}{PER_CONTAINER}" where JETTY_SERVER is the defined component name for the server. On Tue, Mar 1, 2016 at 9:18 AM Jon Maron <jma...@hortonworks.com<mail

Re: Global Allocated Ports Pool

> On Mar 1, 2016, at 9:07 AM, Roshan Punnoose wrote: > > Hi, > > On my current application, we are looking to deploy jetty apps in Slider, > to allow the ability to provision them in Yarn and also to flex them as > needed. What I would like to do is have a separate slider

Re: slider 0.80 error on CDH 5.5.1 - "User is not based on a keytab in a secure deployment"

The slider fix was simply a logging improvement, I believe. The real issue is the modification of the way the JDK changed the kerberos logging module in latter versions of JDK 7 and JDK 8 (https://issues.apache.org/jira/browse/HADOOP-10786). I assume that your version of CDH is manifesting

Re: Valid characters in component name

lusternamePattern). It includes the dash (-). >>>>>>> >>>>>>> While Jon experiments with your package, just wondering your app >>>>> works >>>>>>> fine when you get rid of the dash, right? >>>>>>> &

Re: Valid characters in component name

-). > > While Jon experiments with your package, just wondering your app works > fine when you get rid of the dash, right? > > -Gour > >> On 1/14/16, 8:35 AM, "Jon Maron" <jma...@hortonworks.com> wrote: >> >> Sorry - got pulled off on some other task

Re: Valid characters in component name

ponent name I used above ? > > Thanks, > > Manoj > > On Tue, Jan 12, 2016 at 4:37 PM, Steve Loughran <ste...@hortonworks.com> > wrote: > >> >>> On 12 Jan 2016, at 12:14, Jon Maron <jma...@hortonworks.com> wrote: >>> >>> OK. So was the

Re: Valid characters in component name

ics=Container released by application Thanks for your time, Manoj On Tue, Jan 12, 2016 at 12:14 PM, Jon Maron <jma...@hortonworks.com<mailto:jma...@hortonworks.com>> wrote: OK. So was there a ‘-‘ or some other character in your component name? A ‘-‘ should work. The component name

Re: Valid characters in component name

Did you replace the actual comp name with , or do you actually have the ‘<‘ and ‘>’ characters in the name? > On Jan 12, 2016, at 2:40 PM, Manoj Samel wrote: > > Slider version 0.80 with secured cluster > > Use case is to create a component reflecting user name. It

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

+1 Downloaded source tar.gz file Found no .pyc files verified sha1, asc, and md5 Ran full unit test suite successfully > On Dec 29, 2015, at 5:48 AM, Steve Loughran wrote: > > Hello, > > This is a call for a vote on the Apache Slider (incubating) release >

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

Does looks like this issue: https://bugs.openjdk.java.net/browse/JDK-8051012. I can find instances on the web referencing the version you use with this issue (groovy compatibility issue) > On Dec 29, 2015, at 12:31 PM, Ted Yu wrote: > > java version "1.7.0_67" >

Re: ZK registry entries cleanup for slider app

: > >> there's a patch up to do the deletion (best effort) when things get taken >> down...I plan to pull it in once we've got this 0.90 release out >> >>> On 23 Dec 2015, at 20:21, Jon Maron <jma...@hortonworks.com> wrote: >>> >>>> >

Re: ZK registry entries cleanup for slider app

> On Dec 23, 2015, at 2:03 PM, Manoj Samel wrote: > > Hi, > > Setup - slider version .80, secure hadoop cluster, registry enabled with > security > > Noticed using *** zookeeper client (zkCli.sh) *** that when slider > application is stopped, the registry entries in

Re: ZK registry entries cleanup for slider app

y based information. > > Thanks, > > Manoj > > On Wed, Dec 23, 2015 at 11:12 AM, Jon Maron <jma...@hortonworks.com> wrote: > >> >>> On Dec 23, 2015, at 2:03 PM, Manoj Samel <manojsamelt...@gmail.com> >> wrote: >>> >>> Hi, &g

Re: DISCUSS: SLIDER-1020 Slider client to copy slider.* to AM config

> On Dec 14, 2015, at 9:11 AM, Steve Loughran wrote: > > > I'm doing some work getting the AM to come up as HTTPS (primarily to for > tests related to SLIDER-907 and an HTTPS RM) So you’re implementing HTTPS at the RM end? I imagine you’ll need access to AM cert

Re: Concerning Sentry: A disagreement over the Apache Way and graduation

> On Nov 10, 2015, at 3:38 PM, Steve Loughran wrote: > > From incubator-general > > This is interesting —and I think we need to make sure we aren't going to go > the same way. > > Part of the problem is, IMO, simply JIRA-first development gets in the way of > broader

Re: november report draft

+1 > On Nov 3, 2015, at 12:59 PM, Billie Rinaldi wrote: > > Would anyone like to add something to the following report for November? > > - > Slider > > Slider is a collection of tools and technologies to package, deploy, and > manage long running

[ANNOUNCE] Apache Slider 0.81.1-incubating

The Apache Slider team is proud to announce Apache Slider incubation release version 0.81.1-incubating. Apache Slider (incubating) is a YARN application which deploys existing distributed applications on YARN, monitors them, and makes them larger or smaller as desired - even while the

Re: Slider-agent can not be started

Any idea what python version the agent hosts are running? Version 2.7.9 has issues, so the max version currently supported in 2.7.8. — Jon On Oct 28, 2015, at 6:27 AM, Rohith Sharma K S > wrote: Hi folks, Ping.. Any Idea on this

[VOTE] Release Apache Slider 0.81.1-incubating

Hello, This is a call for a vote for releasing Apache Slider 0.81.1-incubating. This is a source release. Summary of fixes: http://s.apache.org/sgG Release Notes: http://s.apache.org/ZZP Vote thread: http://s.apache.org/Ejv Results: http://s.apache.org/ufJ Staged artifacts:

[CANCEL] [VOTE] Apache Slider Incubating Release 0.81.0-incubating

e. Also a >> candidate for deletion? >> >> * Copyright year exists in some files in the license header (and >> shouldn't/doesn't need to, afaik) >> >> ** ./slider-agent/src/test/python/python-wrap >> ** ./app-packages/storm/package/files/storm-slider >>

[VOTE] Apache Slider Incubating Release 0.81.1-incubating

Hello, This is a call for a vote on Apache Slider 0.81.0-incubating release. This is a source release. The list of all issues fixed: http://s.apache.org/ZnA Staged artifacts: https://repository.apache.org/content/repositories/orgapacheslider-1008/ Source zip:

Re: Slider-develop - Build # 716 - Still Failing

SLIDER-777 and SLIDER-935 are slated for 0.81 as well. Gour, I believe you’ve committed the fix for 777? Steve, Think you’ll get to 935? — Jon > On Oct 13, 2015, at 3:00 PM, Gour Saha wrote: > > Thomas, > If we know the fix, let's fix it. Jon will be starting

Re: Slider-develop - Build # 716 - Still Failing

> On Oct 13, 2015, at 3:09 PM, Jon Maron <jma...@hortonworks.com> wrote: > > SLIDER-777 and SLIDER-935 are slated for 0.81 as well. > > Gour, > > I believe you’ve committed the fix for 777? > > Steve, > > Think you’ll get to 935? It looks li

Re: new committer

Welcome!! — Jon On Jul 7, 2015, at 12:49 PM, Billie Rinaldi billie.rina...@gmail.com wrote: Welcome Thomas Liu, a new committer and PPMC member for Apache Slider!

Re: Secured Zookeeper

On Jun 5, 2015, at 4:12 PM, Billie Rinaldi billie.rina...@gmail.com wrote: On Fri, Jun 5, 2015 at 12:58 PM, Steve Loughran ste...@hortonworks.com wrote: ooh, now ZK has interesting and complicated security. I spent more time writing the kerberos ZK tests for the yarn registry than most

Re: Need hostname for use in appConfig.json

Alternatively, you could also try using the convention used elsewhere in hadoop: username/_HOST@domain. _HOST is generally replaced at runtime with the host name. Most applications currently honor that convention (Internally calling SecurityUtil.getServerPrincipal(String

Re: Need hostname for use in appConfig.json

, 2015 7:20 PM To: dev@slider.incubator.apache.org Subject: Re: Need hostname for use in appConfig.json Thanks for your answer, I did try using {THIS_HOST}, it didn't work Regards, Nathaniel From: Jon Maron jma...@hortonworks.com Sent: Monday

Re: Keytab issue with Hbase secure

redeployed it on my gateway and launched my application. The error is the same as before. On Fri, May 29, 2015 at 3:36 PM, Jon Maron jma...@hortonworks.com wrote: Please describe the full procedure you used to retest. On May 29, 2015, at 9:28 AM, Yohan Bismuth yohan.bismu...@gmail.com

Re: Keytab issue with Hbase secure

That is strange - the login is from a keytab, but the UGI indicates it’s from a ticket. I’ll need to investigate some more. Can you send me the full log? I imagine the listserv will not allow it. Thanks! On May 29, 2015, at 5:24 AM, Yohan Bismuth yohan.bismu...@gmail.com wrote: Btw,

Re: Keytab issue with Hbase secure

Looks like you’ve found a bug: validateLoginUser should be calling isLoginKeytabBased(), not isFromKeytab(). Would mind filing a JIRA? — Jon On May 29, 2015, at 5:24 AM, Yohan Bismuth yohan.bismu...@gmail.com wrote: Btw, i've tried using java7 and java8: smae issue. I'm correctly logged

Re: Keytab issue with Hbase secure

, was not looking the good thing On Fri, May 29, 2015 at 3:13 PM, Jon Maron jma...@hortonworks.com wrote: It’s declared as public static: public synchronized static boolean isLoginKeytabBased() at least the version I’m looking at On May 29, 2015, at 8:52 AM, Yohan Bismuth yohan.bismu

Re: Keytab issue with Hbase secure

is private in ugi. On Fri, May 29, 2015 at 1:56 PM, Jon Maron jma...@hortonworks.com wrote: Looks like you’ve found a bug: validateLoginUser should be calling isLoginKeytabBased(), not isFromKeytab(). Would mind filing a JIRA? — Jon On May 29, 2015, at 5:24 AM, Yohan Bismuth yohan.bismu

Re: Keytab issue with Hbase secure

and launched my application. The error is the same as before. On Fri, May 29, 2015 at 3:36 PM, Jon Maron jma...@hortonworks.com wrote: Please describe the full procedure you used to retest. On May 29, 2015, at 9:28 AM, Yohan Bismuth yohan.bismu...@gmail.com wrote: ...but i got the same

Re: Keytab issue with Hbase secure

. On May 28, 2015, at 1:18 PM, Yohan Bismuth yohan.bismu...@gmail.com wrote: Yes i did Le 28 mai 2015 19:15, Jon Maron jma...@hortonworks.com a écrit : Did you actually log in (kinit) prior to invoking the slider client? You’ll need to do that in order to establish an identity for the AM

Re: slider may report

+1 On May 6, 2015, at 8:58 AM, Billie Rinaldi billie.rina...@gmail.com wrote: How does this draft look? Slider Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since

Re: Need help in starting storm on yarn using slider

client.ConfiguredRMFailoverProxyProvider - Failing over to rm2 2015-04-08 21:40:32,306 [main] ERROR main.ServiceLauncher - *Unknown application instance : hb1* 2015-04-08 21:40:32,308 [main] INFO util.ExitUtil - Exiting with status 69 On Wed, Apr 8, 2015 at 7:14 PM, Jon Maron jma...@hortonworks.com wrote: Indications

Re: Need help in starting storm on yarn using slider

Aside from the yarn issue you discovered wrt HA, if you have any recommendations for usability/diagnosability, please feel free to let us know or file JIRAs (e.g. perhaps the error message below should add “Please make sure you are logged in as the application owner” :) ) — Jon On Apr 9,

Re: Need help in starting storm on yarn using slider

? No need for screen shot. Also please send your resources JSON file. -Gour - Sent from my iPhone On Apr 7, 2015, at 11:01 AM, Jon Maron jma...@hortonworks.com wrote: On Apr 7, 2015, at 1:36 PM, Chackravarthy Esakkimuthu chaku.mi...@gmail.commailto:chaku.mi...@gmail.com wrote

Re: Need help in starting storm on yarn using slider

you take a screenshot of your RM UI and send it over? It is usually available in a URI similar to http://c6410.ambari.apache.org:8088/cluster. I am specifically interested in seeing the Cluster Metrics table. -Gour On 4/7/15, 10:17 AM, Jon Maron jma...@hortonworks.commailto:jma...@hortonworks.com

Re: Need help in starting storm on yarn using slider

On Apr 7, 2015, at 1:14 PM, Jon Maron jma...@hortonworks.com wrote: On Apr 7, 2015, at 1:08 PM, Chackravarthy Esakkimuthu chaku.mi...@gmail.com wrote: Thanks for the reply guys! Contianer allocation happened successfully. *RoleStatus{name='slider-appmaster', key=0, minimum=0

Re: Invalid port 0 for storm instances

We transitioned from “ALLOCATED_PORT” to “PER_CONTAINER” - I just can’t recall whether that was in the 0.60 timeframe? — Jon On Mar 30, 2015, at 1:21 PM, Sumit Mohanty sumit.moha...@gmail.com wrote: Did you create the storm package yourself? Can you share the appConfig.json you are using?

Re: [VOTE] Apache Slider Incubating Release 0.70.0-incubating

+1 On Mar 6, 2015, at 11:14 PM, Gour Saha gs...@hortonworks.com wrote: Hello, This is a call for a vote on Apache Slider Incubating 0.70.0-incubating release. This is a source+binary release. The issues fixed in this release are listed at at:

Re: Intermittent issues accessing zookeeper

the connection seemed to be using the IPv6 address? -Gour On 2/25/15, 6:53 AM, Jon Maron jma...@hortonworks.com wrote: I¹ve noticed that I¹m having intermittent issues accessing the zookeeper quorum during ³destroy² attempts: 2015-02-25 09:48:02,345 [main] WARN client.SliderClient

Intermittent issues accessing zookeeper

I’ve noticed that I’m having intermittent issues accessing the zookeeper quorum during “destroy” attempts: 2015-02-25 09:48:02,345 [main] WARN client.SliderClient (SliderClient.java:getZkClient(523)) - Unable to connect to zookeeper quorum

Re: Slider-develop - Build # 543 - Failure

Looks like a failure from my commit. Will diagnose and fix. On Feb 3, 2015, at 12:42 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: The Apache Jenkins build system has built Slider-develop (build #543) Status: Failure Check console output at

Re: Google Summer of Code 2015 is coming

* Full app package tutorial * native support for scripting langs other than python (agent side) On Feb 3, 2015, at 5:06 PM, Sumit Mohanty sumit.moha...@gmail.com wrote: Some that come to my mind are: * Time line server, integration * Service Registry browser and API in Scala (e.g. some

Re: draft proposal: split up email list

On Feb 2, 2015, at 7:38 AM, Steve Loughran ste...@hortonworks.com wrote: following on from the discussion, I'd like to outline the proposal to bring a vote on two topics. I'm not sure what level of contribution defines bindingness (committer?) Proposal #1: create

Re: [VOTE] Apache Slider Incubating Release 0.61.0-incubating

Perhaps someone better versed with maven can attempt this: I’m just trying to come up with the correct set of parameters to pull this version from the repository as a dependency (just to test the ability to reference it as a project dependency): mvn

Re: [VOTE] Apache Slider Incubating Release 0.61.0-incubating

+1 On Jan 28, 2015, at 10:09 AM, Steve Loughran ste...@hortonworks.com wrote: This is a call for a vote on Apache Slider 0.61.0-incubating release This is a source+binary release. This release extends the previous RC with: -full transient license check metadata -use of -incubating in

Re: [VOTE] Apache Slider Incubating Release 0.61.0-incubating

-9Ew3omr8rek29Ew1vD_Jfd45-shWVukbdAdDa14SUyrwKLp /apache/slider/slider-core/0.61.0-incubating/slider-core-0.61.0-incubating. jar Š Let me verify the other aspects prior to voting. On 1/30/15, 8:42 AM, Jon Maron jma...@hortonworks.com wrote: Perhaps someone better versed with maven can attempt this: I¹m

Re: review board

/5fHCN0gdEI9FK9zDS7PtPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVouu7ffCN5noRw2ytoPH0Nm9mDbCOtoPH0Nm9mDbCPhOwCqei5C7-LPbzPVEVhWZOWrbOvefzD4XYJteOaaJQmul3PWApmU6CQjqpK_9TLuZXTLsTsSjDdqymokUD9qNfpYLx50gA6S1xoqdEupbN-rso5T64kiUyHIqMe9RzeI35oBqsK2G7Og-fixpIxIWNXlJIj_w09JVZV4S2_id44vcOYMq825tywrhsdFzYp2BUD On 27 January 2015 at 16:34, Jon Maron jma...@hortonworks.com wrote: Ted made

Re: updating the release process; what to do about branches

I would favor the current mapping - a little more intuitive IMHO On Jan 29, 2015, at 5:40 AM, Steve Loughran ste...@hortonworks.com wrote: (apologies for any formatting confusion here; I am migrating to Outlook web apps) I quite like the git flow bit of the sourcetree GUI; it looks

Re: [DISCUSS]: mailing list rework

On Jan 29, 2015, at 1:35 PM, Steve Loughran ste...@hortonworks.com wrote: A migration to outlook web access today has brought home how much machine-generated noise there is in this, primarily JIRA notifying of commits and changes.. Gmail had been hiding a lot of this for me. I think

Re: review board

/gdAiIcNyE On 27 January 2015 at 16:34, Jon Maron jma...@hortonworks.com wrote: Ted made that change early in January, but the issue has yet even get assigned. Is there any mechanism available to get this issue some attention? Can we escalate it? — Jon On Jan 5, 2015, at 10:14 AM, Billie

Re: Deploying Accumulo with Slider View Ambari 1.7 Question

You can try to obtain the set of logs associated with the application using the “yarn” command: yarn logs -applicationId application ID — Jon On Jan 27, 2015, at 9:33 AM, Billie Rinaldi billie.rina...@gmail.com wrote: Moving this to the Slider dev list. I am not seeing the cause of the

Re: review board

were listed as ReviewBoard. I think only Ted can change this. On Mon, Jan 5, 2015 at 7:06 AM, Jon Maron jma...@hortonworks.com wrote: Is there a way to poke one of these to get it moving? :) — Jon On Dec 21, 2014, at 11:41 PM, Ted Yu yuzhih...@gmail.com wrote: Logged INFRA-8927

Re: Locality results in instance shut-down due to single bad instance

+1. A good way to provide the functionality while leveraging existing mechanisms On Jan 8, 2015, at 8:46 AM, Gour Saha gs...@hortonworks.com wrote: +1 on that That's also what I meant when I said - I don't think we have a logic where we apply data locality and then upon a certain no of

Re: Locality results in instance shut-down due to single bad instance

requested? On Thu, Jan 8, 2015 at 9:19 AM, Steve Loughran ste...@hortonworks.com wrote: https://issues.apache.org/jira/browse/SLIDER-743 it is then. On 8 January 2015 at 14:26, Jon Maron jma...@hortonworks.com wrote: +1. A good way to provide the functionality while leveraging existing

Re: looking at a 0.62 release; 0.60 as published ASF binaries

+1 On Jan 8, 2015, at 2:13 PM, Sumit Mohanty smoha...@hortonworks.com wrote: Sounds good. +1 On Thu, Jan 8, 2015 at 11:03 AM, Steve Loughran ste...@hortonworks.com wrote: The Apache Ambari need maven-central hosted Slider artifacts, which means that we need to release some. I'm

Re: rm-ing the surplus slider-agent.tar.gz from the slider tar file

On Jan 6, 2015, at 9:54 AM, Steve Loughran ste...@hortonworks.com wrote: https://issues.apache.org/jira/browse/SLIDER-641 covers the fact that we have two slider-agent.tar.gz files in the tar, one in /lib, the other in /agent. I want to cut one: which one should I keep? I'm assuming the

Re: review board

group and also link the git repo for slider. I had created one INFRA jira for Ambari a while back for the same. See if that can be a reference. On Monday, December 22, 2014, Jon Maron jma...@hortonworks.com wrote: I’ve wondered about that myself. I’m wondering if anything is really

Re: How to set jvm option for HMaster

I’m not certain that would work for the HBase Master - it’s a Slider App Master setting. There are some specific heap size settings for the HMaster: site.global.hbase_master_heapsize: 1024m, It looks like specific ways to tune the master launch command line options would require some

Re: how to get get the port of memcached

, 2014 at 9:06 AM, 杨浩 yangha...@gmail.com wrote: I think it would be a convient way. The source idea is that to get some result of slider shell command by REST API. We just don't want to get the result by executing shell command in Java. 2014-12-23 19:39 GMT+08:00 Jon Maron jma

Re: how to get get the port of memcached

idea is that to get some result of slider shell command by REST API. We just don't want to get the result by executing shell command in Java. 2014-12-23 19:39 GMT+08:00 Jon Maron jma...@hortonworks.com: Are you suggesting that the client interact with the REST API to retrieve results

Re: when i run slider0.40+hadoop2.4 i found the error log in slider-error.log

On Dec 26, 2014, at 4:53 AM, liujs3 liu...@asiainfo.com wrote: no,I thought slider should be running like this . in fact ,I config the slider according to sliderwebsite, system required need openssl,when I install openssl,slider didn’t work,it said: ERROR 2014-11-30 22:59:05,697

Re: how to get get the port of memcached

Are you suggesting that the client interact with the REST API to retrieve results (instead of the current rpc mechanism)? That is part of the plan. On Dec 23, 2014, at 1:45 AM, 杨浩 yangha...@gmail.com wrote: I think a way to do so is that exposing the REST API to get the result of slider

Re: review board

I’ve wondered about that myself. I’m wondering if anything is really required administratively, or can we simply install RBTools and start posting reviews? On Dec 21, 2014, at 4:28 PM, Ted Yu yuzhih...@gmail.com wrote: Hi, Who should I contact so that patch for Slider can be added to

Application Management and Authorization

Hi, Is there an existing approach for exposing management functions to users other than the application creator? Most management operations validate the existence of a cluster definition in the cluster directory, which is by default under the creator’s home directory (e.g.

Re: Application Management and Authorization

On 18 December 2014 at 14:54, Jon Maron jma...@hortonworks.com wrote: Hi, Is there an existing approach for exposing management functions to users other than the application creator? Most management operations validate the existence of a cluster definition in the cluster directory, which

Re: [VOTE] Apache Slider Incubating Release 0.60.0-incubating RC1

+1 - performed a build - got a clean run of the full functional test suite against an up to date Ambari generated cluster: Tests run: 54, Failures: 0, Errors: 0, Skipped: 2 - Full unit test run came up clean: Tests run: 420, Failures: 0, Errors: 0, Skipped: 11 — Jon On Nov 14, 2014, at

Re: Do I have to repackage if I change appConfig.json/resources.json

Perhaps I’m misunderstanding your question, but in general, if making modifications to those files, you can simply create a new application instance referencing the new versions of the file from the command line: ./slider create app name —template appConfig path —resources resources file path

Re: Hadoop 2.6.0 being voted on on hadoop common-dev list, what do we need in Hadoop 2.7?

Security wise - perhaps the ability to actually wire encrypt AM traffic (i.e AM HTTPS support). Will require management of AM specific keystones, RM/AM trust establishment, etc (YARN-2554) — Jon On Nov 12, 2014, at 9:37 AM, Sumit Mohanty sumit.moha...@gmail.com wrote: Java7 is good news.

Documenting key configuration properties (appConfig, mostly)

Hi, I’ve started adding some documentation about key configuration properties to the incubator site’s core.md file (the core configuration spec). Perhaps these need to be pulled out as a separate document, but for the time being I thought I’d let it be known in case you are looking for a

Re: Memcahed doesn't start with latest slider code

It may help to provide any of the agent logs or memcached logs from the node managers. This could occur for any number of reasons including wrong java_home value. — Jon On Nov 5, 2014, at 1:55 PM, Pushkar Raste pushkar.ra...@gmail.com wrote: May I should provide entire log 2014-11-05

Re: yes, I've broken jenkins and possibly everyone's builds

Well..that explains it… ;) — Jon On Nov 2, 2014, at 9:40 AM, Steve Loughran ste...@hortonworks.com wrote: I know, I've just broken everyone's builds by merging SLIDER-531 into trunk ... I needed to get this in to go with some other things that aren't quite checked into apache hadoop right

Re: Wrong FS: hdfs://localhost:9000/user/root/.slider/cluster/c100, expected: file:/// Issues deploying memcached using slider.

I think the problem is probably in your appConfig file (e.g. referencing an application package from the the local filesystem as opposed to HDFS). Can you attach that? — Jon On Oct 27, 2014, at 10:54 AM, Pushkar Raste pushkar.ra...@gmail.com wrote: Hi, I am trying to to deploy memcached

Re: Slider-develop - Build # 369 - Failure

Looks like a failure based on my commit. Will fix soon. On Oct 25, 2014, at 6:39 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: The Apache Jenkins build system has built Slider-develop (build #369) Status: Failure Check console output at

Re: Intertmittent unit test failures

Additional logging from failing unit test: 2014-10-21 10:46:37,976 [Thread-76] INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at /192.168.64.1:58613 2014-10-21 10:46:37,976 [Thread-76] INFO

Re: Intertmittent unit test failures

:09 AM, Jon Maron jma...@hortonworks.com wrote: Additional logging from failing unit test: 2014-10-21 10:46:37,976 [Thread-76] INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(465)) - ContainerManager started at /192.168.64.1:58613 2014-10-21 10:46:37,976

Re: Intertmittent unit test failures

Thanks! That was the issue. — Jon On Oct 21, 2014, at 11:29 AM, Jon Maron jma...@hortonworks.com wrote: On Oct 21, 2014, at 11:21 AM, Sumit Mohanty sumit.moha...@gmail.com wrote: I have seen similar issues where, at home, localhost was being mapped to the router's IP and port allocation

Re: new committer

Welcome! Going Mobile On Sep 27, 2014, at 9:13 AM, Billie Rinaldi billie.rina...@gmail.com wrote: Welcome Gour Saha, a new committer and PPMC member for Apache Slider! Billie -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it

Re: --queue as an input parameter

, Sep 20, 2014 at 2:18 PM, Jon Maron jma...@hortonworks.com wrote: On Sep 20, 2014, at 5:11 PM, Sumit Mohanty smoha...@apache.org wrote: Currently, the queue to submit an application is defined in slider-client.xml. It is possible that the same deployment of slider-client can be used

Re: slider create cl1 YARN AM container exception

Which version of python is running on your hosts? The code is simply trying to execute ‘python —version’, and it appears that the python version you’re using indicates that is doesn’t support that option. Can you try the same call form a shell on the AM host? — Jon On Sep 11, 2014, at 9:54

Re: slider create cl1 YARN AM container exception

, PYTHON, --version); which executes python --version. On Thu, Sep 11, 2014 at 7:05 AM, 牛兆捷 nzjem...@gmail.com wrote: Python 2.7. I try the same call from a shell on the AM host and it works well. 2014-09-11 22:01 GMT+08:00 Jon Maron jma...@hortonworks.com: Which version of python

Re: Error with Slider -Memcached - ca.config does not seem to be generated

In this instance you could probably simply delete the /tmp/work directory and restart. A fix for this issue was recently committed (sorry - I don’t recall the exact commit id/date) — Jon On Sep 10, 2014, at 4:23 AM, Shivaji Dutta sdu...@hortonworks.com wrote: Hello All, I am trying to

Re: Self containing all Slider app artifacts

On Aug 30, 2014, at 2:55 PM, Sumit Mohanty smoha...@hortonworks.com wrote: Should we also move slider-client.tar.gz and application package into the application instance specific folder in HDFS? This along with the changes due to SLIDER-330 will likely make the application bits completely

Re: Few changes/improvements to the packaging structure

On Aug 21, 2014, at 5:12 PM, Sumit Mohanty smoha...@hortonworks.com wrote: There are some changes to the packaging structure based on some of the recent JIRA fixes. Let me know if you have any suggestions/objections regarding these and I will incorporate them before moving the change to

Re: ssl error after changing to slider-dev branch

with the configuration? Rui On 08/20/2014 10:05 AM, Jon Maron wrote: Hi, A fix for Slider-333 had just been merged and addresses some issues that appear to be similar. You may want to checkout the latest from develop branch and see if that works better. — Jon On Aug 19, 2014, at 4:41 PM

Re: ssl error after changing to slider-dev branch

/ is not reachable, sleeping for 10 seconds... in the agent log. It picked the first port. So I think I have already applied the fix. Thanks. Rui On 08/20/2014 12:39 PM, Jon Maron wrote: that looks fine. Can you do the following: - Look for logging statements in the AM log like the following

Re: ssl error after changing to slider-dev branch

. On 08/15/2014 12:14 PM, Jon Maron wrote: OK. Make sure the AM logs indicate that the openssl commands are succeeding. You should see log statements displaying some openssl command or statements indicating if the server certificate exists. On Aug 15, 2014, at 12:05 PM, Rui Zhang rzh

Re: ssl error after changing to slider-dev branch

using openssl 1.0.1f, Ubuntu14.04 and Hadoop 2.4.0. Rui On 08/19/2014 03:06 PM, Jon Maron wrote: I’m going to attempt this sort of deployment (I’m assuming you’re attempting two way SSL?) this afternoon (finishing up my current patch) and see if I can recreate the issue. — Jon On Aug

Re: Slider Token Renewal for long running apps

that a shot. I’ll reuse that config for the token renewal/expiry interactions and see if the scheme woks. It's main role is get by code that calls FileSystem.close() while other clients are using it. On 17 August 2014 21:01, Jon Maron jma...@hortonworks.com wrote: On Aug 17, 2014, at 10

Re: Slider Token Renewal for long running apps

On Aug 17, 2014, at 10:35 AM, Steve Loughran ste...@hortonworks.com wrote: On 16 August 2014 23:18, Jon Maron jma...@hortonworks.com wrote: Once a FileSystem existed for user ‘hdfs’ in the file system cache, invocations of FileSystem.get(Configuration) ( you can turn the cache off

Re: Slider Token Renewal for long running apps

that could handle multiple token renewal periods. On Sun, Aug 17, 2014 at 1:01 PM, Jon Maron jma...@hortonworks.com wrote: On Aug 17, 2014, at 10:35 AM, Steve Loughran ste...@hortonworks.com wrote: On 16 August 2014 23:18, Jon Maron jma...@hortonworks.com wrote: Once a FileSystem

Re: ssl error after changing to slider-dev branch

I’m having a hard time understanding exactly what your current setup is, so here are the details: - the agent code has been modified to communicate via SSL. That code is downloaded to each launched container from /slider/agent HDFS folder (slider-agent.tar.gz). If you have installed an up to

Re: ssl error after changing to slider-dev branch

of these but still got this error. It also says that it is not verified when I opened the link in the browser. Maybe there is some issue with my openssl. I will try to solve and report to you my progress. Thanks. On 08/15/2014 11:17 AM, Jon Maron wrote: - the agent code has been modified

Re: ssl error after changing to slider-dev branch

Can you provide more of a stack trace from either the agent logs or the application master log? Thanks! Going Mobile On Aug 14, 2014, at 3:54 PM, Rui Zhang rzh...@vertica.com wrote: Hi, everyone, I have changed to the dev branch but now it has this error. ERROR 2014-08-14

  1   2   >