Re: MapR problem. No FileSystem for scheme: maprfs

2017-02-17 Thread Gour Saha
Can you set the config property "fs.maprfs.impl" to the MapR implementation class of org.apache.hadoop.fs.FileSystem and try again? I think you can set this property in any of the cluster site xmls, preferably core-site.xml. -Gour On 2/17/17, 11:14 AM, "jonma...@gmail.com" wrote: >My guess is

Re: MapR problem. No FileSystem for scheme: maprfs

2017-02-17 Thread Gour Saha
der would read that core-site file, >>but it >> was not the case. However, since it was slider's client failing and the >> cluster is MapR, I simply added that property to slider-client.xml and >>it >> worked! >> Ps: I'm still getting some errors, but

Re: slider docker image name update problem

2017-02-17 Thread Gour Saha
First, I think slider update requires you to pass ‹resources as well, otherwise it messes up the internal resource state. Second, Slider update will not make any change to your running app. It will just update the hdfs state store which will not take effect until you do stop and start again. Or a

Re: slider docker image name update problem

2017-02-17 Thread Gour Saha
Sorry, the 2 dashes for --resources got modified to a weird character. Anyway, I meant pass the resources json with --resources option along with the --template option. On 2/17/17, 6:13 PM, "Gour Saha" wrote: >First, I think slider update requires you to pass ‹resources as >

Re: slider 0.91 install keytab problem

2017-03-01 Thread Gour Saha
Can you use Java 1.7 and try that cmd? -Gour - Sent from my iPhone > On Mar 1, 2017, at 4:56 PM, Jonathan Maron wrote: > > Do other slider commands appear to work (e.g. list)? I would suspect an > illegal character in a slider client xml file. > > >> On Mar 1, 2017, at 7:20 PM, David.Sera

Re: Stop Command Issuance

2017-03-03 Thread Gour Saha
It is probably a bug where it is not getting refreshed in the shutdown hook. Can you file a jira? -Gour On 2/22/17, 12:02 PM, "Josh Clum" wrote: >Hi, > >I'm developing a slider app and would like to know when the stop command >has been issued. I found that Path>/ws/v1/slider/application/live/re

Slider 0.92 release

2017-03-07 Thread Gour Saha
I am working on the next Slider release (version 0.92.0-incubating). Expecting to be done end-to-end by end of next week. https://issues.apache.org/jira/browse/SLIDER-1175 -Gour

Re: AM log file retention

2017-03-09 Thread Gour Saha
Which version of hadoop are you using? -Gour > On Mar 9, 2017, at 12:46 PM, David.Serafini wrote: > > I'm testing Slider 0.91. > The log files for the AM container disappear after a day or so (according to > the YARN UI), even though the application is still running the the AM > container is

[VOTE] Apache Slider (incubating) release 0.92.0-incubating-RC0

2017-03-09 Thread Gour Saha
Hello, This is a call for a vote on the Apache Slider (incubating) release 0.92.0-incubating-RC0 Source artifacts: https://dist.apache.org/repos/dist/release/incubator/slider/0.92.0-incubating-RC0 Staged artifacts: https://repository.apache.org/content/repositories/orgapacheslider-1017/ G

Re: [VOTE] Apache Slider (incubating) release 0.92.0-incubating-RC0

2017-03-10 Thread Gour Saha
/KEYS. There >are >instructions at the top of the file. > >I will continue reviewing RC0. > >On Thu, Mar 9, 2017 at 11:16 PM, Gour Saha wrote: > >> Hello, >> >> This is a call for a vote on the Apache Slider (incubating) release >> 0.92.0-incubatin

Re: [VOTE] Apache Slider (incubating) release 0.92.0-incubating-RC0

2017-03-10 Thread Gour Saha
Apologies, fixing the broken link of the source artifacts this time - https://dist.apache.org/repos/dist/dev/incubator/slider/0.92.0-incubating-RC0 -Gour On 3/10/17, 10:53 AM, "Gour Saha" mailto:gs...@hortonworks.com>> wrote: All, Kindly note that the Source Artifacts ha

Re: [EXTERNAL] Re: AM log file retention

2017-03-13 Thread Gour Saha
Please provide some additional info - 1. Can you login to the AM container node and look under the container log dir and see if the logs files are there? 2. If you don¹t see the log files in step 1 above, can you run the below yarn cmd-line? Do you see the logs? yarn logs -applicationId 3. If

Re: [VOTE] Apache Slider (incubating) release 0.92.0-incubating-RC0

2017-03-13 Thread Gour Saha
>> > repeatUntilSuccess:1405->CommandTestBase.slider:288 » Slider >> > AMConfigPublishingIT.testCreate:130->CommandTestBase.slider:288 » >> > Slider Expec... >> > >> > Tests run: 76, Failures: 4, Errors: 3, Skipped: 1 >> > >> > I

Re: [EXTERNAL] Re: AM log file retention

2017-03-13 Thread Gour Saha
Sorry my bad. It is yarn.nodemanager.log.retain-seconds. Copy paste error. 2. You see that error because the version of hadoop you have does not show logs of a running app. 3. Are there any other apps which are in stopped state already? If yes, then can you run the yarn logs cmd on it? -Gour

Re: instance flex question

2017-03-13 Thread Gour Saha
minInstanceCount and maxInstanceCount in metainfo is used to define the absolute range of the no of running instances for a specific component of your application. It depends a lot on your application logic. For e.g. If your app has a master and there cannot be more than 1 running master at a given

[RESULT] [VOTE] Apache Slider (incubating) release 0.92.0-incubating-RC0

2017-03-15 Thread Gour Saha
Hello, Here are the results of the vote for releasing Apache Slider (incubating) release 0.92.0-incubating-RC0 +1 votes: 3 (3 binding) +0 votes: 0 (0 binding) -1 votes: 0 (0 binding) The vote has succeeded - an incubator vote will now be started. -Gour On 3/9/17, 11:16 PM, "Gour

[RESULT][VOTE] Apache Slider (incubating) release 0.92.0-incubating

2017-03-21 Thread Gour Saha
will now be completed. - gourksaha on behalf of the Apache Slider (incubating) team From: Gour Saha mailto:gs...@hortonworks.com>> Date: Wednesday, March 15, 2017 at 4:15 PM To: "gene...@incubator.apache.org<mailto:gene...@incubator.apache.org>" mailto:gene...@incubato

Re: slider-agent.out error msg

2017-03-23 Thread Gour Saha
That is not from the AM log. It is from the agent log. It will be hard to say what¹s causing the failure without some snippet of the AM log. Does your script/application emit any log of its own into any log file? Then I would look there too. -Gour On 3/23/17, 6:25 PM, "David.Serafini" wrote: >

[ANNOUNCE] Apache Slider (incubating) release 0.92.0-incubating

2017-03-23 Thread Gour Saha
The Apache Slider team is proud to announce Apache Slider incubation release version 0.92.0-incubating Apache Slider (incubating) is a YARN application which deploys existing distributed applications on YARN, monitors them, and makes them larger or smaller as desired - even while the applicatio

Re: slider-agent.out error msg

2017-03-24 Thread Gour Saha
Ha, my bad. I forgot they are using 0.91. I looked at the latest code and assumed that the check was there. Yup, as Billie mentioned you need to make the below change to move forward or upgrade to Slider 0.92.0 which we shipped yesterday. -Gour On 3/24/17, 9:23 AM, "Billie Rinaldi" wrote: >I t

Re: [EXTERNAL] Re: specifying port explicitly

2017-04-04 Thread Gour Saha
If you have a fixed port say 12345 then hard-code it to 12345 instead of 0 or ALLOCATED_PORT. If you want a random port but within a range then additionally set the config property site.global.slider.allowed.ports in the global section of app config, as stated here - https://slider.incubator.apach

Re: Slider 0.92 version download - no binaries available ?

2017-04-10 Thread Gour Saha
https://repository.apache.org/content/groups/public/org/apache/slider/slide r-assembly/0.92.0-incubating/ On 4/10/17, 3:00 PM, "Manoj Samel" wrote: >Hi, > >For slider version 0.92, on the download side, I could only find sources. >I >could not find full assemblies (like version 0.80 etc.). > >T

Re: Slider 0.92 on CDH 5.5.1 (Hadoop 2.6) - AM log shows NPE at component heardbeat URI

2017-04-12 Thread Gour Saha
Manoj, Even if the metainfo change fixes your issue, please file a Slider JIRA and upload the logs. The logs are dropped in Apache DLs. -Gour On 4/12/17, 3:15 AM, "Chris T582" wrote: >I believe I've come across this error before. The problem was that the >metainfo.xml file in the application pa

Re: Podling Report Reminder - May 2017

2017-04-27 Thread Gour Saha
Here¹s a draft for May2017. Just a few changes on top of the Feb report on ³community developed since last report² and ³the last release². -- Slider Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. S

Re: Podling Report Reminder - May 2017

2017-05-01 Thread Gour Saha
draft looks good. On Thu, Apr 27, 2017 at 4:16 PM, Gour Saha mailto:gs...@hortonworks.com>> wrote: Here¹s a draft for May2017. Just a few changes on top of the Feb report on ³community developed since last report² and ³the last release². -- Slider Slider is a collection of tools and

Re: Podling Report Reminder - August 2017

2017-07-24 Thread Gour Saha
Any volunteers? On 7/23/17, 5:07 PM, "johndam...@apache.org" wrote: >Dear podling, > >This email was sent by an automated system on behalf of the Apache >Incubator PMC. It is an initial reminder to give you plenty of time to >prepare your quarterly board report. > >The board meeting is scheduled

Re: Podling Report Reminder - August 2017

2017-08-02 Thread Gour Saha
I think the confusion arose that, Slider did the June report so why August? On 8/2/17, 8:34 PM, "John D. Ament" wrote: >Did anyone step up? Surprised over the lack of report with the level of >activity on list. > >On 2017-07-24 19:47, Gour Saha wrote: >> Any volunte

Re: Sometimes slider commands time out in a secured cluster

2017-09-21 Thread Gour Saha
Are you able to go to the RM UI and load the ApplicationMaster web ui for this app? -Gour On 9/21/17, 11:00 AM, "Manoj Samel" wrote: >Any thoughts ? > >On Mon, Sep 18, 2017 at 3:22 PM, Manoj Samel >wrote: > >> >> CDH 5.5.1 cluster with Kerberos, slider version 0.80 >> >> Sometimes Slider comma

Re: Sometimes slider commands time out in a secured cluster

2017-09-21 Thread Gour Saha
anoj > >On Thu, Sep 21, 2017 at 11:26 AM, Gour Saha wrote: > >> Are you able to go to the RM UI and load the ApplicationMaster web ui >>for >> this app? >> >> -Gour >> >> On 9/21/17, 11:00 AM, "Manoj Samel" wrote: >> >>

Re: Podling Report Reminder - November 2017

2017-10-30 Thread Gour Saha
I will pick this up. -Gour On 10/29/17, 3:29 AM, "johndam...@apache.org" wrote: >Dear podling, > >This email was sent by an automated system on behalf of the Apache >Incubator PMC. It is an initial reminder to give you plenty of time to >prepare your quarterly board report. > >The board meeting

Re: Podling Report Reminder - November 2017

2017-10-30 Thread Gour Saha
This is the draft for Nov 2017. Please review. Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in th

Re: Ensure no more than one container for the same application is running in the same host

2017-12-01 Thread Gour Saha
Set yarn.component.placement.policy to 4 for the component in resources.json to get anti- affinity. -Gour - Sent from my iPhone On Dec 1, 2017, at 7:14 PM, Juan Rodr?guez Hortal? mailto:juan.rodriguez.hort...@gmail.com>> wrote: Hi, I'm new to slider, and I'm trying to run an application for

Re: Ensure no more than one container for the same application is running in the same host

2017-12-04 Thread Gour Saha
> >Thanks again, > >Juan > >On Mon, Dec 4, 2017 at 2:56 PM, Juan Rodríguez Hortalá < >juan.rodriguez.hort...@gmail.com> wrote: > >> Thanks a lot Gour! I'll do so. >> >> Greetings, >> >> Juan >> >> On Fri, Dec 1, 2017 at 11

Re: Docker on slider

2018-01-16 Thread Gour Saha
Docker support in Slider is tech preview only. You should start looking into Docker and long-running services support in YARN 3.x - https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn /hadoop-yarn-site/src/site/markdown/yarn-service/Overview.md First GA release is targeted

Re: Slider upgrade command error : org.apache.slider.core.persist.LockAcquireFailedException: Failed to acquire lock

2018-01-17 Thread Gour Saha
Manoj, By any chance is it possible to find out (maybe from logs or sar files) if there was HDFS unavailability (say NN node connection issue) around the time of 2018-01-06 00:33 (based on the readlock file timestamp)? -rw-r--r-- 3 xxx xxx 23 2018-01-06 00:33 hdfs://xxx/user/xxx/.slider/

Re: Slider upgrade command error : org.apache.slider.core.persist.LockAcquireFailedException: Failed to acquire lock

2018-01-17 Thread Gour Saha
this time > stamp. Apparently App Stop/Start did not delete this file. Can you >confirm > that behaviour ? Also would it make sense to have a enhancement to >delete > this file on App stop/start if indeed not being done ? > >Thanks, > >Manoj > >On Wed, Jan

Re: Podling Report Reminder - February 2018

2018-01-30 Thread Gour Saha
I will create a first draft for Feb. -Gour On 1/29/18, 8:20 PM, "johndam...@apache.org" wrote: >Dear podling, > >This email was sent by an automated system on behalf of the Apache >Incubator PMC. It is an initial reminder to give you plenty of time to >prepare your quarterly board report. > >Th

Re: Podling Report Reminder - February 2018

2018-02-05 Thread Gour Saha
This is the draft for Feb 2018. Please review. Slider is a collection of tools and technologies to package, deploy, and manage long running applications on Apache Hadoop YARN clusters. Slider has been incubating since 2014-04-29. Three most important issues to address in th

Re: Podling Report Reminder - February 2018

2018-02-06 Thread Gour Saha
I will be adding this to the report tomorrow morning. So please send in comments/edits by then. -Gour On 2/5/18, 4:17 PM, "Gour Saha" wrote: This is the draft for Feb 2018. Please review. Slider is a collection of tools and technologies

Re: Podling Report Reminder - February 2018

2018-02-12 Thread Gour Saha
On 2018/02/07 19:07:24, Billie Rinaldi wrote: > Thanks, Gour. I don't see any issues. > > On Tue, Feb 6, 2018 at 10:25 PM, Gour Saha wrote: > > > I will be adding this to the report tomorrow morning. So please send in > > comments/edits by then.

Re: Welcoming a new committer

2018-02-26 Thread Gour Saha
Congratulations Kyungwan! Your contribution to Slider is well appreciated. -Gour > On Feb 26, 2018, at 9:16 AM, Billie Rinaldi wrote: > > I'd like to welcome Kyungwan Nam, a new committer and PPMC member for > Apache Slider!

Re: slider report draft

2018-03-07 Thread Gour Saha
+1, looks good to me. -Gour On 3/7/18, 12:24 PM, "Billie Rinaldi" wrote: Please review this report draft for March 2018. It is due today. Slider Slider is a collection of tools and technologies to package, deploy, and manage long running appli

Re: slider 0.92 question

2018-04-03 Thread Gour Saha
Can you share the logs of the dying containers and the AM to debug further? -Gour On 4/3/18, 6:49 PM, "David.Serafini" wrote: I've been using slider 0.91 for a year and it's been very stable lately. I built 0.92 to test it and my yarn containers are dying after 10 minutes. Slider r

Re: [EXTERNAL] Re: slider 0.92 question

2018-04-03 Thread Gour Saha
og,/grid/7/hadoop/yarn/log,/grid/9/hadoop/yarn/log,/grid/0/hadoop/yarn/log,/grid/3/hadoop/yarn/log" last_health_report_time: 1522798707678] -Gour On 4/3/18, 10:49 PM, "David.Serafini" wrote: I've attached what I can find. On 4/3/18, 10:38 PM, Gour Saha

Re: May report draft

2018-05-02 Thread Gour Saha
+1 -Gour > On May 2, 2018, at 9:12 AM, Ted Yu wrote: > > +1 > > On Wed, May 2, 2018 at 8:27 AM, Billie Rinaldi > wrote: > >> Hi all, here is a draft of our report due today. If there are no objections >> / suggestions, I'll post this by the end of the day. >> >> Slider >> >> Slider is a co

Re: [VOTE] Retire Slider from incubation

2018-05-15 Thread Gour Saha
+1 On 5/15/18, 8:01 AM, "jonma...@gmail.com" wrote: +1 On Tue, May 15, 2018 at 10:56 AM, Billie Rinaldi wrote: > Since there has been no additional activity on the discussion thread, it is > time to call vote. Please vote on whether we should retire the Slider

Re: forking off releases/branch-0.60 to work with hadoop-2.6

2014-11-05 Thread Gour Saha
Steve, The changes for SLIDER-555 (AM log4j) has been merged into develop and releases/slider-0.60. -Gour On Wed, Nov 5, 2014 at 12:50 PM, Steve Loughran wrote: > FYI, there's going to be an RC of Hadoop 2.6 this weekend. To celebrate > this I'm creating a slider-0.60 release which will be in

Re: Maven repository?

2014-11-06 Thread Gour Saha
Until then, you should be able to get away by checking out the git repo and run mvn install -DskipTests (to get it into your .m2) and then use this (for develop) - org.apache.slider slider-core 0.61-incubating -Gour On Thu, Nov 6, 2014 at 6:51 AM, Billie Rin

Re: How to change log level for Slider AM?

2014-11-14 Thread Gour Saha
Under conf directory there is a file named *log4j-server.properties*. Just edit that file and change *log4j.rootLogger* from INFO to what you like. Then do slider stop and slider start. The new level for Slider AM will take effect. The *slider.log* file is rotated as well on a 100KB size threshold

Re: [VOTE] Apache Slider Incubating Release 0.60.0-incubating RC1

2014-11-15 Thread Gour Saha
+ 1 - successfully downloaded tarball - verified md5, sha signatures - followed the steps in the "Getting Started" guide http://slider.incubator.apache.org/docs/getting_started.html and successfully did all the following * built slider package - mvn clean site:site site:stage package -DskipTests

Re: Application configuration page is outdated?

2014-11-18 Thread Gour Saha
Given you moved to 0.60 it would be a good idea to start with the default file in this branch - ./app-packages/hbase/appConfig-default.json The site documentation is getting updated as we speak. -Gour On Tue, Nov 18, 2014 at 2:14 PM, hsy...@gmail.com wrote: > I just figure out: > > config_type

Re: how to get get the port of memcached

2014-12-10 Thread Gour Saha
What do you get when you call "slider status "? -Gour On Wed, Dec 10, 2014 at 1:02 AM, 杨浩 wrote: > Hi, I have installed the jmemcached successfully, but how can I use it, or > how to get the port of memcached > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the indi

Re: how to get get the port of memcached

2014-12-15 Thread Gour Saha
t;0", > "role.actual.instances" : "1", > "yarn.component.instances" : "1", > "role.releasing.instances" : "0", > "role.failed.instances" : "0" > }, > "slider-appmaster&

Re: how to get get the port of memcached

2014-12-22 Thread Gour Saha
gt; "+applicationName+" --state RUNNING",but arguing with my boss, we think > it's an ugly way to be used in production env. > > Can we get the am host:port through Java API > > 2014-12-16 9:07 GMT+08:00 Gour Saha : > > > Once the app is up and runnin

Re: how to get get the port of memcached

2014-12-22 Thread Gour Saha
of > slider shell command > > 2014-12-23 14:22 GMT+08:00 Gour Saha : > > > Do you mean REST API? > > > > Significant work is going on in exposing REST API in slider for the next > > major release. We still don't know the best way to expose a REST API to >

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Gour Saha
Try setting property *yarn.component.placement.policy* to 2 for the component, something like this - "HBASE_MASTER": { "yarn.role.priority": "1", "yarn.component.instances": "1", "yarn.memory": "1500", "yarn.component.placement.policy": "2" }, -Gour On Tue, Jan 6,

Re: rm-ing the surplus slider-agent.tar.gz from the slider tar file

2015-01-06 Thread Gour Saha
+1 for getting rid of the /agent one On Tue, Jan 6, 2015 at 9:23 AM, Sumit Mohanty wrote: > Yes, the /agent one can be removed. > > On Tue, Jan 6, 2015 at 7:26 AM, Jon Maron wrote: > > > > > On Jan 6, 2015, at 9:54 AM, Steve Loughran > wrote: > > > > > https://issues.apache.org/jira/browse/SLI

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Gour Saha
> > > >*/ > > > > public static final int NO_DATA_LOCALITY = 2; > > > > On Tue, Jan 6, 2015 at 4:15 PM, Gour Saha wrote: > > > > > Try setting property *yarn.component.placement.policy* to 2 for the > > > comp

Re: Locality results in instance shut-down due to single bad instance

2015-01-08 Thread Gour Saha
location-preferred, default, how best to react to a >> launch failure? Completely cut that node off the list of suitable targets? >> Or try again a few more times? If its a transient problem, retry gives >> locality without over-reacting. If its a permanent problem, then retrying &

Planning Slider Release 0.70 - early Feb

2015-01-20 Thread Gour Saha
Folks, I am planning to cut a 0.70 release for Slider by early Feb. The code freeze date is set at Jan 31st. If there are any specific JIRAs that needs to get into the 0.70 release please set Fix Version to "Slider 0.70" and reply back to this dev group. -Gour -- CONFIDENTIALITY NOTICE NOTICE:

Re: updating the release process; what to do about branches

2015-01-28 Thread Gour Saha
The most common use I have seen for the master branch, is to signify that it contains the most recent release of the product. The individual release branches would still be there, like releases/slider-0.60, releases/slider-0.70, etc. But for anyone who would just need the latest release would not h

A new branch created

2015-02-03 Thread Gour Saha
Just FYI.. A new branch releases/slider-0.61.0-incubating has been created corresponding to the tag slider-0.61.0-incubating. -Gour

Re: [VOTE] Move Slider to JDK7+

2015-02-20 Thread Gour Saha
+1 On 2/20/15, 2:00 PM, "Sumit Mohanty" wrote: >Given that Java 6 is no longer supported (even Java 7 will not be >supported >after Spring 2015) and Hadoop 2.7+ is JDK7+, we should have Slider move to >JDK7+. > >This is a call to vote to have Slider move to JDK7+ after the upcoming >0.70 >releas

Re: Intermittent issues accessing zookeeper

2015-02-25 Thread Gour Saha
Can you check the zk logs at /var/log/zookeeper/zookeeper.out and see if you find something? Also, see if you can use the zkCli.sh client to query in a loop for few minutes (with few secs of interval between queries) and see if you get similar intermittent connection issues? -Gour On 2/25/15, 6:

Re: Intermittent issues accessing zookeeper

2015-02-25 Thread Gour Saha
Yup, those logs are normal. Are all your 3 nodes healthy? Not sure what could be causing it. On 2/25/15, 7:28 AM, "Jon Maron" wrote: > >> On Feb 25, 2015, at 10:16 AM, Gour Saha wrote: >> >> Can you check the zk logs at /var/log/zookeeper/zookeeper.out and see

[VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-06 Thread Gour Saha
Hello, This is a call for a vote on Apache Slider Incubating 0.70.0-incubating release. This is a source+binary release. The issues fixed in this release are listed at at: https://issues.apache.org/jira/browse/SLIDER/fixforversion/12327847 (or the shortened URL http://s.apache.org/AnM) Artifa

Re: [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-09 Thread Gour Saha
sed the time window. > I'm sorry about that Gour. > > Might we be able to extend the voting window through tmrw evening? > > Gour Saha wrote: >> Hello, >> >> This is a call for a vote on Apache Slider Incubating 0.70.0-incubating >> release. >> &g

Re: [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-09 Thread Gour Saha
resolved > >One note, make sure that the source tag identifier/URL provided to IPMC >is the SHA1 and not a logical name (as that isn't guaranteed unique). > >Gour Saha wrote: >> Hello, >> >> This is a call for a vote on Apache Slider Incubating 0.70.0-incubatin

[RESULTS] [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-11 Thread Gour Saha
The vote passes with 6 +1 votes 杨浩 (yangha...@gmail.com) +1 Steve Loughran +1 (binding) Jon Maron +1 Josh Elser +1 Ted Yu +1 Gour Saha +1 Mail Thread: http://mail-archives.apache.org/mod_mbox/incubator-slider

Re: [RESULTS] [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-11 Thread Gour Saha
Sorry for the broken mail thread link - http://mail-archives.apache.org/mod_mbox/incubator-slider-dev/201503.mbox/%3cd11fbaf8.a971%25gs...@hortonworks.com%3E -Gour On 3/11/15, 11:04 AM, "Gour Saha" mailto:gs...@hortonworks.com>> wrote: The vote passes with 6 +1 votes 杨浩 (yan

[VOTE] Release Apache Slider 0.70.0-incubating

2015-03-11 Thread Gour Saha
Hello, This is a call for a vote for releasing Apache Slider 0.70.0-incubating. This is a source+binary release with one .tar file (appdef_1.tar), which is a text file used for -ve testing. Summary of fixes: http://s.apache.org/AnM Vote thread: http://s.apache.org/YQx Results: http://s.apache.o

[VOTE] Apache Slider Incubating Release 0.70.1-incubating

2015-03-16 Thread Gour Saha
Hello, This is a call for a vote on Apache Slider 0.70.1-incubating release. This is a source+binary release. The following 2 issues were identified in release 0.70.0-incubating and have been fixed in this release. https://issues.apache.org/jira/browse/SLIDER-815 https://issues.apache.org/jira/b

[RESULT] [VOTE] Apache Slider Incubating Release 0.70.1-incubating

2015-03-23 Thread Gour Saha
The vote passes with 4 +1 votes Steve Loughran +1 (binding) Josh Elser+1 Ted Yu +1 Gour Saha +1 Mail Thread: http://mail-archives.apache.org/mod_mbox/incubator-slider-dev/201503.mbox/%3CD12CAA07.AEB5%25gsaha%40hortonworks.com%3E -Gour

[VOTE] Release Apache Slider 0.70.1-incubating

2015-03-23 Thread Gour Saha
Hello, This is a call for a vote for releasing Apache Slider 0.70.1-incubating. This is a source+binary release with one .tar file (appdef_1.tar), which is a text file used for -ve testing. The following 2 issues were identified in release 0.70.0-incubating and have been fixed in this release

Re: quick note about slider release

2015-03-24 Thread Gour Saha
Hi Ted, Thank you for bringing this up. I will work with the team to incorporate your suggestion. -Gour From: Ted Dunning mailto:ted.dunn...@gmail.com>> Date: Tuesday, March 24, 2015 at 9:44 AM To: Gour Saha mailto:gs...@hortonworks.com>> Subject: quick note about slider release

[RESULT] [VOTE] Release Apache Slider 0.70.1-incubating

2015-03-27 Thread Gour Saha
The VOTE passes with 3, +1 binding votes from IPMC and no -1s. Jean-Baptiste Onofré+1 (binding) Billie Rinaldi +1 (binding) Steve Loughran +1 (binding) Thanks to everyone for the votes. Next Steps: Push the release out to the mirrors and announce. -Gour From: Gour Saha

[ANNOUNCE] Apache Slider 0.70.1-incubating release

2015-03-30 Thread Gour Saha
The Apache Slider team is proud to announce Apache Slider incubation release version 0.70.1-incubating. Apache Slider (incubating) is a YARN application which deploys existing distributed applications on YARN, monitors them, and makes them larger or smaller as desired - even while the applicati

Re: [ANNOUNCE] Apache Slider 0.70.1-incubating release

2015-03-30 Thread Gour Saha
went out now, so it's there's not much to do now, but we do need to make sure this doesn't keep happening. Gour Saha wrote: The Apache Slider team is proud to announce Apache Slider incubation release version 0.70.1-incubating. Apache Slider (incubating) is a YARN application

Re: [ANNOUNCE] Apache Slider 0.70.1-incubating release

2015-03-31 Thread Gour Saha
g project disclaimer. I >> forgot to add it myself on 0.60 :). Did you happen to copy this text >> from somewhere in our docs that did not include the disclaimer as well? >> I had thought I updated the site to include the necessary disclaimer. >> >> It already w

Re: Slider-develop - Build # 609 - Failure

2015-04-01 Thread Gour Saha
Looking into this. Filed - https://issues.apache.org/jira/browse/SLIDER-837 On 4/1/15, 2:49 PM, "Apache Jenkins Server" wrote: >The Apache Jenkins build system has built Slider-develop (build #609) > >Status: Failure > >Check console output at https://builds.apache.org/job/Slider-develop/609/ >t

Re: Finding the host having Slider client

2015-04-03 Thread Gour Saha
Try this URI - http://:8080/api/v1/clusters//host_components?Ho stRoles/component_name=SLIDER Replace the ambari_host and cluster_name -Gour On 4/3/15, 8:24 AM, "Sumit Mohanty" wrote: >Just forwarded an email to the mailing list where Ambari folks replied to >a >similar question. > >On Fri, A

Re: Finding the host having Slider client

2015-04-05 Thread Gour Saha
ommand line (shell), can you please tell me how... > >Kishore > >On Sat, Apr 4, 2015 at 12:38 AM, Gour Saha wrote: > >> Try this URI - >> http:// >> :8080/api/v1/clusters//host_components?Ho >> stRoles/component_name=SLIDER >> >> >> Repl

Re: Need help in starting storm on yarn using slider

2015-04-07 Thread Gour Saha
Can you take a screenshot of your RM UI and send it over? It is usually available in a URI similar to http://c6410.ambari.apache.org:8088/cluster. I am specifically interested in seeing the Cluster Metrics table. -Gour On 4/7/15, 10:17 AM, "Jon Maron" wrote: > >> On Apr 7, 2015, at 1:14 PM, Jon

Re: Need help in starting storm on yarn using slider

2015-04-07 Thread Gour Saha
70does not have any log files. > > Can you login to the cluster node and look at the logs directory (e.g. in HDP > install it would be under /hadoop/yarn/logs IIRC)? > > > > @Gour, Please find the attachment. > > On Tue, Apr 7, 2015 at 10:57 PM, Gour Saha > mail

Re: Need help in starting storm on yarn using slider

2015-04-07 Thread Gour Saha
;: "2048" > >}, > >"STORM_UI_SERVER": { > > "yarn.role.priority": "2", > > "yarn.component.instances": "1", > > "yarn.memory": "1278" > >}, > >"DRP

Re: Need help in starting storm on yarn using slider

2015-04-07 Thread Gour Saha
ram ><http://zs-exp-01.nm.flipkart.com:8088/proxy/application_1427882795362_007 >0/slideram> > >On Wed, Apr 8, 2015 at 1:05 AM, Gour Saha wrote: > >> Sorry forgot that the AM link not working was the original issue. >> >> Few more things - >> - Seems like you

Re: Need help in starting storm on yarn using slider

2015-04-07 Thread Gour Saha
This is not a secured cluster. >And yes, I used 'hdfs' user while running slider create. > >On Wed, Apr 8, 2015 at 2:03 AM, Gour Saha wrote: > >> Which user are you running the slider create command as? Seems like you >> are running as hdfs user. Is this a secure

Re: Need help in starting storm on yarn using slider

2015-04-08 Thread Gour Saha
er, but it remains in same state. > AM link not working, and AM logs are similar. > > On Wed, Apr 8, 2015 at 2:14 AM, Gour Saha wrote: > >> In a non-secured cluster you should run as yarn. Can you do that and let >> us know how it goes? >> >> Also you can sto

Re: Need help in starting storm on yarn using slider

2015-04-08 Thread Gour Saha
>2015-04-08 21:40:32,308 [main] INFO util.ExitUtil - Exiting with status >69 > > >On Wed, Apr 8, 2015 at 7:14 PM, Jon Maron wrote: > >> Indications seem to be that the AM is started but the AM URI you’re >> attempting to attach to may be mistaken or there may be somethin

Re: Need help in starting storm on yarn using slider

2015-04-09 Thread Gour Saha
You don¹t need to do su . There is an option --user which you can provide on the command line. storm-slider script is a wrapper on top of slider command line. It has a syntax mapping issue. You can use slider command line directly to do the same and much much more. For e.g. Running this fetches yo

Re: Need help in starting storm on yarn using slider

2015-04-09 Thread Gour Saha
Awesome. Happy to get you up and running. So I presume you were able to get the JSON dump for the quicklinks command line. This is what I get in my local vm. { "org.apache.slider.jmx" : "http://c6410.ambari.apache.org:56329/api/v1/cluster/summary";, "org.apache.slider.metrics" : "http://c6410

Re: Invalid port 0 for storm instances

2015-04-11 Thread Gour Saha
There were no issues. The variable was renamed to be more user friendly. -Gour On 4/10/15, 3:48 PM, "Nitin Aggarwal" wrote: >My mistake, we are running slider version 0.50. I believe these configs >were changed in 0.60 version. >Also, were there any issues around port allocation that could fix

Re: Doubts on stop/destroy the application instance

2015-04-27 Thread Gour Saha
Calling ³slider stop² before ³slider destroy² is the right order. On calling stop, your storm cluster should be completely stopped (including Slider AM and all storm components). Can you run this command after stop and send the output (don¹t run destroy yet)? slider list --containers Also, at

Re: Doubts on stop/destroy the application instance

2015-04-27 Thread Gour Saha
running. > >But, when I login to that machine, I could see storm components are still >running there (ps -ef | grep storm). The processes are up. Even Storm UI >is >still accessible. > > > >On Tue, Apr 28, 2015 at 12:29 AM, Gour Saha wrote: > >> Calling ³slider s

Re: Doubts on stop/destroy the application instance

2015-04-27 Thread Gour Saha
n_1428575950531_0013 > >2015-04-28 01:14:26,108 [main] INFO util.ExitUtil - Exiting with status 0 > >On Tue, Apr 28, 2015 at 1:01 AM, Gour Saha wrote: > >> Sorry, forgot that --containers is supported in develop branch only. >>Just >> run list without that option. >

Re: Doubts on stop/destroy the application instance

2015-04-27 Thread Gour Saha
cessible. >> >> 3) slider start storm1 (RM UI was less responsive during this time) >> --- it started another sliderAM and other set of storm components and >> slider agents also. And able to access storm UI in another host. >> >> So now, actually two storm cluster is

Re: Doubts on stop/destroy the application instance

2015-04-27 Thread Gour Saha
>from >both application_1428575950531_0013 and application_1428575950531_0014 >running? > ---> yes both are running and able to access both storm UI's also. >(only >SliderAM was stopped) > >On Tue, Apr 28, 2015 at 1:54 AM, Gour Saha wrote: > >> Yes, those

Re: Doubts on stop/destroy the application instance

2015-04-28 Thread Gour Saha
Can you send us the complete-config dump? -Gour On 4/28/15, 2:45 AM, "Chackravarthy Esakkimuthu" wrote: >yes this is the config taken by slider also. > >http://host2:8088/proxy/application_1428575950531_0016/ws/v1/slider/publis >her/slider/complete-config > >yarn.nodemanager.sleep-delay-before-

Re: Doubts on stop/destroy the application instance

2015-04-29 Thread Gour Saha
, "Gour Saha" wrote: >Can you send us the complete-config dump? > >-Gour > >On 4/28/15, 2:45 AM, "Chackravarthy Esakkimuthu" >wrote: > >>yes this is the config taken by slider also. >> >>http://host2:8088/proxy/application_14285759505

Re: Doubts on stop/destroy the application instance

2015-04-29 Thread Gour Saha
the nodes in your cluster? -Gour On 4/29/15, 10:49 AM, "Chackravarthy Esakkimuthu" wrote: >sure Gour, Thanks for helping out. >Do you also see these kind of issues? Is it reproducible for you as well? > >On Wed, Apr 29, 2015 at 8:58 PM, Gour Saha wrote: > >> T

  1   2   3   4   5   6   7   8   9   10   >