Re: [EXTERNAL] Re: slider 0.92 question

2018-04-22 Thread Manoj Samel
David, When local disks on the host running node manager are more than 90% full, nodemanager gives message like "10/12 local-dirs are bad:". In such cases, the node manager service keeps running but is not servicing any applications. Check if the host had multiple disk more than 90% full. Hope

Agent log shows connection refused error : hostname shows container name

2018-03-02 Thread Manoj Samel
Hello, Slider version 0.80 with CDH 5.5.1 Investigating a instance where Slider application errored out. slider.agent.log for many components show following trace - noticed that the "hostname" key is actually the container name e.g. "hostname":

Re: Slider upgrade command error : org.apache.slider.core.persist.LockAcquireFailedException: Failed to acquire lock

2018-01-17 Thread Manoj Samel
33 > hdfs://xxx/user/xxx/.slider/cluster/spas/readlock > > > -Gour > > On 1/17/18, 1:05 PM, "Manoj Samel" <manojsamelt...@gmail.com> wrote: > > >Hello, > > > >Slider version 0.80 on CDH 5.5.1 cluster with kerberos > > > >Slider upgrad

Slider upgrade command error : org.apache.slider.core.persist.LockAcquireFailedException: Failed to acquire lock

2018-01-17 Thread Manoj Samel
Hello, Slider version 0.80 on CDH 5.5.1 cluster with kerberos Slider upgrade --template /xxx/appConfig.json --resources /xxx/resources.json --queue tenant --force failed with following trace 2018-01-17 20:31:23,030 [main] INFO tools.SliderUtils - JVM initialized into secure mode with kerberos

Re: Sometimes slider commands time out in a secured cluster

2017-09-22 Thread Manoj Samel
accessible when the CLI fails. Seems like your > issue is intermittent. RPC timeout for CLIs are set to 15 secs, so there > could be several reasons for which the timeout occurs. Do you see any > network/routing issue to connect to the host where the AM is running? > > -Gour > >

Re: Sometimes slider commands time out in a secured cluster

2017-09-21 Thread Manoj Samel
Any thoughts ? On Mon, Sep 18, 2017 at 3:22 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > > CDH 5.5.1 cluster with Kerberos, slider version 0.80 > > Sometimes Slider commands start hanging > > slider list --containers > > [r...@s-76zyl02.sys.az1.e

Sometimes slider commands time out in a secured cluster

2017-09-18 Thread Manoj Samel
CDH 5.5.1 cluster with Kerberos, slider version 0.80 Sometimes Slider commands start hanging slider list --containers [r...@s-76zyl02.sys.az1.eng.pdx.wd ~]# slider list spas --containers 2017-09-18 21:44:45,659 [main] INFO tools.SliderUtils - JVM initialized into secure mode with kerberos

[jira] [Created] (SLIDER-1227) Component name with 3 "_" gives NPE in 0.92, is working in 0.80

2017-05-10 Thread Manoj Samel (JIRA)
Manoj Samel created SLIDER-1227: --- Summary: Component name with 3 "_" gives NPE in 0.92, is working in 0.80 Key: SLIDER-1227 URL: https://issues.apache.org/jira/browse/SLIDER-1227 Proje

Re: Slider 0.92 on CDH 5.5.1 (Hadoop 2.6) - AM log shows NPE at component heardbeat URI

2017-05-09 Thread Manoj Samel
ld not be used in any role names; then slider 0.92 should give error when creating cluster or accepting configs during any other operations etc. saying invalid role name etc. etc. Thanks in advance, On Tue, Apr 11, 2017 at 6:09 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi > &g

slider 0.92 - After upgrade, existing component keeps showing "awaiting heartbeat..."

2017-05-09 Thread Manoj Samel
Slider 0.92 on secured hadoop 2.6 cluster Have a app with component "tenant1" running. Add another component "tenant2" and do a upgrade. After that, the original component keeps showing "awaiting heartbeat..." in the output of "slider list --containers" ... The component and AM log does not seem

Re: Slider 0.92 on CDH 5.5.1 (Hadoop 2.6) - AM log shows NPE at component heardbeat URI

2017-05-03 Thread Manoj Samel
il.com> wrote: > I believe I've come across this error before. The problem was that the > metainfo.xml file in the application package I was trying to deploy was > malformed / missing required tags. > > > On 12 April 2017 at 02:09, Manoj Samel <manojsamelt...@gmail.com> wro

Slider 0.92 on CDH 5.5.1 (Hadoop 2.6) - AM log shows NPE at component heardbeat URI

2017-04-11 Thread Manoj Samel
Hi Running slider 0.92 on CDH 5.5.1 (which is Hadoop 2.6), with Kerberos I am deploying a application with multiple components. The components start but fail to heart beat to slider AM. The slider AM log shows NPE at container heartbeat URLs as below. I have attached the complete slider AM log

Re: Slider 0.92 version download - no binaries available ?

2017-04-10 Thread Manoj Samel
assembly/0.92.0-incubating/ > > > On 4/10/17, 3:00 PM, "Manoj Samel" <manojsamelt...@gmail.com> wrote: > > >Hi, > > > >For slider version 0.92, on the download side, I could only find sources. > >I > >could not find full assemblies (like version 0.80 etc.). > > > >Thoughts? > > > >Thanks, > >

Re: Slider 0.92 version download - no binaries available ?

2017-04-10 Thread Manoj Samel
Thanks Gaur for prompt reply ! Manoj On Mon, Apr 10, 2017 at 5:32 PM, Gour Saha <gs...@hortonworks.com> wrote: > https://repository.apache.org/content/groups/public/org/ > apache/slider/slide > r-assembly/0.92.0-incubating/ > > > On 4/10/17, 3:00 PM, "Manoj Sam

Slider 0.92 version download - no binaries available ?

2017-04-10 Thread Manoj Samel
Hi, For slider version 0.92, on the download side, I could only find sources. I could not find full assemblies (like version 0.80 etc.). Thoughts? Thanks,

[jira] [Comment Edited] (SLIDER-1114) Provide option to run components as different user(s)

2017-03-09 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904142#comment-15904142 ] Manoj Samel edited comment on SLIDER-1114 at 3/10/17 12:33 AM: --- Last year I

[jira] [Commented] (SLIDER-1114) Provide option to run components as different user(s)

2017-03-09 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15904142#comment-15904142 ] Manoj Samel commented on SLIDER-1114: - Last year I had reported that the implementation

[jira] [Updated] (SLIDER-1114) Provide option to run components as different user(s)

2017-03-09 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1114: Attachment: run_components_as_different_users.pdf > Provide option to run components as differ

[jira] [Updated] (SLIDER-1114) Provide option to run components as different user(s)

2017-03-09 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1114: Attachment: (was: run_component_as_different_users.pdf) > Provide option to run compone

Re: First draft of Apache Slider November 2016 report

2016-11-02 Thread Manoj Samel
t quarter with all these > features and bug fixes.² > > -Gour > > On 11/2/16, 10:29 AM, "Manoj Samel" <manojsamelt...@gmail.com> wrote: > > >Hi Gour, > > > >As user of slider (in production), it would be great to have some idea on > >timeli

Re: First draft of Apache Slider November 2016 report

2016-11-02 Thread Manoj Samel
Hi Gour, As user of slider (in production), it would be great to have some idea on timelines so to plan to switch from "classic slider" to hadoop branch. Given that hadoop version of branch itself will be not be a stable / battle tested and that "slider classic" development is slowing down (for

Ballpark timeline for 1.0.0 release ?

2016-10-31 Thread Manoj Samel
Hello, I see many of the critical issues getting fixed in Slider 1.0.0 version. Can anyone comment if there is even a ballpark timeline for releasing 1.0.0 ? Thanks, Manoj

[jira] [Comment Edited] (SLIDER-1169) Slider not honoring zookeeper quorum values passed

2016-10-21 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595869#comment-15595869 ] Manoj Samel edited comment on SLIDER-1169 at 10/21/16 6:04 PM: --- Hi [~gsaha

[jira] [Commented] (SLIDER-1169) Slider not honoring zookeeper quorum values passed

2016-10-21 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595869#comment-15595869 ] Manoj Samel commented on SLIDER-1169: - Hi [~gsaha], I applied the patch to version 0.80 and it had

[jira] [Commented] (SLIDER-1169) Slider not honoring zookeeper quorum values passed

2016-09-30 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536520#comment-15536520 ] Manoj Samel commented on SLIDER-1169: - 1. Can this patch be applied to version 0.80 ? 2. In cases

Re: Slider fails when first zookeeper in registry quorum is down

2016-09-30 Thread Manoj Samel
Thanks Gour ! Any idea when 1.0.0 will be available ? On Fri, Sep 30, 2016 at 7:23 AM, Gour Saha <gs...@hortonworks.com> wrote: > I think you are hitting this - > https://issues.apache.org/jira/browse/SLIDER-1169 > > > On 9/29/16, 10:21 PM, "Manoj Samel" &

Slider fails when first zookeeper in registry quorum is down

2016-09-29 Thread Manoj Samel
Hi Slider version .80 on secure cluster. In my xxx-site.xml files, the hadoop.registry.zk.quorum zk1_host:2181,zk2_host:2181,zk3_host:2181 However, it appears slider AM uses only the first ZK to connect for registry - and fails when the first ZK happens to be down. In the

[jira] [Commented] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-08-04 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408171#comment-15408171 ] Manoj Samel commented on SLIDER-1158: - Hello, Can someone provide any further pointer ? Thanks

Re: Slider AM fails to run when RM in HA setup fails over

2016-08-01 Thread Manoj Samel
? Thanks in advance, Manoj On Thu, Jul 28, 2016 at 7:01 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi Gour, > > I added properties in /etc/hadoop/conf/yarn-site.xml and emptied the > /data/slider/conf/slider-client.xml and restarted both RMs. > >- h

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-29 Thread Manoj Samel
ng with status 0 foo RUNNING application_1469834604094_0001 http://xxx:23188/proxy/application_1469834604094_0001/ .. Thanks, On Thu, Jul 28, 2016 at 7:01 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi Gour, > > I added properties in /etc/hadoop/conf/yarn-site.xml

[jira] [Commented] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-29 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400111#comment-15400111 ] Manoj Samel commented on SLIDER-1158: - Hi [~jmaron] & [~gsaha], I have attached cluster ha

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-29 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Attachment: slider-1158.hadoop_conf.tar.gz > Slider AM hits er

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-28 Thread Manoj Samel
, On Thu, Jul 28, 2016 at 5:28 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Thanks. I will test with the updated config and then upload the latest > ones ... > > Thanks, > > Manoj > > On Thu, Jul 28, 2016 at 5:21 PM, Gour Saha <gs...@hortonworks.com>

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-28 Thread Manoj Samel
ate cmd. You can > also set on the command line using -D slider.yarn.queue=<> during the > create call. If indeed all slider apps should go to one and only one > queue, then this prop can be specified in any one of the existing site xml > files under /etc/hadoop/conf. > > -Gour

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-28 Thread Manoj Samel
. This probably gives an > indication that there might be some issue with cluster configuration based > on files solely under HADOOP_CONF_DIR to begin with. > > Suggest you to upload all the config files to the jira to help debug this > further. > > -Gour > > On 7/

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-28 Thread Manoj Samel
will be read from HADOOP_CONF_DIR files. Let me know if this could cause any issues. On Thu, Jul 28, 2016 at 3:36 PM, Gour Saha <gs...@hortonworks.com> wrote: > No need to copy any files. Pointing HADOOP_CONF_DIR to /etc/hadoop/conf is > good. > > -Gour > > On 7/28/16, 3:24

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-28 Thread Manoj Samel
, Manoj On Tue, Jul 26, 2016 at 3:27 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Filed https://issues.apache.org/jira/browse/SLIDER-1158 with logs and my > analysis of logs. > > On Tue, Jul 26, 2016 at 10:36 AM, Gour Saha <gs...@hortonworks.com> wrote: > >> Pleas

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-27 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Attachment: SUCCESS_slider.log SUCCESS_rm1.log.gz > Slider AM hits er

[jira] [Commented] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-27 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396727#comment-15396727 ] Manoj Samel commented on SLIDER-1158: - Hi Jon, 1. Just to clarify, our hadoop version is 2.6. 2. I

[jira] [Commented] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-27 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395892#comment-15395892 ] Manoj Samel commented on SLIDER-1158: - Also, other applications on this cluster e.g. Oozie & S

[jira] [Commented] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-27 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395889#comment-15395889 ] Manoj Samel commented on SLIDER-1158: - We are running CDH 5.5.1, which is Hadoop 2.6 > Slider

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-26 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Description: In certain cases, when a RM fails over from RM1 to RM2, the Slider AM starts getting

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-26 Thread Manoj Samel
Filed https://issues.apache.org/jira/browse/SLIDER-1158 with logs and my analysis of logs. On Tue, Jul 26, 2016 at 10:36 AM, Gour Saha <gs...@hortonworks.com> wrote: > Please file a JIRA and upload the logs to it. > > On 7/26/16, 10:21 AM, "Manoj Samel" <manojsamelt.

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-26 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Description: In certain cases, when a RM fails over from RM1 RM2, the Slider AM starts getting

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-26 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Attachment: slider.log rm2.log README_INFO_ANALYSIS > Slider

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-26 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Description: In certain cases, when a RM fails over from RM1 RM2, the Slider AM starts getting

[jira] [Updated] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-26 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1158: Description: In certain cases, when a RM fails over from RM1 RM2, the Slider AM starts getting

[jira] [Created] (SLIDER-1158) Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA

2016-07-26 Thread Manoj Samel (JIRA)
Manoj Samel created SLIDER-1158: --- Summary: Slider AM hits error org.apache.hadoop.security.AccessControlException: Client cannot authenticate via:[TOKEN] when RM failover happens in RM HA Key: SLIDER-1158 URL

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-26 Thread Manoj Samel
Now coming to the 2 issues you are facing, you have to provide additional > logs for us to understand better. Let¹s start with - > 1. RM logs (specifically between the time when rm1->rm2 failover is > simulated) > 2. Slider App logs > > -Gour > > On 7/25/16, 5:16 PM,

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-25 Thread Manoj Samel
F_DIR to /tmp/hadoop_conf and clear everything out from > slider-client.xml. > > On 7/25/16, 4:12 PM, "Manoj Samel" <manojsamelt...@gmail.com> wrote: > > >Hi Gour, > > > >Thanks for your prompt reply. > > > >FYI, issue happens when I create slid

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-25 Thread Manoj Samel
s, do you > see the same behaviors? > > -Gour > > On 7/25/16, 2:28 PM, "Manoj Samel" <manojsamelt...@gmail.com> wrote: > > >Another observation (whatever it is worth) > > > >If slider app is created and started when rm2 was active, then it seems to &g

What RM properties are must in slider-client.xml, if present in files in HADOOP_CONF_DIR ?

2016-07-25 Thread Manoj Samel
Hello, Slider version is 0.80, Hadoop is 2.6 with Kerberos Slider-client.xml allows specification of full path of hadoop conf using HADOOP_CONF_DIR. In our case, full hadoop configuration, including all HA configurations are available in the HADOOP_CONF_DIR for hdfs-site, core-site and

Re: Slider AM fails to run when RM in HA setup fails over

2016-07-25 Thread Manoj Samel
again. Slider AM still keeps running So, it seems if it starts with rm1 active, then the AM goes to "ACCEPTED" state when RM fails to rm2. If it starts with rm2 active, then it runs fine with any switches between rm1 and rm2. Any feedback ? Thanks, Manoj On Mon, Jul 25, 2016 at 12:25

Slider AM fails to run when RM in HA setup fails over

2016-07-25 Thread Manoj Samel
Setup - Hadoop 2.6 with RM HA, Kerberos enabled - Slider 0.80 - In my slider-client.xml, I have added all RM HA properties, including the ones mentioned in http://markmail.org/message/wnhpp2zn6ixo65e3. Following is the issue * rm1 is active, rm2 is standby * deploy and start slider application,

[jira] [Updated] (SLIDER-1151) Don't log Invalid port range values when there are no invalid ports specified

2016-07-07 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1151: Attachment: SLIDER-1151.1.patch > Don't log Invalid port range values when there are no inva

[jira] [Updated] (SLIDER-1151) Don't log Invalid port range values when there are no invalid ports specified

2016-07-07 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1151: Attachment: (was: check_empty.patch) > Don't log Invalid port range values w

[jira] [Commented] (SLIDER-1151) Don't log Invalid port range values when there are no invalid ports specified

2016-07-07 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15366824#comment-15366824 ] Manoj Samel commented on SLIDER-1151: - [~gsaha], patch attached > Don't log Invalid port ra

[jira] [Updated] (SLIDER-1151) Don't log Invalid port range values when there are no invalid ports specified

2016-07-07 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1151: Attachment: check_empty.patch > Don't log Invalid port range values when there are no inva

[jira] [Created] (SLIDER-1151) Don't log Invalid port range values when there are no invalid ports specified

2016-07-06 Thread Manoj Samel (JIRA)
Manoj Samel created SLIDER-1151: --- Summary: Don't log Invalid port range values when there are no invalid ports specified Key: SLIDER-1151 URL: https://issues.apache.org/jira/browse/SLIDER-1151 Project

[jira] [Updated] (SLIDER-1114) Provide option to run components as different user(s)

2016-06-23 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1114: Attachment: (was: run_components_as_different_users.pdf) > Provide option to run compone

[jira] [Updated] (SLIDER-1114) Provide option to run components as different user(s)

2016-06-23 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1114: Attachment: run_component_as_different_users.pdf > Provide option to run components as differ

Need help on SLIDER-1114 - Run each component as different user

2016-06-15 Thread Manoj Samel
Hello, https://issues.apache.org/jira/browse/SLIDER-1114 Trying to implement a new feature where each component of a application is run as different linux user. I have so far implemented a way to start each component as different user and accurately keep track status of each component. The

[jira] [Commented] (SLIDER-1114) Provide option to run components as different user(s)

2016-06-13 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328475#comment-15328475 ] Manoj Samel commented on SLIDER-1114: - Hi, I attached a small document describing

[jira] [Updated] (SLIDER-1114) Provide option to run components as different user(s)

2016-06-13 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1114: Attachment: run_components_as_different_users.pdf > Provide option to run components as differ

[jira] [Commented] (SLIDER-875) Ability to create an Uber application package with capability to deploy and manage as a single business app

2016-06-13 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328342#comment-15328342 ] Manoj Samel commented on SLIDER-875: Hi [~gsaha], any ballpark timelines when we could see https

[jira] [Commented] (SLIDER-875) Ability to create an Uber application package with capability to deploy and manage as a single business app

2016-06-13 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328301#comment-15328301 ] Manoj Samel commented on SLIDER-875: This would be a great feature to have. One point to observe

[jira] [Created] (SLIDER-1137) Option to define port range per component & limit it to components only

2016-06-04 Thread Manoj Samel (JIRA)
Manoj Samel created SLIDER-1137: --- Summary: Option to define port range per component & limit it to components only Key: SLIDER-1137 URL: https://issues.apache.org/jira/browse/SLIDER-1137 Pro

Re: allowed.ports - Different use cases ...

2016-06-04 Thread Manoj Samel
e > elements that actually get assigned ports from the specified ranges. > > > On Jun 1, 2016, at 12:15 PM, Manoj Samel <manojsamelt...@gmail.com> > wrote: > > > > Any thoughts ? > > > > On Wed, May 25, 2016 at 11:27 AM, Manoj Samel <manojsamel

Re: allowed.ports - Different use cases ...

2016-06-01 Thread Manoj Samel
Any thoughts ? On Wed, May 25, 2016 at 11:27 AM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi, > > At present the allowed.ports is applied to AM as well as containers > > While this may be a valid use case for certain deployments, there are > other use cases &

Question on {PER_CONTAINER} flag

2016-05-25 Thread Manoj Samel
Hello, Just wanted to confirm my understanding of PER_CONTAINER for allocated ports. Looking @ AgentProviderService.java - if (!value.contains(PER_CONTAINER_TAG)) { // If the config property is shared then pass on the already allocated value // from any container

allowed.ports - Different use cases ...

2016-05-25 Thread Manoj Samel
Hi, At present the allowed.ports is applied to AM as well as containers While this may be a valid use case for certain deployments, there are other use cases 1. The "allowed.ports" should be only applied to certain port(s) for components that are marked as {ALLOCATED_PORT}{PER_CONTAINER} etc..

[jira] [Commented] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception - add else part

2016-05-20 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15293722#comment-15293722 ] Manoj Samel commented on SLIDER-1124: - Thanks [~billie.rinaldi] for the fix > If unparsable p

[jira] [Updated] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception - add else part

2016-05-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1124: Summary: If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should

Re: What does PER_CONTAINER in port allocation does ? Facing AM start error ...

2016-05-19 Thread Manoj Samel
Filed https://issues.apache.org/jira/browse/SLIDER-1124 On Thu, May 19, 2016 at 7:18 AM, Billie Rinaldi <billie.rina...@gmail.com> wrote: > I agree, it would be good to throw an Exception if the format of the port > range is bad. > > On Wed, May 18, 2016 at 7:15 PM, Manoj

[jira] [Updated] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception

2016-05-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1124: Description: {noformat} The issue was discovered when a JSON was generated with IDE and instead

[jira] [Updated] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception

2016-05-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1124: Description: The issue was discovered when a JSON was generated with IDE and instead

[jira] [Updated] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception

2016-05-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1124: Description: The issue was discovered when a JSON was generated with IDE and instead

[jira] [Updated] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception

2016-05-19 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1124: Description: The issue was discovered when a JSON was generated with IDE and instead

[jira] [Created] (SLIDER-1124) If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception

2016-05-19 Thread Manoj Samel (JIRA)
Manoj Samel created SLIDER-1124: --- Summary: If unparsable port range is specified, Slider AM PortScanner.java setPortRange() should throw exception Key: SLIDER-1124 URL: https://issues.apache.org/jira/browse/SLIDER

Re: What does PER_CONTAINER in port allocation does ? Facing AM start error ...

2016-05-16 Thread Manoj Samel
nchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)

Re: What does PER_CONTAINER in port allocation does ? Facing AM start error ...

2016-05-16 Thread Manoj Samel
y utilized by > another application on the same box. > > Is your cluster idle or do you have other slider apps running? Do you have > more complete output of the logs and possibly the appConfig that you can > share? Are you sure it's the AM failing to start and not a service within

Re: Update : Run each component of application as different user working - except stop command

2016-05-04 Thread Manoj Samel
wrote: > Manoj Samel wrote: > >> 1. I have loggedhttps://issues.apache.org/jira/browse/SLIDER-1114 to >> describe the use case in detail as a new feature request. Josh - regarding >> your suggestion on launching each component as separate app; I have added

Update : Run each component of application as different user working - except stop command

2016-05-02 Thread Manoj Samel
d > process, like the system command would. Perhaps if you used the system > command in your C code, that would produce a different result. > > Billie > > On Fri, Apr 22, 2016 at 12:17 PM, Manoj Samel <manojsamelt...@gmail.com> > wrote: > > > Hello Again ! > &g

[jira] [Comment Edited] (SLIDER-1114) Provide option to run components as different user(s)

2016-04-29 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264752#comment-15264752 ] Manoj Samel edited comment on SLIDER-1114 at 4/29/16 9:11 PM: -- Capturing d

[jira] [Commented] (SLIDER-1114) Provide option to run components as different user(s)

2016-04-29 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264752#comment-15264752 ] Manoj Samel commented on SLIDER-1114: - Capturing d-list discussion for this topic here for future

[jira] [Updated] (SLIDER-1114) Provide option to launch components as different user(s)

2016-04-29 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Samel updated SLIDER-1114: Description: Environment is slider .80 on Hadoop 2.6 secured cluster A component is launched

[jira] [Commented] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2016-04-28 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262807#comment-15262807 ] Manoj Samel commented on YARN-4692: --- Hi [~kasha] and team, I would like to add another type of service

(2nd attempt) Need Help !: Run each component of application as different user

2016-04-22 Thread Manoj Samel
Thanks, Manoj ------ Forwarded message -- From: Manoj Samel <manojsamelt...@gmail.com> Date: Thu, Apr 21, 2016 at 2:40 PM Subject: Need Help !: Run each component of application as different user To: dev@slider.incubator.apache.org Hi, See use case background below I have implemente

[jira] [Created] (SLIDER-1114) Provide option to launch components as different user(s)

2016-04-21 Thread Manoj Samel (JIRA)
Manoj Samel created SLIDER-1114: --- Summary: Provide option to launch components as different user(s) Key: SLIDER-1114 URL: https://issues.apache.org/jira/browse/SLIDER-1114 Project: Slider

[jira] [Commented] (SLIDER-1063) duplicated port allocation when slider.allowed.ports is set

2016-04-21 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253002#comment-15253002 ] Manoj Samel commented on SLIDER-1063: - Any update on this issue ? > duplicated port allocation w

Re: Need Help !: Run each component of application as different user

2016-04-21 Thread Manoj Samel
h is "/bin/bash --login ..." and which launches a subprocess as specified in execute(). Can someone confirm this ? On Thu, Apr 21, 2016 at 2:40 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi, > > See use case background below > > I have implemented option 2

Need Help !: Run each component of application as different user

2016-04-21 Thread Manoj Samel
user "B") Any help in identifying why is the parent process dying ? Thanks in advance !! Manoj PS : Please ignore my last mail sent with same title few minutes back. I hit return by mistake when it was not complete :( On Fri, Apr 8, 2016 at 10:30 AM, Manoj Samel <manojsamelt...@g

Need help !: Run each component of application as different user

2016-04-21 Thread Manoj Samel
er to "B" and does a "exec" for the java component On Fri, Apr 8, 2016 at 10:30 AM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hello, > > Environment is slider .80 on Hadoop 2.6 secured cluster > > A component is launched for each distinct user o

Re: Run each component of application as different user

2016-04-11 Thread Manoj Samel
Any thoughts ? Feedback ? On Fri, Apr 8, 2016 at 10:30 AM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hello, > > Environment is slider .80 on Hadoop 2.6 secured cluster > > A component is launched for each distinct user of the service (via > upgrade). E.g. when use

Run each component of application as different user

2016-04-08 Thread Manoj Samel
Hello, Environment is slider .80 on Hadoop 2.6 secured cluster A component is launched for each distinct user of the service (via upgrade). E.g. when user A accesses service, do a "upgrade" and create a component for user A. When user B comes, create another component for user B etc. At

Re: slider 0.80 error on CDH 5.5.1 - "User is not based on a keytab in a secure deployment"

2016-02-10 Thread Manoj Samel
.1 ? 2. I had opened SLIDER-1067 for backport of slider fix to .82 release. Any idea when 0.82 will be available ? Thanks, On Wed, Feb 10, 2016 at 3:45 AM, Steve Loughran <ste...@hortonworks.com> wrote: > > > On 9 Feb 2016, at 01:54, Manoj Samel <manojsamelt...@gmail.com>

Re: slider 0.80 error on CDH 5.5.1 - "User is not based on a keytab in a secure deployment"

2016-02-09 Thread Manoj Samel
Any help on this will be appreciated !!! Thanks, Manoj On Mon, Feb 8, 2016 at 5:54 PM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi, > > Slider 0.80 running on CDH 5.5.1 secured cluster fails to create slider-AM > with error "User is not based on a keytab in a se

slider 0.80 error on CDH 5.5.1 - "User is not based on a keytab in a secure deployment"

2016-02-08 Thread Manoj Samel
Hi, Slider 0.80 running on CDH 5.5.1 secured cluster fails to create slider-AM with error "User is not based on a keytab in a secure deployment". 1) I had same slider version working without issue on CDH 5.4.2 without any issues. 2) I thought the issue was in slider 0.81 (

[jira] [Commented] (SLIDER-1066) Make AM restart during upgrade option - e.g. via a option to upgrade command

2016-01-22 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/SLIDER-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112756#comment-15112756 ] Manoj Samel commented on SLIDER-1066: - Curious how AM picks up new containers without restart during

Re: Valid characters in component name

2016-01-21 Thread Manoj Samel
Hello, Any update on this ? Should I file a Jira ? Thanks, On Tue, Jan 19, 2016 at 8:58 AM, Manoj Samel <manojsamelt...@gmail.com> wrote: > Hi Jon, > > Did you get a chance to try to reproduce the issue with component > containing a dash ? > > Thanks, > > Manoj

  1   2   3   >