Re: LIBPROCESS_IP

2018-05-18 Thread Jie Yu
Hendrik, It looks to me that Mesos always pass LIBPROCESS_IP to executor if agent's LIBPROCESS_IP environment variable is set: https://github.com/apache/mesos/blob/1.4.x/src/slave/slave.cpp#L8106-L8115 Maybe that's the difference between your vanilla Mesos, and DC/OS Mesos config? - Jie On Fri

LIBPROCESS_IP

2018-05-18 Thread Hendrik Haddorp
Hi, I had been using Mesos 1.4.1 and now tried out a DC/OS setup (1.9.4) and noticed that the env variable LIBPROCESS_IP was set. This broke my scheduler (running as a docker container on Marathon). Things worked fine again once I unset the variable in my startup script. I'm now wondering

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-08 Thread Eli Jordan
on. Always passing the LIBRPOCESS_IP into the > container. I’d argue that, by default, it should not carry the name of the > var over. It should be avaialble under another name but giving the user the > option to assign it to LIBPROCESS_IP inside of the container. > – > Best regar

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-07 Thread Radoslaw Gruchalski
option. Always passing the LIBRPOCESS_IP into the container. I’d argue that, by default, it should not carry the name of the var over. It should be avaialble under another name but giving the user the option to assign it to LIBPROCESS_IP inside of the container. – Best regards, Radek Gruchalski ra

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-07 Thread Tom Arnfeld
ok like any shell expansion happens long the way (for good reason, really) so we couldn’t find a way. Given that you’re using host networking, i’d suggest trying to detect the right interface to bind to yourself, on the executor side, and set LIBPROCESS_IP= to the result of that logic be

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-07 Thread Eli Jordan
- > Best regards, > Rad > > > > > On Tue, Jun 7, 2016 at 3:21 AM +0200, "Eli Jordan" <elias.k.jor...@gmail.com> > wrote: > >> It's important to note that if you run a task with the command executor >> (I.e. Not using docker) LIBPRO

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-06 Thread Radoslaw Gruchalski
f you run a task with the command executor (I.e. Not using docker) LIBPROCESS_IP is defined, along with several other variables that are not defined in docker. ThanksEli On 7 Jun 2016, at 10:05, Radoslaw Gruchalski <ra...@gruchalski.com> wrote: I think the problem is that it is not known which age

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-06 Thread Radoslaw Gruchalski
can't have the docket executor set the LIBPROCESS_IP variable in the same way the command executor does. Thanks Eli On 6 Jun 2016, at 21:44, Radoslaw Gruchalski <ra...@gruchalski.com> wrote: Out of curiosity. Why are you insisting on using host names? Say you have 1 master and 2

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-06 Thread Eli Jordan
that in the container and read the ip. I would like to avoid having a dependency on the file system of the agents though. I'm not sure why I can't have the docket executor set the LIBPROCESS_IP variable in the same way the command executor does. Thanks Eli > On 6 Jun 2016, at 21:44, Radoslaw Gruchalski

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-06 Thread Radoslaw Gruchalski
rivileged. If it has come to you in error you must take no action based on it, nor must you copy or show it to anyone; please delete/destroy and inform the sender immediately. On June 6, 2016 at 1:16:07 PM, Eli Jordan (elias.k.jor...@gmail.com) wrote: The issue refers to LIBPROCESS_IP not LIBPROCES

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-06 Thread Eli Jordan
The issue refers to LIBPROCESS_IP not LIBPROCESS_HOST. I haven’t been able to find the LIBPROCESS_HOST variable documented anywhere. My understanding is that the scheduler uses LIBPROCESS_IP to determine which network interface to bind to, and also which ip to advertise to the master, so

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-05 Thread Eli Jordan
te > master(s). You might want to set 'LIBPROCESS_IP' environment variable to use > a routable IP address.” > > I tried setting LIBPROCESS_IP to ‘0.0.0.0’ and LIBPROCESS_ADVERTISE_IP=‘the > public ip’ and this works. But the host variations don’t seem to work. (i.e. > set L

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-05 Thread Eli Jordan
ter(s). You might want to set 'LIBPROCESS_IP' environment variable to use a routable IP address.” I tried setting LIBPROCESS_IP to ‘0.0.0.0’ and LIBPROCESS_ADVERTISE_IP=‘the public ip’ and this works. But the host variations don’t seem to work. (i.e. set LIBPROCESS_IP=0.

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-04 Thread Eli Jordan
. When running without a docker image LIBPROCESS_IP was defined along with many other variables. Sample output when running without docker (note LIBPROCESS_IP) is defined Registered executor on mesos-slave0 Starting task plain-test.5e5b00cc-2645-11e6-a3dd-080027aa149e sh -c 'while [ true ]; do env

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-06-03 Thread Eli Jordan
The reason I need to set LIBPROCESS_IP is because the slaves have 2 network interfaces, and the docker container is running in host networking mode. So libmesos doesn’t know which IP to advertise. The hostnames of the slaves are all resolvable. I have noticed that if I run a marathon app

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-04-04 Thread Pradeep Chhetri
Hello, Can you try changing your cmd to: "LIBPROCESS_IP=$HOST ./kafka-mesos.sh scheduler --master=mesos-master:5050 --zk=mesos-master:2181 --api=http://$HOST: <http://mesos-slave0:/> --storage=zk://kafka-mesos" and remove constraints and env sections. On Mon, Apr 4,

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-04-03 Thread Eli Jordan
pi=http://mesos-slave0: --storage=zk:/kafka-mesos", "instances": 1, "constraints": [["hostname", "LIKE", "mesos-slave0"]], "env": { "LIBPROCESS_IP": "192.168.3.16" } } @Chris Bake

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-04-03 Thread Chris Baker
Alternatively, because the $HOST username is indirect, which would require a runtime element to "export $LIBPROCESS_IP=$HOST", another alternative is to fallback on Mesos-DNS, if that's part of the cluster deployment, setting $LIBPROCESS_IP to the (a priori) Mesos-DNS entry cor

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-04-03 Thread craig w
Hi, marathon sets the HOST env var. If it's not the ip address you can use getent with the value from HOST to figure it out. >However, in order for the frameworks to receive resource offers I need to set the LIBPROCESS_IP environment variable to the hosts IP address for the docker contai

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-04-03 Thread haosdent
>However, in order for the frameworks to receive resource offers I need to set the LIBPROCESS_IP environment variable to the hosts IP address for the docker container running the frameworks. Hi, @Gmail. Could you provide more details about this? On Sun, Apr 3, 2016 at 10:40 PM, Rad Gruchal

Re: Set LIBPROCESS_IP for frameworks launched with marathon

2016-04-03 Thread Rad Gruchalski
. On Sunday, 3 April 2016 at 16:09, Gmail wrote: > I'm pretty new to mesos and marathon, and I'm running a couple of frameworks > with marathon (Kafka and elastic search). However, in order for the > frameworks to receive resource offers I need to set the LIBPROCESS_IP > environm