RE: Custom python executor with Docker

Hi All, I can see there are many use cases for extending Docker tasks with some pre/post work. In our solution we want to prepare and attach some volumes (e.g ceph volumes) to Docker. As you know we cannot (easily) attach a volume to the running Docker, so we need pre script for preparing &

RE: Custom python executor with Docker

This is somehow possible using Kubernetes over Mesos: https://github.com/kubernetes/kubernetes/blob/master/docs/getting-started-guides/mesos.md Kind Regards, Bartek Plotka From: Aaron Carey [mailto:aca...@ilm.com] Sent: Tuesday, November 10, 2015 4:33 PM To: user@mesos.apache.org Subject: RE:

RE: Custom python executor with Docker

Yeah.. it'd be nice to do it natively though :) From: Plotka, Bartlomiej [bartlomiej.plo...@intel.com] Sent: 10 November 2015 15:38 To: user@mesos.apache.org Subject: RE: Custom python executor with Docker This is somehow possible using Kubernetes over Mesos:

RE: Custom python executor with Docker

We would also be interested in some sort of standardised DockerExecutor which would allow us to add pre and post launch steps. Also having the ability to run two containers together as one task would be very useful (ie on the same host and linked together)

Re: Zookeeper cluster changes

I agree, you want to apply the changes gradually so as not to lose a quorum. The problem is automating this so that it happens in a lights-out environment, in the cloud, without some poor slob's pager going off in the middle of the night :) While health checks can detect and replace a dead

Re: spark on mesos with docker issue

Stavros, As mentioned a couple of weeks ago: https://issues.apache.org/jira/browse/SPARK-11638 Happy to answer any questions. Kind regards,
 Radek Gruchalski 
ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 (mailto:ra...@gruchalski.com) de.linkedin.com/in/radgruchalski/

Re: Zookeeper cluster changes

Keep in mind that mesos is designed to "fail fast". So when there are problems (such as losing connectivity to the resolved ZooKeeper IP) the daemon(s) (master & slave) die. Due to this design, we are all supposed to run the mesos daemons under "supervision", which means auto-restart after they

Re: Mesos and Zookeeper TCP keepalive

same here , same question with Erik. could you please input more background info, thanks 2015-11-10 15:56 GMT+08:00 Erik Weathers : > It would really help if you (Jeremy) explained the *actual* problem you > are facing. I'm *guessing* that it's a firewall timing out the

Re: Failed to authenticate

This issue is only on centos 7, On ubuntu its working fine. Any idea? Regards, Pradeep On 9 November 2015 at 17:32, Pradeep Kiruvale wrote: > Hi All, > > I am getting authentication issue on my mesos cluster > > Please find the slave side and master side logs. > >

Re: mess slave can't register to master via master ip:port

What should I do in this scenarios: slave register to master with --master=masterip:masterport After that ,master nodes change their leader. I found mesos-slave can’t not register to master anymore. So it seems masterip:masterport is not a PROD-READY choice. Does that mean slaves have to

Re: mess slave can't register to master via master ip:port

How about use zookeeper acl? https://zookeeper.apache.org/doc/r3.1.2/zookeeperProgrammers.html#sc_ZooKeeperAccessControl On Tue, Nov 10, 2015 at 6:01 PM, Xiaodong Zhang wrote: > What should I do in this scenarios: > > slave register to master with --master=masterip:masterport

Re: Failed to authenticate

would you help to log a JIRA to trace it? Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Tue, Nov 10, 2015 at 5:12 PM, Pradeep Kiruvale

Re: Custom python executor with Docker

Customized framework with Mesos persistent volumn can come to your desired feature, IMO. Which will recover the volumn after framework deregistered. > 在 2015年11月10日，23:43，Aaron Carey 写道： > > Yeah.. it'd be nice to do it natively though :) > > From: Plotka, Bartlomiej

Re: Mesos and Zookeeper TCP keepalive

Hi Jeremy, Can you read the description of these parameters on the master, and possibly share your values for these flags? It seems from the re-registration attempt on the agent, that

what's the best way to monitor mesos cluster

Hi Mesos experts There is server and client snapshot metrics in jason format provided by Mesos itself. but more often we want to extend the metrics a bit more than that. I have been looking for this for a couple of days, while https://collectd.org/ comes to my sight, it also has a mesos

Re: Mesos and Zookeeper TCP keepalive

Hi Tommy, Erik, all, You are correct in your assumption that I'm trying to solve for a one hour session expire time on a firewall. For some more background info, our master cluster is in datacenter X, the slaves in X will stay "up" for days and days. The slaves in a different datacenter, Y,