Re: Running a task in Mesos cluster

2015-10-05 Thread Guangya Liu
Hi Pradeep, My steps was pretty simple just as https://github.com/apache/mesos/blob/master/docs/getting-started.md#examples On Master node: root@mesos1:~/src/mesos/m1/mesos/build# GLOG_v=1 ./bin/mesos-master.sh --ip=192.168.0.107 --work_dir=/var/lib/mesos On 3 Slave node:

Re: OS X build

2015-10-05 Thread Alexander Rojas
Well, libapr-1 is supposed to be shipped with default with OS X, so in theory one shouldn’t need to use the homebrew version. I did had a problem with my machine not finding libapr after I updated to “El Capitan.” My solution was to reinstall the command line tools with `code-select —install`.

Re: Advice on agent disconnect and reconnect

2015-10-05 Thread Benjamin Mahler
There are a few things going on there, you're having ZooKeeper connectivity issues. And the master is not able to health check the agent. I would recommend triaging what occurred in your network, but you can increase the master's health check timeouts as a mitigation. You can also control the

Re: Running a task in Mesos cluster

2015-10-05 Thread Guangya Liu
Hi Pradeep, Glad it finally works! Not sure if you are using systemd.slice or not, are you running to this issue: https://issues.apache.org/jira/browse/MESOS-1195 Hope Jie Yu can give you some help on this ;-) Thanks, Guangya On Mon, Oct 5, 2015 at 5:25 PM, Pradeep Kiruvale

Re: Xian-Mesos-User-Group: Apache Mesos Startup In Xi'an China

2015-10-05 Thread haosdent
Thank you for sharing, the topics look great! On Mon, Oct 5, 2015 at 8:58 PM, Guangya Liu wrote: > Hi, > > All of the materials of Xian Mesos Meetup have been uploaded to > http://www.meetup.com/Xian-Mesos-User-Group/files/ > > There are 3 topics: > 1) Seattle Mesos Conf

Re: Running a task in Mesos cluster

2015-10-05 Thread Guangya Liu
Hi Pradeep, >From your log, seems that the master process is exiting and this caused the framework fail over to another mesos master. Can you please show more detail for your issue reproduced steps? I did some test by running mesos-execute on a client host which does not have any mesos service

Re: Running a task in Mesos cluster

2015-10-05 Thread Pradeep Kiruvale
Hi Guangya, Hmm!...That is strange in my case! If I run from the mesos-execute on one of the slave/master node then the tasks get their resources and they get scheduled well. But if I start the mesos-execute on another node which is neither slave/master then I have this issue. I am using an lxc

Re: Running a task in Mesos cluster

2015-10-05 Thread Pradeep Kiruvale
Hi Guangya, I am facing one more issue. If I try to schedule the tasks from some external client system running the same cli mesos-execute. The tasks are not getting launched. The tasks reach the Master and it just drops the requests, below are the logs related to that I1005 11:33:35.025594

Re: Running a task in Mesos cluster

2015-10-05 Thread Guangya Liu
Hi Pradeep, I think that the problem might be caused by that you are running the lxc container on master node and not sure if there are any port conflict or what else wrong. For my case, I was running the client in a new node but not on master node, perhaps you can have a try to put your client

Scheduling tasks based on dependancy

2015-10-05 Thread Pradeep Kiruvale
Hi All, Are there any frameworks that exists with the Mesos to schedule the bigger apps? I mean to say scheduling a app which has many services and will not fit into one physical node. Is there any frame work that can be used to schedule tasks based on the underlying hardware constraints like

Re: Scheduling tasks based on dependancy

2015-10-05 Thread Guangya Liu
Pradeep, There is a JIRA ticket doing your requirement but not finished yet, please refer to https://issues.apache.org/jira/browse/MESOS-3366 for detail. The basic idea is using customized hook modules to collect customized metrics. For now, you have to set metrics/resource manually for each

Re: Scheduling tasks based on dependancy

2015-10-05 Thread Pradeep Kiruvale
Hi Guangya, Thanks for information. Regards, Pradeep On 5 October 2015 at 17:57, Guangya Liu wrote: > Pradeep, > > There is a JIRA ticket doing your requirement but not finished yet, please > refer to https://issues.apache.org/jira/browse/MESOS-3366 for detail. The >

Re: Scheduling tasks based on dependancy

2015-10-05 Thread Olaf Magnetic
Hi Pradeep, Our opensource framework VAMP (www.vamp.io) might help you. It's possible to define entire topologies of services, and has drivers to run on mesos/marathon. Network bandwidth detection is not a current feature, but as our system is modular and open all kinds of metrics and

Re: Scheduling tasks based on dependancy

2015-10-05 Thread Sharma Podila
Pradeep, We recently open sourced Fenzo (wiki ) to handle these scenarios. We add a custom attribute for network bandwidth for each agent's "mesos-slave" command line. And we have Fenzo assign resources to tasks based on

RE: Scheduling tasks based on dependancy

2015-10-05 Thread Clarke, Trevor
Take a look at kubernetes. https://github.com/mesosphere/kubernetes-mesos From: Pradeep Kiruvale [pradeepkiruv...@gmail.com] Sent: Monday, October 05, 2015 11:21 AM To: user; d...@mesos.apache.org Subject: Scheduling tasks based on dependancy Hi All, Are

Re: Scheduling tasks based on dependancy

2015-10-05 Thread Pradeep Kiruvale
Hi Guangya, Thanks for your reply. That is nice feature to group the slaves into different racks and etc...But is there any way I can get metric of other hardware features other than CPU,MEM, DISK like IO, PCI devices that exists with the node etc? Thanks, Pradeep On 5 October 2015 at 17:45,

Securing executors

2015-10-05 Thread Paul Bell
Hi All, I am running an nmap port scan on a Mesos agent node and noticed nmap reporting an open TCP port at 50577. Poking around some, I discovered exactly 5 mesos-docker-executor processes, one for each of my 5 Docker containers, and each with an open listen port: root 14131 3617 0 10:39