Re: Mesos API - How to send argument to task?

For the xml files part, I think you can set uris in CommandInfo with file:// scheme, e.g. file:///etc/path/to/foo.xml. Then in your executor you can access the files in /mnt/mesos/sandbox/foo.xml. On Tue, Jul 5, 2016 at 2:11 PM, Bryan Fok wrote: > > > > > >

Re: MesosCon North America videos and Europe CFP!

It works for me. Maybe you can just visit the youtube videos list directly: https://www.youtube.com/playlist?list=PLGeM09tlguZQVL7ZsfNMffX9h1rGNVqnC . On Sat, Jun 18, 2016 at 7:44 PM, Barry Kaplan wrote: > I get redirect to

Re: Redirect mesos logs out of /var/log/messages

32 PM, June Taylor <j...@umn.edu> wrote: > >> Shuai, >> >> Thank you for your quick reply. Just confirming: What is the & stop >> portion for? >> >> >> Thanks, >> June Taylor >> System Administrator, Minnesota Population Center &

Re: Redirect mesos logs out of /var/log/messages

Here's what we use to redirect slave logs to its own file on ubuntu 14.04: $ cat /etc/rsyslog.d/30-mesos.conf > :programname, contains, "mesos-slave" /var/log/mesos-slave.log > & stop The master part is basically the same. On Wed, May 25, 2016 at 11:02 PM, June Taylor wrote: >

Re: Framework Scheduling on Slave Question

> > Does mesos-slave know how to pass scheduler requests back to a Mesos > master node? Does one have to have mesos-master running on slave nodes to > do this? Am I smoking bad stuff? No problem at all. AFAIK it's a very common practice to have marathon running other frameworks. On Wed, May

Change the role of a framework

Hi list, For some reason I need to change the role of an existing framework (marathon) from the default role "*" to a specific role, say "services", I don't find any existing documentation on this, so here are the steps that I take on a staging cluster: - stop all HA marathon instances, only

Re: Marathon Docker Application Deployment Issue

image on to my slave machine and haven’t used a > docker hub instead. > > > > *From:* Shuai Lin [mailto:linshuai2...@gmail.com] > *Sent:* 21 April 2016 18:34 > > *To:* user <user@mesos.apache.org> > *Subject:* Re: Marathon Docker Application Deployment Issue > &

Re: Marathon Docker Application Deployment Issue

n socket > with fd 9: Transport endpoint is not connected > > E0421 03:02:22.856468 2804 process.cpp:1966] Failed to shutdown socket > with fd 9: Transport endpoint is not connected > > > > Thank you. > > > > *From:* Shuai Lin [mailto:linshuai2...@gmail.com]

Re: Marathon Docker Application Deployment Issue

There should be detailed error messages somewhere. Check your mesos slave logs, marathon logs, and docker daemon logs. On Thu, Apr 21, 2016 at 6:18 PM, wrote: > Hi , > > > > I have setup single mesos master and single slave machine in my > environment. And

Re: Docker image on mesos-slave

Take a look at https://github.com/spotify/docker-gc , and as Abhishek mentioned, you need to setup a cron job to do this. On Wed, Apr 20, 2016 at 2:32 PM, Dhiraj Thakur wrote: > Hi Folks, > > I have few question related to handling of docker images. > > Does mesos

Re: libmesos on alpine linux?

Take a look at http://stackoverflow.com/questions/35614923/errors-compiling-mesos-on-alpine-linux , this guy has successfully patched an older version of the mesos to build on alpine linux. On Sun, Apr 17, 2016 at 3:19 AM, Dick Davies wrote: > Has anyone been able to

Re: Pyspark Cluster Mode

To run the dispatcher in marathon I would recommend use a docker image like mesosphere/spark https://hub.docker.com/r/mesosphere/spark/tags/ One problem is how to access the dispatcher since it may be launched on any one the slaves. You can setup a service discovery mechanism like marathon-lb or

Re: Mesos master not joining cluster

Hi Shakeel, what do you mean by "one of the master was not participating in the quorum"? Can you paste related lines from the logs of that master? On Thu, Apr 14, 2016 at 8:44 PM, shakeel wrote: > Hi, > > I have three mesos master configured. They have all been

Re: Problems with scheduling tasks in mesos and spark

Have you tried setting the "spark.cores.max" in sparkconf? Check http://spark.apache.org/docs/1.6.1/running-on-mesos.html : You can cap the maximum number of cores using conf.set("spark.cores.max", > "10") (for example). On Thu, Apr 14, 2016 at 12:53 AM, Andreas Tsarida <

Re: Vote TODAY MesosCon voting closes today, Friday March 25

Not sure whether it's personal feeling or not, but in the voting page I see on a scale of 1 to 10, 1 for "accept" and 10 for "reject" is quite counter-intuitive. On Sat, Mar 26, 2016 at 1:32 AM, Kiersten Gaffney wrote: > If you haven't already, please take a few minutes

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

Maybe also https://issues.apache.org/jira/browse/MESOS-4877 and https://issues.apache.org/jira/browse/MESOS-4878 ? On Tue, Mar 8, 2016 at 9:13 AM, Jie Yu wrote: > I'd like to fix https://issues.apache.org/jira/browse/MESOS-4888 as well > if you guys plan to cut another RC >

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

> > * [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1 > Scheduler API. > * [MESOS-4591] - Change the object of ReserveResources and CreateVolume > ACLs to `roles`. > * [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1 > Scheduler API. MESOS-4712 is

Re: Downloading s3 uris

If you don't want to configure hadoop on your mesos slaves, the only workaround I see is to write a "hadoop" script and put it in your PATH. It need to support the following usage patterns: - hadoop version - hadoop fs -copyToLocal s3n://path /target/directory/ On Sat, Feb 27, 2016 at 12:31 AM,

Re: Mesos fetcher in dockerized slave

ping @Tim, I think this bug also affects https://issues.apache.org/jira/browse/MESOS-4743 . On Wed, Jan 20, 2016 at 10:20 PM, Shuai Lin <linshuai2...@gmail.com> wrote: > The testing of this case requires to build a docker image for mesos-slave, > so it seems not practical to add

Re: Can Marathon ensure single instance of a service at any give time?

> > If I would like to allow it to restart on any node in a cluster can I use > Marathon to simplify the implementation or it warrants more involved > implementation using Zoo. Does Mesos provide any other helpers to simplify > this use case? Marathon can do that, but be aware that there is

Re: Zookeeper & Paxos: Why?

Hi, As far as I have read, Paxos is not related to mesos master election. It is used to implement the "replicated logs", as the storage backend of the registry where information like slaves, quota, and maintenance schedules are persisted (check

Re: memory limit exceeded ==> KILL instead of TERM (first)

I'm not familiar with why SIGKILL is sent directly without SIGTERM, but is it possible to have your consul registry cleaned up when task killed by adding consul health checks? On Fri, Feb 12, 2016 at 6:12 PM, Harry Metske wrote: > Hi, > > we have a Mesos (0.27) cluster

Re: Using Virtual Hosts

Since you already have haproxy running, why not use it as a reverse proxy? On Fri, Feb 12, 2016 at 3:31 AM, Alfredo Carneiro < alfr...@simbioseventures.com> wrote: > Hi guys, > > I have been searching for the past few weeks about Mesos and VHosts, > saddly, I have not found anything useful. > >

Re: mesos 0.23, long term quering state.json data.

I would suggest first check the possibility of whether it's a problem of the vm/docker networking, e.g. run a web server in docker in the vm, and try to download some files from it, and vice versa. On Thu, Feb 4, 2016 at 2:17 AM, tommy xiao wrote: > hi, All > > I came across

Re: Unable to receive offers / long delays when starting or restarting.

Is there any warning/error message in marathon logs when it takes a long time to deploy/redeploy your micro service? Also worth take a look of the mesos slave logs. On Tue, Feb 2, 2016 at 6:55 AM, Rodrick Brown wrote: > My cluster consist of 9 slaves server split in 1/2

Re: Issues on Zk configuration in Marathon

I think you need to either pin the tasks to some of the slaves (e.g. using marathon "CLUSTER" constraint) so that you can have a static configuration for your zk instances, or you need some type of service discovery.

Re: Unable to build 2.6 on OS X

A googling of "configure: error: invalid variable name" leads me to http://askubuntu.com/a/590679 . The reason: the first dash in your '--with-apr' is not correct typed. btw I would suggest similiar questsions go to dev list instead of user list. On Fri, Jan 29, 2016 at 1:02 PM, Rinaldo

Re: Mesos fetcher in dockerized slave

Lin <linshuai2...@gmail.com> wrote: > Hi Tim, > > The review is here: https://reviews.apache.org/r/42390/ , would you > please take a look? > > Regards, > Shuai > > On Sat, Jan 9, 2016 at 9:42 AM, Shuai Lin <linshuai2...@gmail.com> wrote: > >> Hi

Re: Mesos fetcher in dockerized slave

Hi Tim, The review is here: https://reviews.apache.org/r/42390/ , would you please take a look? Regards, Shuai On Sat, Jan 9, 2016 at 9:42 AM, Shuai Lin <linshuai2...@gmail.com> wrote: > Hi Maria and Tim, > > I'm setting up a test case for this scenario that would fail, aft

Re: 答复: can mesos run in SUSE Linux 11?

11 SP3 with g++4.7, but I > encountered a error: > > configure: error: *** A compiler with support for C++11 language features > is required. > > Any suggestion? > > > > *发件人:* Shuai Lin [mailto:linshuai2...@gmail.com] > *发送时间:* 2016年1月16日 15:13 &

Re: can mesos run in SUSE Linux 11?

There is no official package for SUSE on the downloads page of mesosphere: https://open.mesosphere.com/downloads/mesos/#apache-mesos-0.26.0 . So I guess you have to either compile from source, or run mesos master/slave in docker containers. On Sat, Jan 16, 2016 at 1:47 PM, Linyuxin

Re: slave nodes are living in two cluster and can not remove correctly.

Based on your description, you have two clusters: - old cluster B, with mesos 0.25, and the master ip is 10.88.169.195 - new cluster A, with mesos 0.22, and the master ip is 10.90.12.29 Also you have a slave S, 10.90.5.19, which was originally in cluster B, and you have reconfigured it to join

Re: Mesos fetcher in dockerized slave

Chen <t...@mesosphere.io> wrote: > I can shepherd no problem. > > Tim > > On Dec 25, 2015, at 4:32 PM, Shuai Lin <linshuai2...@gmail.com> wrote: > > I'll work on it. @Tim could you shepherd it? > > On Sat, Dec 26, 2015 at 2:49 AM, Marica Antonacci < > ma

Re: mesos, big data and service discovery

What about specifying all non-local instances as "backup" in haproxy.cfg? This way haproxy would only direct traffic to the local instance as long as the local instance is alive. For example, if you plan to use the haproxy-marathon-bridge script, you can modify this line to achieve that:

Re: make slaves not getting tasks anymore

> > I need to wait until all tasks are done and during this time no new tasks > should be started on this slave This is exactly what maintenance mode is designed for. But to achieve this, it requires the cooperation of the framework. When the operator adds a maintenance schedule for a slave,

Re: Mesos fetcher in dockerized slave

The problem happens to me if I don't specify the --docker_mesos_image flag. However, specifying the flag only makes things worse: the task is failed again and agin, but there does exist a container for this task. master and zookeeper is running on host, and slave is running inside a docker image:

Re: Team organization around Mesos cluster

I think that would depends on how would you use the mesos cluster. We have a mesos cluster of ~20 nodes to run all the production web services. From the POV of other teams, the mesos cluster is like an internal PaaS, and they only need to know how to manage their own apps - how to create app

Re: Mesos Events Calendar

+1, very useful! On Sat, Nov 21, 2015 at 2:58 PM, Michael Park wrote: > I can definitely add a finite list of admins, but I don't think I can just > open it up to the public (we probably don't want to anyway). > I've added your gmail account as one of the admins to start, I

Re: Deploying containers to every mesos slave node

We do the same thing: running consul on each mesos slave, and use saltstack to provision it. Why do you want to get rid of salt? You always need some tool to provision your server, right? Regards, Shuai On Thu, Mar 12, 2015 at 4:54 PM, Aaron Carey aca...@ilm.com wrote: Hi All, In setting

Re: cluster wide init

You can always write the init wrapper scripts for marathon. There is an official debian package, which you can find in mesos's apt repo. On Thu, Jan 22, 2015 at 4:20 AM, CCAAT cc...@tampabay.rr.com wrote: Hello all, I was reading about Marathon: Marathon scheduler processes were started

Re: mesos and coreos?

Nope. First, mesos is not a framework. A framework is what you use in your application to help build the app itself, like spring, rails, or django. Mesos is more fundamental. - mesos gathers all the resources (cpus/mems/disks) of the nodes in your cluster and make it a resource pool - your app

Re: Recommended resources for master / scheduler machines

Hi Itamar, You should really run zookeeper on more than one node (typically 3, 5, or 7 is very common). Otherwise, in your case, if the node running your zookeeper servce goes down for any reason, your whole mesos installation would stop working until you bring that node back. Regards, Shuai

Re: Following Mesos

Hi Dave, thanks for the link to markmail and planet mesos, especially the latter, it has many good articles about mesos! On Fri, Jan 9, 2015 at 7:38 AM, Dave Lester daveles...@gmail.com wrote: Hi James, Thanks for asking about this! I think there's a lot of room for improvement here. Have

Re: conf files location of mesos.

Yes, the mesos-master or mesos-slave binary itself only accepts command line options, and do not read configs from places like /etc/mesos/ or /etc/default/mesos. If you compile from source, you either write a wrapper script to read these configs/options, and pass them to mesos-master/mesos-slave

Re: python error when configuring mesos on CentOS6.6.

On Tue, Jan 6, 2015 at 4:55 AM, Dan Dong dongda...@gmail.com wrote: Hi, All, When I configure mesos 0.21.0 on CentOS6.6, I got python lib error as following. python2.7 and python-dev packages have been installed already. Any hints(e.g: ENVs)? (python-devel-2.6.6-52.el6.x86_64