Re: Total resources available versus actually available

If you are looking for something more dynamic, you should follow the discussion on oversubscription :) Cheers, Niklas On 9 February 2015 at 02:34, craig w codecr...@gmail.com wrote: Mesos slaves report the total resources they have available, such as 2 CPU, 8GB Memory and 100GB disk

Total resources available versus actually available

Mesos slaves report the total resources they have available, such as 2 CPU, 8GB Memory and 100GB disk. Does Mesos keep track of the amount of resources that are actually available to best schedule tasks? For example, imagine a slave has some other processes running on it (that are not mesos

Re: [VOTE] Release Apache Mesos 0.22.0 (rc4)

+1 On Wed, Mar 18, 2015 at 3:52 PM, Niklas Nielsen nik...@mesosphere.io wrote: Hi all, Please vote on releasing the following candidate as Apache Mesos 0.22.0. 0.22.0 includes the following: * Support for

Re: Deploying containers to every mesos slave node

aca...@ilm.com wrote: Hi Craig, I'd looked into that, but I was thinking this may cause issues when our cluster auto scales up or down, as instances would no longer equal slaves? Thanks, Aaron -- *From:* craig w [codecr...@gmail.com] *Sent:* 12 March 2015 08

marathon 0.8.1 packages

Will the 0.8.1 packages (rpm / deb) be posted to github?

Re: mesos on coreos

Is there any documentation describing what's necessary to run mesos master and slaves in Docker containers? You already mentioned a few things (mounting work dir, /sys/fs, etc). Thanks On Tue, Mar 10, 2015 at 6:41 PM, Tim Chen t...@mesosphere.io wrote: Hi all, As Alex said you can run Mesos

Re: [RESULT][VOTE] Release Apache Mesos 0.22.0 (rc4)

Rukletsov Craig W Ben Whitehead Elizabeth Lingg Dario Rexin Jeff Schroeder Michael Park Alexander Rojas Andrew Langhorn There were no 0 or -1 votes. Please find the release at: https://dist.apache.org/repos/dist/release/mesos/0.22.0 It is recommended to use a mirror to download

Re: Unable to install subversion-devel 1.8+ on CentOS 7

https://issues.apache.org/jira/browse/MESOS-2115 On Mon, Mar 23, 2015 at 8:30 AM, Aaron Carey aca...@ilm.com wrote: ah interesting.. what causes this difference? I think this probably makes sense for our setup currently.. -- *From:* craig w [codecr

Unable to install subversion-devel 1.8+ on CentOS 7

Mesos 0.21.0+ requires subversion-devel 1.8+, which can be installed by adding the Wandisco yum repo. However, it appears that subversion-devel 1.8+ requires libsasl2.so.2, which is not available on CentOS7. I've seen one person try to create a symlink to libsasl2.so.3 and it worked [1], while

Re: Unable to install subversion-devel 1.8+ on CentOS 7

What OS is your docker image based on? On Mon, Mar 23, 2015 at 8:11 AM, Aaron Carey aca...@ilm.com wrote: Not sure if this helps, but we've been using docker to run Mesos on Centos 7 hosts. -- *From:* craig w [codecr...@gmail.com] *Sent:* 23 March 2015 12:06

Re: Unable to install subversion-devel 1.8+ on CentOS 7

that it had running will remain running even if the process dies. That's why I hadn't gone that route. Have you considered that? On Mon, Mar 23, 2015 at 8:15 AM, craig w codecr...@gmail.com wrote: What OS is your docker image based on? On Mon, Mar 23, 2015 at 8:11 AM, Aaron Carey aca...@ilm.com

Re: Docker 1.6 and Registry 2.0 support

version 1, it works as normal. On Tue, Apr 21, 2015 at 5:57 PM, craig w codecr...@gmail.com wrote: From what I can tell, Mesos and Marathon should still be able to work with Docker 1.6, but will Mesos / Marathon be able to pull images from the Registry 2.0? It seems like the new registry won't

Docker 1.6 and Registry 2.0 support

From what I can tell, Mesos and Marathon should still be able to work with Docker 1.6, but will Mesos / Marathon be able to pull images from the Registry 2.0? It seems like the new registry won't support the v1 API based on this section of their Deploying page:

Re: Current State of Service Discovery

We're going with HAProxy on every node + haproxy-marathon-bridge (since we're leveraging Marathon). We deployed mesos-dns but it didn't make seem to make sense to have both solutions. -craig On Wed, Apr 1, 2015 at 12:33 PM, Adam Shannon adam.shan...@banno.com wrote: David, Smartstack was one

Re: Master UI - Tasks section is empty

See https://issues.apache.org/jira/browse/MESOS-3282 On Aug 23, 2015 12:28 PM, Jeremy Olexa jol...@spscommerce.com wrote: Hi all, On a new cluster, the tasks section of the left sidebar is populated as jobs are staged, started, killed, etc. I've noticed that after a rolling restart of the

Re: Is it possible to run mesos master/slave in private IP and exhibit mesos cluster status with public IP?

The mesos-slaves have their own UI separate from the master? If so, what's the URL to get to it? I just tried http://mesos-slave:5051 and got a blank page. On Tue, Jul 28, 2015 at 6:51 AM, Adam Bordelon a...@mesosphere.io wrote: A simple nginx reverse proxy will get you most of the way there,

Re: Get List of Active Slaves

If the information is going to be in Zookeeper, you could setup one of the REST frontends and query Zookeeper over HTTP (check the zookeeper src/contrib directory). On Aug 5, 2015 1:26 AM, Marco Massenzio ma...@mesosphere.io wrote: Now that Mesos (0.24, to be released soon) publishes the Master

Re: SSL in Mesos 0.23

I've run ldd on /usr/sbin/mesos-master (on CentOS 7 using mesos 0.23 from mesosphere repo) and I see libssl.3.so and libssl.so.10 On Thu, Aug 6, 2015 at 12:20 PM, Jeff Schroeder jeffschroe...@computer.org wrote: Can you run ldd on the mesos-master or mesos-slave binaries? I believe you

Are the resource options documented?

When configuring a mesos-slave with --resources, I know cpu, mem and ports are available. Are there others? Are these documented somewhere? I've found some examples here https://open.mesosphere.com/reference/mesos-slave/ and the configuration page

Re: Docker Private Registry problem when update from 0.23 to 0.25

e: >> >>> According https://github.com/mesosphere/marathon/pull/2462 , I think >>> the patches merge into 0.12.0-RC1 and 0.11.1 doesn't contain yet. >>> >>> On Fri, Oct 23, 2015 at 7:32 PM, craig w <codecr...@gmail.com> wrote: >>>

Re: Docker Private Registry problem when update from 0.23 to 0.25

j.stabe...@livespottingmedia.com>: > > Hey Brian, > > sorry for my late response. > > I'll try the latest 0.11.1. > > This may be one of the problems: > https://github.com/mesosphere/marathon/pull/2415 > > > Am 15.10.2015 um 21:14 schrieb craig w <codecr...

Re: Docker Private Registry problem when update from 0.23 to 0.25

o 0.12.0-RC1 and 0.11.1 doesn't contain yet. > > On Fri, Oct 23, 2015 at 7:32 PM, craig w <codecr...@gmail.com> wrote: > >> Has anyone confirmed that Mesos 0.25.0 with Marathon 0.11.1 with a >> private docker registry (without credentials) works? >> >> On Thu,

Re: Marathon 0.11.1 - Mesos 0.25 - Mesos-DNS 0.4.0

I've had no issue with the following combination: MesosDNS 0.4.0 Marathon 0.11.0 Mesos 0.24.1 I've been waiting to upgrade to Mesos 0.25.0 because of issues mentioned in the mesos mailing list regarding Marathon 0.11.x and Mesos 0.25.0 On Wed, Oct 28, 2015 at 10:38 AM, John Omernik

Re: mesos-slave configuration file with Ports Offer

Miguel, create a file named: /etc/mesos-slave/resources/ports(*) It should contain: [21000-24000] On Fri, Nov 13, 2015 at 6:30 AM, Miguel Ángel Ausó wrote: > Hi > > I'm trying configure "port offers" in mesos-slave using a configuration > file (I'm using mesosphere

Re: many outstanding chronos offers

rocess/3rdparty/stout/include/stout/duration.hpp#L55-L69 > for detail, thanks! > > > > On Thu, Nov 5, 2015 at 9:04 PM, craig w <codecr...@gmail.com> wrote: > >> Looks like it would be "5min" or "30s" >> >> >> https://github.com/mes

Re: many outstanding chronos offers

Looks like it would be "5min" or "30s" https://github.com/mesosphere/mesos/blob/master/3rdparty/libprocess/3rdparty/stout/include/stout/duration.hpp#L37 On Thu, Nov 5, 2015 at 7:55 AM, craig w <codecr...@gmail.com> wrote: > What's the format for that value?

Re: many outstanding chronos offers

t; small value e.g. 5 minutes ? The default behavior is that a framework can > keep hoarding the offered resources forever. > > http://mesos.apache.org/documentation/latest/configuration/ > > -anand > > On Nov 5, 2015, at 5:15 PM, craig w <codecr...@gmail.com> wrote: > > I'm runni

Re: Mesos-Dns Masters List

If you can, try mesos-dns 0.4.0, there were a handful of fixes and improvements that might help. 0.4.0 is working great for me. On Wed, Oct 14, 2015 at 9:10 AM, John Omernik wrote: > Hey all, > > I was using mesos-dns, and I filled in my zk field based on the HA mesos >

Re: How production un-ready are Mesos Cassandra, Spark and Kafka Frameworks?

So far the Kafka framework has worked well in production. We launch the framework using marathon, then execute a few command line statements to add and start the brokers. On Oct 12, 2015 1:38 PM, "Dick Davies" wrote: > Hi Chris > > > > Spark is a Mesos native, I'd have

upgrade from 0.24.1 to 0.25

When upgrading from 0.23.0 to 0.24.1, I installed the new binaries and restarted the masters (all at once), then restarted all of the slaves. I then observed all of the tasks that were running (via Marathon 0.10.x) were restarted. I had expected "no downtime" or restarts, did I misunderstand the

Re: upgrade from 0.24.1 to 0.25

> > Niklas > > On 13 October 2015 at 02:39, craig w <codecr...@gmail.com> wrote: > >> When upgrading from 0.23.0 to 0.24.1, I installed the new binaries and >> restarted the masters (all at once), then restarted all of the slaves. >> >> I then observe

Re: After restarting cluster task disappeared

With regards to item #2, I saw the same issue. it's been fixed in mesos 0.25 (release candidates are out now), see https://issues.apache.org/jira/browse/MESOS-3282. On Fri, Oct 9, 2015 at 8:16 AM, Badal Naik wrote: > Hello Mesos-Users, > > I have set up 3 node mess

Re: Basic installation question

Mesosphere has packages prebuilt, go to their site to find how to install On Sep 4, 2015 5:11 PM, "Stephen Boesch" wrote: > > After following the directions here: > http://mesos.apache.org/gettingstarted/ > > Which for centos7 includes the following: > > > > > # Change

Re: Basic installation question

old. > > https://docs.mesosphere.com/tutorials/install_centos_rhel/ > > > 2015-09-04 14:27 GMT-07:00 craig w <codecr...@gmail.com>: > >> Mesosphere has packages prebuilt, go to their site to find how to install >> On Sep 4, 2015 5:11 PM, "Stephen Boesch" <java.

0.24.1 blog post link broken

The link to the blog post about mesos 0.24.1 seems to be broken: http://mesos.apache.org/blog/mesos-0-24-1-and-more-released/

Re: Changing mesos slave configuration

I believe Brian might be referring to the "KillMode" in the systemd unit file: # the default is cgroup, which means kill all processes # in the control group of this process, which is not # what you'd want KillMode=process On Wed, Sep 23, 2015 at 8:11 AM, Brian Devins wrote:

Re: Official RPMs

Mesosphere provides packages, you can find more information here: https://mesosphere.com/downloads/ As of right now, they don't seem to have a 0.24.0 package. On Fri, Sep 18, 2015 at 8:51 PM, Brian Hicks wrote: > We've got some experimental packages at

mesos 0.24 released?

has mesos 0.24 been released? it's on the downloads page, but the tarball is from september 4 http://mesos.apache.org/downloads/

Re: Mesos masters and zookeeper running together?

We've run the mesos-master and marathon processes in the same servers as zookeeper. On Dec 24, 2015 11:01 AM, "Ron Lipke" wrote: > Hello, I've been working on setting up a mesos cluster for eventual > production use and I have a question on configuring zookeeper alongside >

Re: mesos-elasticsearch vs Elasticsearch with Marathon

In terms of discovery, elasticsearch provides that out of the box https://www.elastic.co/guide/en/elasticsearch/reference/1.4/modules-discovery.html. We deploy elasticsearch via Marathon and it works great. On Mon, Dec 28, 2015 at 2:17 PM, Eric LEMOINE wrote: > On Mon,

mesos 0.26.0 website updates

When will the mesos website and blog be updated to mention the 0.26.0 release?

Re: mesos-elasticsearch vs Elasticsearch with Marathon

We'd like to use the framework once some more features are available (see the road map). Currently we deploy ES in docker using marathon. On Dec 21, 2015 11:14 PM, "Weitao" wrote: > IMO, es as a framework running on Mesos is our future, atst, we can deploy > the es

Re: mesos 0.26.0 website updates

ws > >- *December 16, 2015* - Mesos 0.26.0 is released! See the CHANGELOG > > <https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=0.26.0> > and blog post <http://mesos.apache.org/blog/mesos-0-26-0-released/> for > details. >

Re: mesos-elasticsearch vs Elasticsearch with Marathon

r these ip addresses). On Mon, Dec 28, 2015 at 5:51 PM, Alex Rukletsov <a...@mesosphere.com> wrote: > Craig, > > mind elaborating, how exactly do you run elasticsearch in Marathon? > > On Mon, Dec 28, 2015 at 8:36 PM, craig w <codecr...@gmail.com> wrote: > > In

Re: 0.28.2 has been released

Jie, Thanks for the updates. When will the packages be available (in particular RPM)? -craig On Sun, Jun 5, 2016 at 2:31 PM, Jie Yu wrote: > Hi folks, > > I just released Mesos 0.28.2 and updated the website. > > It includes some important bug fixes. The change log can be

Re: Resources clarification in Mesos UI

t should <= "allocated" resources. > > On Wed, Feb 3, 2016 at 9:02 PM, craig w <codecr...@gmail.com> wrote: > >> On the Mesos UI (v 0.26.0) under the "resources" section when it lists >> CPUs and Mem, is "used" the actual amount of memory b

blog post for 0.27.0 release

Will there be a blog post for the 0.27.0 release?

Re: Resources clarification in Mesos UI

Done - https://issues.apache.org/jira/browse/MESOS-4586 thanks On Wed, Feb 3, 2016 at 9:16 AM, haosdent <haosd...@gmail.com> wrote: > hmm, I think it is correct. Could you help create a ticket about this > display problem in mesos jira? > On Feb 3, 2016 9:28 PM, "craig w&q

Resources clarification in Mesos UI

On the Mesos UI (v 0.26.0) under the "resources" section when it lists CPUs and Mem, is "used" the actual amount of memory being used or the amount that's been allocated? I ask, because on the page that displays information for a slave it shows the CPUs and Mem used and allocated.

Re: "Chaos monkey" for mesos?

here's a direct link in the video https://youtu.be/0I6qG9RQUnY?t=389 On Thu, Feb 25, 2016 at 12:17 PM, David Wood wrote: > The DCOS tutorial mentions a chaos tool at the end of the video. Not sure > if that's what your looking for, but it might be something to follow up on >

Re: Mesos metrics -> influxdb

Niklas -- is the mesos collector ready? it's in the "wish list" on that page. On Fri, Feb 26, 2016 at 11:12 AM, Niklas Nielsen wrote: > Or take SNAP for a spin: > https://github.com/intelsdi-x/snap/blob/master/docs/PLUGIN_CATALOG.md > Can collect metrics from Mesos and output in

0.27.2 RPMs

When will the 0.27.2 RPMs be available?

Re: [RESULT][VOTE] Release Apache Mesos 0.28.0 (rc2)

Great news. Do the rpm's get automatically built and released or will they come later this week? On Thu, Mar 17, 2016 at 1:28 PM, Vinod Kone wrote: > Hi all, > > > The vote for Mesos 0.28.0 (rc2) has passed with the > > following votes. > > > +1 (Binding) > >

Re: marathon-lb at scale

For what it's worth, I had tried the haproxy bridge with marathon 0.11 back when that was the latest release. I had the bridge running on 90 nodes and it crushed the marathon leader. Marathon had made lots of improvements so it might be better now, but figured I'd share. On Mar 2, 2016 7:59 PM,

Re: marathon-lb at scale

That was using the marathon-haproxy-bridge script, so it was polling marathon every minute to try and keep up to date. Though a minute lag in updating the proxy wasn't sufficient.

Re: marathon-lb at scale

t seen. > > On Thu, Mar 3, 2016 at 12:23 PM, craig w <codecr...@gmail.com> wrote: > >> That was using the marathon-haproxy-bridge script, so it was polling >> marathon every minute to try and keep up to date. Though a minute lag in >> updating the proxy wasn't sufficie

Re: Set LIBPROCESS_IP for frameworks launched with marathon

Hi, marathon sets the HOST env var. If it's not the ip address you can use getent with the value from HOST to figure it out. >However, in order for the frameworks to receive resource offers I need to set the LIBPROCESS_IP environment variable to the hosts IP address for the docker container