Re: Problem building 0.23.0 under mock for RHEL7

2015-08-04 Thread Tim St Clair
I'll take a look in the a.m. feel free to ping me on irc. Cheers, Tim - Original Message - From: Jeff Schroeder jeffschroe...@computer.org To: Mesos Users user@mesos.apache.org Sent: Tuesday, August 4, 2015 6:21:39 PM Subject: Problem building 0.23.0 under mock for RHEL7 I'm

Re: Setting minimum offer size

2015-06-24 Thread Tim St Clair
- Original Message - From: Brian Candler b.cand...@pobox.com To: user@mesos.apache.org Sent: Wednesday, June 24, 2015 10:50:43 AM Subject: Re: Setting minimum offer size On 24/06/2015 16:31, Alex Gaudio wrote: Does anyone have other ideas? HTCondor deals with this by having a

Re: Task requires multiple containers

2015-06-22 Thread Tim St Clair
What's the current status regarding the POD-esk JIRA to treat as a single unit vs. custom? It sounds like this is what he wants. Cheers, Tim - Original Message - From: Tim Chen t...@mesosphere.io To: user@mesos.apache.org Sent: Saturday, June 20, 2015 7:25:00 PM Subject: Re:

Re: Batch Scheduler with dependency support

2015-05-13 Thread Tim St Clair
Hi Alex, Have you by chance integrated with any of the tradition batch DAG systems? http://pegasus.isi.edu/ , http://ccl.cse.nd.edu/software/makeflow/ I keep longing for folks with decades of experience in HTCHPC to chime in on-list. Subtle nudge ;-) Tim - Original Message -

Re: [VOTE] Release Apache Mesos 0.22.0 (rc4)

2015-03-24 Thread Tim St Clair
+1 binding Fedora 21 GCC 4.9.2 - Original Message - From: Andrew Langhorn and...@ajlanghorn.com To: user@mesos.apache.org Cc: cc...@tampabay.rr.com Sent: Tuesday, March 24, 2015 7:05:37 AM Subject: RE: [VOTE] Release Apache Mesos 0.22.0 (rc4) +1 (non-binding) on Ubuntu 14.04 with

Apache Mesos 0.22.0 (rc4) -- push to epel

2015-03-19 Thread Tim St Clair
Folks, For those who are interested, going to make the push now for getting Mesos into epel ( https://fedoraproject.org/wiki/EPEL ) 7 and by extension all the clones and variants. https://bugzilla.redhat.com/show_bug.cgi?id=1177055 Luckily just by waiting a while, the dep-graph has shrunk.

Re: Deploying containers to every mesos slave node

2015-03-12 Thread Tim St Clair
You may want to also view - https://issues.apache.org/jira/browse/MESOS-1806 as folks have discussed straight up consul integration on that JIRA. - Original Message - From: Aaron Carey aca...@ilm.com To: user@mesos.apache.org Sent: Thursday, March 12, 2015 3:54:52 AM Subject:

Re: how to create rpm package

2015-01-23 Thread Tim St Clair
What's your distro+version? Cheers, Tim - Original Message - From: Yu Wenhua s...@yuwh.net To: user@mesos.apache.org Sent: Friday, January 23, 2015 3:27:36 AM Subject: how to create rpm package Hi, Can anyone tell me how to build a mesos rpm package? So I can deploy it to

Re: Architecture question

2015-01-21 Thread Tim St Clair
@some point I'd hope the litany of existing DAG generators that exist for legacy batch systems would make it's way to support this ecosystem. /me coughs Makeflow, pegasus ... | for that matter, one might redux a high throughput systems in a (Docker) world where NP-hard matching no longer

*namespaces now in Docker for Mesos slave in a container parity.

2015-01-19 Thread Tim St Clair
Greetings folks - All of the namespace work should be in the next release of Docker(1.5?).   This would enable ~feature parity to bare metal on the slave, but it may require some command line magic to enable super privileged containers to behave as expected.     This means you should be able

Re: [HTCondor-users] HTCondor and Mesos

2014-12-08 Thread Tim St Clair
There has been chatter, myself included, but time has been sparse. The approach discussed would be very similar to the YARN on Mesos: https://github.com/mesos/myriad . By querying the schedulers you could elastically provision resources based on load + policy. Cheers, Tim - Original

Re: Rocket

2014-12-03 Thread Tim St Clair
Not to put too fine a point on it, but how are folks planning on establishing governance around the App Container spec? https://github.com/coreos/rocket/issues/193 If the mesos community decides to leverage our own, how do we ensure that we have say in the spec going forwards? Cheers, Tim

Re: Rocket

2014-12-03 Thread Tim St Clair
which should help also being in the loop as well. Relationships alone won't cut it. Friends one day, enemies the next, isn't that the way it worked with Docker...? Governance, such as Apaches model, is of critical importance. Tim On Wed, Dec 3, 2014 at 8:26 AM, Tim St Clair tstcl

Re: Mesos inside Docker

2014-12-02 Thread Tim St Clair
If you're going to want to exercise the namespaces then you'll need to run as super-privledged containers http://developerblog.redhat.com/2014/11/06/introducing-a-super-privileged-container-concept/ Cheers, Tim - Original Message - From: Cody Maloney c...@mesosphere.io To:

Re: Rocket

2014-12-01 Thread Tim St Clair
Absolutely... Cheers, Tim - Original Message - From: Tim Chen t...@mesosphere.io To: dev d...@mesos.apache.org, user@mesos.apache.org Sent: Monday, December 1, 2014 1:10:44 PM Subject: Rocket Hi all, Per the announcement from CoreOS about Rocket (

Re: [RESULT][VOTE] Release Apache Mesos 0.21.0 (rc3)

2014-11-21 Thread Tim St Clair
For those who are interested, I've updated my spec to match and have rebuilt for f21: http://koji.fedoraproject.org/koji/buildinfo?buildID=594867 Same steps apply for those who would like to rebuild for EL7Variants: http://timothysc.github.io/blog/2014/09/08/mesos-breeze/ In the coming

Re: [VOTE] Release Apache Mesos 0.21.0 (rc1)

2014-11-06 Thread Tim St Clair
$ git tag -l | grep 21 $ git branch -r origin/0.21.0-rc1 It looks like you created a branch vs. tag ...? Cheers, Tim - Original Message - From: Ian Downes ian.dow...@gmail.com To: d...@mesos.apache.org, user@mesos.apache.org Sent: Wednesday, November 5, 2014 5:12:52 PM Subject:

0.21.0-pre Spark latest

2014-10-28 Thread Tim St Clair
Folks - We have some automated tests that run the latest Mesos against the latest Spark, and we've run across a series of issues in both fine, and course grained mode that I believe stem from a series of changes in the 0.21 cycle. I'm not certain if anyone owns this integration, but we

Re: 0.21.0-pre Spark latest

2014-10-28 Thread Tim St Clair
/apache/spark/pull/2401 [3]: https://github.com/apache/spark/pull/2453 On Tue, Oct 28, 2014 at 7:46 AM, Tim St Clair tstcl...@redhat.com wrote: Folks - We have some automated tests that run the latest Mesos against the latest Spark, and we've run across a series of issues in both fine

Re: Do i really need HDFS?

2014-10-22 Thread Tim St Clair
If it's locally mounted via fuse then there is no issue. Also there are tickets open about volume mounting in the sandbox, that would be the ideal solution.   Cheers, Tim - Original Message - From: Dick Davies d...@hellooperator.net To: user@mesos.apache.org Sent: Wednesday,

Re: Connecting spark from a different Machine to mesos cluster

2014-10-15 Thread Tim St Clair
Details? 1. What versions are you running? 2. Fine grained mode or Course Gained? 3. Are you running in VM's? Logs always help too. Cheers, Tim - Original Message - From: Johannes Schillinger (Intern) johannes.schillin...@citrix.com To: user@mesos.apache.org Sent: Wednesday,

Re: Network management

2014-10-10 Thread Tim St Clair
openvswitch has fast become the goto answer. https://github.com/GoogleCloudPlatform/kubernetes/blob/master/docs/ovs-networking.md I've not played with this approach myself, as it's not hit my primary use cases. Cheers, Tim - Original Message - From: Kashif Ali

Re: Multiple Network interfaces

2014-10-08 Thread Tim St Clair
Not via mesos directly (at least not that I'm aware of), however it may be possible if you use Docker and do it indirectly by configuring multiple bridge adapters || via ( https://github.com/jpetazzo/pipework ). Another option might be Kube on Mesos, I hear that openvswitch exists under the

Re: Multiple disks with Mesos

2014-10-08 Thread Tim St Clair
+1, stitching can be done outside of mesos prior to init. - Original Message - From: Steven Schlansker sschlans...@opentable.com To: user@mesos.apache.org Sent: Tuesday, October 7, 2014 6:08:21 PM Subject: Re: Multiple disks with Mesos On Oct 7, 2014, at 4:06 PM, Arunabha Ghosh

Re: Release of jesos 1.0 - pure java bindings for Apache Mesos

2014-10-01 Thread Tim St Clair
Thanks Henning! - Original Message - From: Henning Schmiedehausen henn...@schmiedehausen.org To: mesos d...@mesos.apache.org, user@mesos.apache.org Sent: Tuesday, September 30, 2014 10:31:02 PM Subject: Release of jesos 1.0 - pure java bindings for Apache Mesos Hi, I am happy

Re: Mesos 0.20.1 still using -net=host when launching Docker containers

2014-10-01 Thread Tim St Clair
inline below - From: Andy Grove andy.gr...@codefutures.com To: user@mesos.apache.org Sent: Wednesday, October 1, 2014 2:47:54 PM Subject: Mesos 0.20.1 still using -net=host when launching Docker containers Hi, I'm making better progress but have run into another issue that I need help

ApacheCon EU - Mesos Talk

2014-10-01 Thread Tim St Clair
Greetings Folks - I'm on the docket for ApacheCon EU, and was planning on giving a state-of-the-state talk for Mesos seeing how I didn't see others on the schedule. I'd be happy to collaborate on the content if there are certain features folks wanted to highlight, or if you're just

Re: Build on Amazon Linux

2014-09-24 Thread Tim St Clair
1.) What version of Mesos are you running? 2.) What's your version of amazon Linux EL (6|7) based? Cheers, Tim - Original Message - From: John Mickey j...@pithoslabs.com To: user@mesos.apache.org Sent: Wednesday, September 24, 2014 1:23:19 PM Subject: Re: Build on Amazon Linux

Re: Build on Amazon Linux

2014-09-24 Thread Tim St Clair
Thank you again for the responses. What is the option to remove cgroups isolation from the slave start? I ran /usr/local/sbin/mesos-slave --help and do not see an option to remove cgroups isolation from the slave start On Wed, Sep 24, 2014 at 1:48 PM, Tim St Clair tstcl...@redhat.com wrote

Fwd: Running mesos-slave in Docker container

2014-09-23 Thread Tim St Clair
mounted into the mesos container. - Original Message - From: Scott Collier scoll...@redhat.com To: Tim St Clair tstcl...@redhat.com Cc: Fedora Cloud SIG cl...@lists.fedoraproject.org Sent: Tuesday, September 23, 2014 9:37:21 AM Subject: Re: Fwd: Running mesos-slave in Docker

Re: spark and mesos issue

2014-09-16 Thread Tim St Clair
inline - - Original Message - From: CCAAT cc...@tampabay.rr.com To: user@mesos.apache.org Cc: cc...@tampabay.rr.com Sent: Monday, September 15, 2014 5:33:08 PM Subject: Re: spark and mesos issue Hello Brenden/Vinod, Is your installation using systemd ? Has anyone documented

Re: Mesos on Gentoo

2014-09-08 Thread Tim St Clair
Greetings James! This is great to see, also if you're interested feel free to compare notes: http://pkgs.fedoraproject.org/cgit/mesos.git/tree/mesos.spec inline comments below: - Original Message - From: CCAAT cc...@tampabay.rr.com To: user@mesos.apache.org Cc:

Getting Started with Mesos on Fedora 21 and CentOS 7

2014-09-08 Thread Tim St Clair
http://timothysc.github.io/blog/2014/09/08/mesos-breeze/ -- Cheers, Timothy St. Clair Red Hat Inc.

Re: F21 Grand unified .spec - CentOS7.rpm

2014-09-01 Thread Tim St Clair
/ No claims they are any good... yet. Cheers, Tim - Original Message - From: Tim St Clair tstcl...@redhat.com To: mesos-devel d...@mesos.apache.org Cc: user@mesos.apache.org, henn...@groupon.com Sent: Thursday, August 28, 2014 8:44:57 AM Subject: F21 Grand unified .spec - CentOS7

Tachyon on Mesos

2014-08-25 Thread Tim St Clair
system seems like a long term issue that will keep coming up. On Aug 15, 2014 4:02 PM, Tim St Clair tstcl...@redhat.com wrote: The uri doesn't currently start with any of the known types (at least

Re: [VOTE] Release Apache Mesos 0.20.0 (rc2)

2014-08-19 Thread Tim St Clair
./bootstrap ./configure make check '+1 make check' on clean el7 is green However on machines that already have deps installed, my F20 machine: I've seen '[ FAILED ] ExamplesTest.PythonFramework' for a while. Digging I find: Traceback (most recent call last): File

Re: MesosCon attendee introduction thread

2014-08-14 Thread Tim St Clair
I'm Timothy St. Clair (@timothysc), principle software engineer in the office of the CTO @ Red Hat. I've worked on 'schedulers' for many years and if anyone has contributed patches in the last couple of months, 1st beer is on me. ( Jie Yu Vinod get 2). Cheers, Tim - Original Message

Re: Does Mesos support Hadoop MR V2

2014-08-05 Thread Tim St Clair
FWIW - I've been able to setup YARN clusters in containers using bridged networking and relying on zookeeper for Namenode resolution. The problem is - 'bridged networking' = IP-fiasco at scale. However, I still have hopes for MAC VLAN support for Docker:

Re: Mesos language bindings in the wild

2014-07-17 Thread Tim St Clair
have gone on long enough. Looking for ward to feedback. I usually don't tread here, but perhaps a git-submodule works in this narrow case. Thoughts? On Tue, Jul 15, 2014 at 10:07 AM, Tim St Clair tstcl...@redhat.com wrote: Tom - I understand the desire to create bindings outside

Re: Mesos language bindings in the wild

2014-07-17 Thread Tim St Clair
and it was, to be frank, a mess to handle, update and maintain. Yeah... it can become unwieldy. I am rooting for separate repos. Maybe worth a non-binding vote? +1 (provided shared testing). Niklas On 17 July 2014 11:45, Tim St Clair tstcl...@redhat.com wrote: Inline - From: Vladimir

Re: Mesos language bindings in the wild

2014-07-14 Thread Tim St Clair
So I fear the fragmentation that can occur if we provide native bindings outside of the core, unless there is some mechanism for testing, a well established versioning scheme. IMHO, priority inversion on 'versioning' should come before bindings to ensure we adhere to policy. Thoughts?

Re: Mesos language bindings in the wild

2014-07-14 Thread Tim St Clair
/ZKClientBindings So, IMHO, I think it should be the maintainer's responsibility to keep the binding in healthy state, with clear documentation of which version of the mesos core they supports. Yifan On 07/14/2014 11:30 AM, Tim St Clair wrote: So I fear the fragmentation that can occur

Re: mesos isolation

2014-07-11 Thread Tim St Clair
It will also matter if you are using systemd. Cheers, Tim - Original Message - From: Dick Davies d...@hellooperator.net To: user@mesos.apache.org Sent: Friday, July 11, 2014 11:43:36 AM Subject: Re: mesos isolation Are you using cgroups, or the default (posix) isolation?

Re: Mesos language bindings in the wild

2014-07-11 Thread Tim St Clair
+1, esp re: Go. Test harness for language bindings will be pretty important. Cheers, Tim - Original Message - From: Niklas Nielsen nik...@mesosphere.io To: dev d...@mesos.apache.org Cc: user@mesos.apache.org Sent: Thursday, July 10, 2014 5:57:49 PM Subject: Re: Mesos language

kubernetes framework.

2014-06-20 Thread Tim St Clair
Is anyone (working on/thinking about) a kubernetes framework?   It's a masterworker, so it should slot in pretty nicely. -- Cheers, Tim Freedom, Features, Friends, First - Fedora https://fedoraproject.org/wiki/SIGs/bigdata

Re: cgroups memory isolation

2014-06-19 Thread Tim St Clair
at 1:42 PM, Tim St Clair tstcl...@redhat.com wrote: FWIW - There is classic grid mantra that applies here. Test your workflow on an upper bound, then over provision to be safe. Mesos is no different then SGE, PBS, LSF, Condor, etc. Also, there is no hunting algo for jobs, that would

Re: cgroups memory isolation

2014-06-19 Thread Tim St Clair
https://issues.apache.org/jira/browse/MESOS-1516 - Original Message - From: Vinod Kone vinodk...@gmail.com To: user@mesos.apache.org Cc: Ian Downes ian.dow...@gmail.com, Eric Abbott eabb...@hubspot.com Sent: Thursday, June 19, 2014 2:35:20 PM Subject: Re: cgroups memory isolation

Re: Difficulties building libmesos.so

2014-06-19 Thread Tim St Clair
patch tomorrow. https://issues.apache.org/jira/browse/MESOS-1174 Thanks! Sincerely, Alexander Gallego ---*--- --* * * * On Mon, Jun 16, 2014 at 4:49 PM, Tim St Clair tstcl...@redhat.com wrote: Greetings Alexandar - My apologies for my delayed response, I've been inundated

Re: [RESULT][VOTE] Release Apache Mesos 0.18.2 (rc1)

2014-05-19 Thread Tim St Clair
Thanks Niklas - Updated Fedora channels in preparation: http://koji.fedoraproject.org/koji/buildinfo?buildID=516853 Cheers, Tim - Original Message - From: Niklas Nielsen n...@qni.dk To: user@mesos.apache.org, dev d...@mesos.apache.org Sent: Monday, May 19, 2014 3:57:19 PM

Mesos - 0.16.0-rc3 + are now in Fedora Channels.

2014-01-21 Thread Tim St Clair
Greetings Mesos Community - Mesos has been accepted into Fedora channels, and is available in rawhide/F21. http://koji.fedoraproject.org/koji/packageinfo?packageID=17691 I'll be tracking upstream, and if there are others who are interested in contributing to our packaging efforts please feel

Re: run master and slave on same host (just for testing)?

2014-01-15 Thread Tim St Clair
Jim - If you have a Fedora 19/20 machine and are willing to take some prototypes for a test drive. I have packaged .src.rpm available for rebuild: http://tstclair.fedorapeople.org/mesos/ simply `rpmbuild -bb http://tstclair.fedorapeople.org/mesos/mesos-0.16.0-2.d0cb03f.fc21.src.rpm`

Re: mesos and ec2

2013-12-09 Thread Tim St Clair
inline - Original Message - From: Benjamin Hindman benjamin.hind...@gmail.com To: dev d...@mesos.apache.org, user@mesos.apache.org Sent: Monday, December 9, 2013 2:06:36 PM Subject: mesos and ec2 If you don't use Mesos on EC2 then you can likely stop reading this email. When

Re: mesos and ec2

2013-12-09 Thread Tim St Clair
full ref: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AESDG-chapter-instancedata.html - Original Message - From: Tim St Clair tstcl...@redhat.com To: user@mesos.apache.org Cc: dev d...@mesos.apache.org Sent: Monday, December 9, 2013 2:46:46 PM Subject: Re: mesos and ec2

Re: Running Hadoop MRv2 on Mesos

2013-12-06 Thread Tim St Clair
Aaron - You might want to follow up on a thread from July, but I don't know if anything has happened. http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-dev/201307.mbox/%3CCAAD07OLom2SUHBwHKmpQ0YNsQtQTAM9-4igcui%2BrjkJz3XN7jQ%40mail.gmail.com%3E However, imho Spark is now mature