FYI: MesosCon Europe 2015 Schedule & Diversity Scholarship now available

2015-09-17 Thread Michael Hausenblas
Details see: http://mesos.apache.org/blog/mesoscon-europe-2015-schedule-announced/ Hope you can make it to Dublin and share your experience running Mesos as well as learn more about it! Cheers, Michael -- Michael Hausenblas Ireland, Europe http://mhausenblas.info/

mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

2015-09-17 Thread F21
I am building mesos 0.24.0 with the goal to compress the binaries into an archive and distribute them onto other machines to run. Mesos is configured with the following options and then compiled: ./configure CC=gcc-4.8 CXX=g++-4.8 LD_LIBRARY_PATH=/tmp/mesos-build/sasl2/lib

Re: SSL in Mesos 0.23

2015-09-17 Thread Carlos Sanchez
I got back to SSL and made some progress, SSL is enabled now (I think I needed to export the variables in /etc/default/mesos) but I got 2 new problems (described in more detail in https://gist.github.com/carlossg/64c9f8050d637f51c77c ) #1 slaves can't connect to master over SSL, master refuses

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

2015-09-17 Thread haosdent
Does libmesos-0.24.0.so exists in LD_LIBRARY_PATH=/path/to/mesos/lib? On Thu, Sep 17, 2015 at 5:01 PM, F21 wrote: > I am building mesos 0.24.0 with the goal to compress the binaries into an > archive and distribute them onto other machines to run. > > Mesos is configured

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

2015-09-17 Thread F21
Yes, it exists. I can also see a libmesos.so that is symlinked to libmesos-0.24.0.so On 17/09/2015 7:08 PM, haosdent wrote: Does libmesos-0.24.0.so exists in LD_LIBRARY_PATH=/path/to/mesos/lib? On Thu, Sep 17, 2015 at 5:01 PM, F21

Re: Apache Mesos Community Sync

2015-09-17 Thread haosdent
haha, cool. On Thu, Sep 17, 2015 at 11:32 PM, Joris Van Remoortere wrote: > Youtube on-air: http://youtu.be/ZQT6-fw8Ito > Speakers channel: > https://plus.google.com/hangouts/_/hoaevent/AP36tYd59qP_P4ac-NwOI7LztI_hBsku54gXqk1DhFGsKkne_cmByA > > On Mon, Sep 14, 2015 at 7:02

Re: Apache Mesos Community Sync

2015-09-17 Thread Joris Van Remoortere
Youtube on-air: http://youtu.be/ZQT6-fw8Ito Speakers channel: https://plus.google.com/hangouts/_/hoaevent/AP36tYd59qP_P4ac-NwOI7LztI_hBsku54gXqk1DhFGsKkne_cmByA On Mon, Sep 14, 2015 at 7:02 PM, Adam Bordelon wrote: > We'll have the next community sync this Thursday (Sept.

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

2015-09-17 Thread haosdent
How about pass --executor_environment_variables when start slave? I think maybe because LD_LIBRARY_PATH not work. On Thu, Sep 17, 2015 at 5:11 PM, F21 wrote: > Yes, it exists. I can also see a libmesos.so that is symlinked to > libmesos-0.24.0.so > > > On 17/09/2015 7:08

Re: Mesos 0.24.0 with spark in docker - error

2015-09-17 Thread tommy xiao
OK. Rad, i don't think this is caused by docker compatible. 2015-09-17 15:54 GMT+08:00 Rad Gruchalski : > I found a fix. It’s rather obvious: build on the same system you’re going > to deploy to. > Scala Spark Notebook built on 14.04 and running on 14.04 works without any >

Re: Apache Mesos Community Sync

2015-09-17 Thread Adam Bordelon
Today's community sync video/audio is archived at: http://youtu.be/ZQT6-fw8Ito The meeting agenda/notes are available at: https://docs.google.com/document/d/153CUCj5LOJCFAVpdDZC7COJDwKh9RDjxaTA0S7lzwDA/edit?usp=sharing For convenience, today's notes are reproduced below: - 0.21.2-0.24.1

Re: Marathon stable version for Mesos 0.23.0

2015-09-17 Thread Sébastien Kurtzemann
Ok. Thanks for your response Regards, Sébastien Kurtzemann Le 17/09/15 01:37, Radoslaw Gruchalski a écrit : We have run it with 0.23.0 for 2 weeks, now running with 0.24.0. No major issues so far. Chronos also works. Kind regards, Rad Gruchalski On Wed, Sep 16, 2015 at 4:29 PM -0700,

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

2015-09-17 Thread F21
I have that set using the environment variable: MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH": "/path/to/mesos/lib"} However, it doesn't seem to have any effect. On 18/09/2015 12:27 AM, haosdent wrote: MESOS_EXECUTOR_ENVIRONMENT_VARIABLES={"LD_LIBRARY_PATH": "/path/to/mesos/lib"}

Re: Help interpreting output from running java test-framework example

2015-09-17 Thread Marco Massenzio
Hey Stephen, The spark on mesos is twice as fast as yarn on our 20 node cluster. In > addition Mesos is handling datasizes that yarn simply dies on it. But > mesos is still just taking linearly increased time compared to smaller > datasizes. Obviously delighted to hear that, BUT me not much

Building portable binaries

2015-09-17 Thread F21
Is there anyway to build portable binaries for mesos? Currently, I have tried building my own libsvn, libsasl2, libcurl, libapr and then built mesos using the following: ../configure CC=gcc-4.8 CXX=g++-4.8 LD_LIBRARY_PATH=/tmp/mesos-build/sasl2/lib SASL_PATH=/tmp/mesos-build/sasl2/lib/sasl2

Re: Help interpreting output from running java test-framework example

2015-09-17 Thread Stephen Boesch
Compared to Yarn Mesos is just faster. Mesos has a smaller startup time and the delay between tasks is smaller. The run times for terasort 100GB tended towards 110sec median on Mesos vs about double that on Yarn. Unfortunately we require mature Multi-Tenancy/Isolation/Queues support -which is

Re: Building portable binaries

2015-09-17 Thread Alexander Gallego
My build system is a HUGE PITA. Right now it is a set of 77 ansible roles. For configuring. half of them are for mesos. The reason to have ansible do it exactly because of what you are seeing, but it gets more complex for framework authors (combination of operating systems types, versions,

Re: Building portable binaries

2015-09-17 Thread Alexander Gallego
I run a custom build of mesos and it works pretty reliably, so I'll try to share what I do in the hopes that it helps you. The symptom you are seeing of exiting before anything is output to the logs has been usually an issue with the LD_LIBRARY_PATH being screwed up. I would try to ssh into the

Re: Building portable binaries

2015-09-17 Thread F21
Thanks for your pointers! I will give that a try to see if I can track down the problem. Do you mind sharing a bit more about your build process? What do your ./configure flags look like? Also, do you do a `make install` and then package up the contents? Cheers! On 18/09/2015 10:06 AM,

Re: mesos-containerizer: error while loading shared libraries: libmesos-0.24.0.so

2015-09-17 Thread F21
Hey haosdent, I was the one that opened the issue :) On 18/09/2015 1:52 PM, haosdent wrote: Hi, @F21 You problems is similar to https://issues.apache.org/jira/browse/MESOS-3462? I would test it tonight and give you feedback later. On Fri, Sep 18, 2015 at 5:59 AM, F21

Re: Building portable binaries

2015-09-17 Thread CCAAT
First, here is a very cool gentoo vm with btrfs in a raid-one config. https://docs.google.com/document/d/1VJlJyYLTZScta9a81xgKOIBjYsG3_VfxxmUSxG23Uxg/edit?pli=1 I'll clean up the ebuild and post tomorrow. I got an old spark and zookeeper is floating around. I got sidetracked into working on a

Re: Building portable binaries

2015-09-17 Thread James Peach
> On Sep 17, 2015, at 4:33 PM, F21 wrote: > > Is there anyway to build portable binaries for mesos? > > Currently, I have tried building my own libsvn, libsasl2, libcurl, libapr and > then built mesos using the following: > > ../configure CC=gcc-4.8 CXX=g++-4.8 >