Re: Review Request 31444: Support chrooting in MesosContainerizer launch helper.

2015-03-19 Thread James Peach
? It's not at all clear to me how to actually use the --chroot option, though that's probably because I'm a Mesos noob. - James Peach On March 17, 2015, 10:44 p.m., Ian Downes wrote: --- This is an automatically generated e-mail. To reply

Re: Review Request 32694: Set death signal for forked du processes for posix/disk isolator.

2015-04-01 Thread James Peach
think that ``#ifdef PR_SET_PDEATHSIG`` would be better than ``#ifdef __linux__`` since other platforms may implement this prctl() in the future. - James Peach On March 31, 2015, 7:32 p.m., Jie Yu wrote: --- This is an automatically

jira assignments and shepherding

2015-03-24 Thread James Peach
Hi all, I would like to contribute patches for: MESOS-2545 MESOS-2537 Could a committer please assign those to me (my JIRA username is 'jamespeach'). Also, can anyone advise on how to nominate a suitable shepherd? thanks, James

Re: [2/2] mesos git commit: Warn if g++ 4.8 or a C++ standard library is too old for Mesos.

2015-04-26 Thread James Peach
On Apr 25, 2015, at 4:24 PM, b...@apache.org wrote: Warn if g++ 4.8 or a C++ standard library is too old for Mesos. After this a whole bunch more of the C++11 checks can be removed, we can unconditionally use -std=c++11, among other things with this change. Note that we don't

Re: Review Request 33090: Removed unmaintained frameworks code.

2015-04-22 Thread James Peach
``? - James Peach On April 21, 2015, 5:09 p.m., Jiang Yan Xu wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/33090/ --- (Updated

Re: [1/3] mesos git commit: Index slaves by UPID in the master.

2015-05-20 Thread James Peach
On May 19, 2015, at 12:22 PM, bmah...@apache.org wrote: Repository: mesos Updated Branches: refs/heads/master 26091f461 - c24268f13 Index slaves by UPID in the master. Review: https://reviews.apache.org/r/34388 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo

Re: Build failed in Jenkins: mesos-reviewbot #6201

2015-06-04 Thread James Peach
On Jun 4, 2015, at 12:50 PM, Vinod Kone vinodk...@apache.org wrote: On Thu, Jun 4, 2015 at 7:48 AM, Apache Jenkins Server jenk...@builds.apache.org wrote: checking for C++ compiler version... 4.8.2 checking for C++ compiler vendor... (cached) gnu configure: error: GCC 4.8 or higher

Re: soliciting shepherds for auto tools changes

2015-06-03 Thread James Peach
-- Forwarded message -- From: James Peach jpe...@apache.org Date: Fri, May 15, 2015 at 9:28 AM Subject: soliciting shepherds for auto tools changes To: benjamin.mah...@gmail.com, c...@mesosphere.io, tstcl...@redhat.com, benjamin.hind...@gmail.com, vinodk...@gmail.com, mcyp...@gmail.com Hi

Re: soliciting shepherds for auto tools changes

2015-06-04 Thread James Peach
, James Peach jor...@gmail.com wrote: On Jun 3, 2015, at 10:25 AM, Jake Farrell jfarr...@apache.org wrote: Happy to help review and provide feedback on these patches Thanks Jake, does that mean you are shepherding too, or just reviewing? -Jake On Wed, Jun 3, 2015 at 12:21 PM, James

Re: soliciting shepherds for auto tools changes

2015-06-03 Thread James Peach
On Jun 3, 2015, at 10:25 AM, Jake Farrell jfarr...@apache.org wrote: Happy to help review and provide feedback on these patches Thanks Jake, does that mean you are shepherding too, or just reviewing? -Jake On Wed, Jun 3, 2015 at 12:21 PM, James Peach jor...@gmail.com wrote

Re: soliciting shepherds for auto tools changes

2015-06-04 Thread James Peach
On Jun 4, 2015, at 9:33 AM, James Peach jor...@gmail.com wrote: On Jun 4, 2015, at 8:31 AM, Benjamin Hindman b...@eecs.berkeley.edu wrote: Took care of MESOS-2666 as well James. There was a bug I had to fix. ;-) Please take a look at the reviews where I left some comments. Thanks Ben

Re: Update minimum required automake version to 1.13

2015-06-26 Thread James Peach
On Jun 25, 2015, at 11:01 PM, Kapil Arya ka...@mesosphere.io wrote: On Fri, Jun 26, 2015 at 1:38 AM, Benjamin Mahler benjamin.mah...@gmail.com wrote: Taking a step back, it looks like the patches in MESOS-2273 approached the problem assuming 1.13. Have you re-considered how you might

Re: [1/2] mesos git commit: Add CMake logic for building the Stout tests.

2015-07-29 Thread James Peach
On Jul 23, 2015, at 9:21 AM, b...@apache.org wrote: Repository: mesos Updated Branches: refs/heads/master 34c6400f8 - f0ee4aa3d Add CMake logic for building the Stout tests. This project is the first of two commits that will add support for building and running the Stout tests,

Re: Introducing a CMake-based build system for Mesos

2015-07-27 Thread James Peach
On Jul 23, 2015, at 12:40 PM, Alex Clemmer clemmer.alexan...@gmail.com wrote: A fix is up for review here[1]. Thanks again for your feedback, this is very valuable! [1] https://reviews.apache.org/r/36743/ AFAICT this just checks whether the -std=c++11 compiler option is accepted. The

Re: RFC: batch-only allocations

2015-07-27 Thread James Peach
On Jul 27, 2015, at 2:26 PM, Vinod Kone vinodk...@gmail.com wrote: Never mind. Just saw MESOS-3157 OK :) On Mon, Jul 27, 2015 at 2:22 PM, Vinod Kone vinodk...@gmail.com wrote: Can I ask why you want to do this change in the first place? On Mon, Jul 27, 2015 at 2:11 PM, James Peach

RFC: batch-only allocations

2015-07-27 Thread James Peach
Hi all, See MESOS-3157 for more details. I'd like mesos-master to only do resource allocation from the periodic batch callback, never from reviveOffers, addFramework, etc. Can anyone recommend whether this needs to be a configuration option, or whether I can just remove the event-triggered

Re: Prepping for next release

2015-07-21 Thread James Peach
On Jul 21, 2015, at 11:46 AM, Vinod Kone vinodk...@gmail.com wrote: In one of the previous community syncs, we decided to try time based releases (roughly a month apart) going forward since 1) we have enough meaty stuff landing every month and 2) gives users a cadence of releases. How long

RFC: QuiesceOffers message

2015-07-17 Thread James Peach
Hi all, In our Mesos deployment, we end up with a lot of small frameworks ( 200) that hit their targets and have to refuse a lot of unwanted resources. This causes significant performance degradation and unnecessary memory use in the hierarchical allocator. I'm proposing a new QuiesceOffers

Re: RFC: QuiesceOffers message

2015-07-18 Thread James Peach
not sure whether FILTER would be. If you can end up with a lot of filters or if filters are expensive to evaluate then we would end up having the same problems as DECLINE. On Fri, Jul 17, 2015 at 10:30 AM, James Peach jor...@gmail.com wrote: Hi all, In our Mesos deployment, we end up

Re: [mesos][gdb] How to use gdb-mesos-master.sh to debug mesos master code?

2015-07-15 Thread James Peach
On Jul 15, 2015, at 6:31 AM, Guangya Liu gyliu...@gmail.com wrote: Hi Mesos dev: I'm now trying to use gdb-mesos-master.sh to debug mesos master but found that I cannot hit my break point, can someone help to see if there are something wrong with my steps? The following are my steps:

writing a scheduler against the v1 C++ API

2015-10-23 Thread James Peach
Hi all, I was going to kick the tires by trying to write a toy scheduler against the v1 C++ API. Is the v1 API ready enough that that is a reasonable thing to try to do? J

Re: [2/2] mesos git commit: Added JSON parsing for Resources.

2015-11-10 Thread James Peach
> On Nov 9, 2015, at 10:25 AM, m...@apache.org wrote: > > Added JSON parsing for Resources. > > [snip] > http://git-wip-us.apache.org/repos/asf/mesos/blob/62f17731/src/tests/resources_tests.cpp > -- > diff --git

soliciting shepherds

2015-10-29 Thread James Peach
Hi all, Can anyone shepherd the following changes? https://issues.apache.org/jira/browse/MESOS-3605 https://issues.apache.org/jira/browse/MESOS-3602 https://issues.apache.org/jira/browse/MESOS-3725 https://issues.apache.org/jira/browse/MESOS-3708 thanks, James

Re: soliciting shepherds

2015-11-03 Thread James Peach
ache.org/jira/browse/MESOS-3708, can other >> committers pitch in for the other tickets here? >> >> On Thu, Oct 29, 2015 at 8:15 PM, James Peach <jor...@gmail.com> wrote: >> >>> Hi all, >>> >>> Can anyone shepherd the following changes? >&g

Re: shepherd for MESOS-3600

2015-10-08 Thread James Peach
> On Oct 7, 2015, at 10:35 AM, James Peach <jor...@gmail.com> wrote: > > Hi all, > > Can I get a shepherd for MESOS-3600? and also https://issues.apache.org/jira/browse/MESOS-3608 :)

Re: RFC: license headers interfere with doxygen documentation (MESOS-3581)

2015-10-20 Thread James Peach
> On Oct 20, 2015, at 8:55 AM, Bernd Mathiske wrote: > > All, is changing every source code file prohibitive or not? > >> On Oct 20, 2015, at 10:01 AM, Benjamin Bannier >> wrote: >> >> Hi, >> >> I would like to ask for input on how we

shepherd for MESOS-3600

2015-10-07 Thread James Peach
Hi all, Can I get a shepherd for MESOS-3600? thanks

Re: RFC convert documentation to Sphinx

2015-10-06 Thread James Peach
> On Oct 4, 2015, at 5:23 PM, Marco Massenzio wrote: > > +1 for Sphinx > (and RST - *way* better than MD :) > > To do the autoconversion, I've used pandoc [0] in the past and (at least > for me) it worked just fine. > > @James - if you do go ahead with the conversion,

Re: shepherd for MESOS-3600

2015-10-13 Thread James Peach
> On Oct 13, 2015, at 12:50 PM, Till Toenshoff <toensh...@me.com> wrote: > > Hey James, > > I’ll be your host for those :) …. assigned myself. thanks Till > > Thanks for reaching out! > Till > >> On Oct 8, 2015, at 7:19 PM, James Peach <jor...@gm

shared library loading path

2015-10-13 Thread James Peach
Hi all, I tripped over MESOS-3725 shared library loading depends on environment variable updates. Does anyone want to shepherd this or weigh in with any comments on compatibility before I start working on a patch? cheers, James

Re: Quota Design Doc v1

2015-07-08 Thread James Peach
On Jul 4, 2015, at 3:15 AM, Alex Rukletsov a...@mesosphere.com wrote: Folks, Jörg and I are working on adding *quota* support to Mesos. Quota can be described as cluster-wide dynamic reservation. I would like to share the design doc [1] to gather community feedback early in the design

seeking a shepherd for autotools build changes

2015-08-26 Thread James Peach
Hi all, Is anyone willing to shepherd or otherwise provide feedback on MESOS-2537? https://reviews.apache.org/r/33752/ https://reviews.apache.org/r/35084/ https://reviews.apache.org/r/35234/ This improves the --enable-foo handling so that you can safely specify the

Re: brew install mesos doesn't work for 0.24.0

2015-09-14 Thread James Peach
> On Sep 14, 2015, at 4:51 PM, Vinod Kone wrote: > > I do fine libsvn_delta libs in my file system > > ➜ twitter git:(vinod/0.24.0) ✗ sudo find / -name "*svn_delta*" > > Password: > > /Applications/Xcode.app/Contents/Developer/usr/lib/libsvn_delta-1.0.dylib > >

Re: seeking a shepherd for autotools build changes

2015-09-17 Thread James Peach
> On Sep 1, 2015, at 4:02 PM, Vinod Kone <vinodk...@gmail.com> wrote: > > Tim, looks like you already reviewed some of these patches? Do you have > cycles to shepherd this? Is there any interest in this? Should I just close out the JIRA? > > On Wed, Aug 26, 2015 at 1

Re: seeking a shepherd for autotools build changes

2015-09-17 Thread James Peach
lready given a couple of looks, but > he's not (yet) a committer. Maybe a committer can pair with him to review > and land these patches. Thanks Adam. To clarify, I'm totally OK with dropping these, just looking for some guidance :) > On Thu, Sep 17, 2015 at 9:44 AM, James Peach <jor...@gm

RFC convert documentation to Sphinx

2015-10-02 Thread James Peach
Hi all, I'd like to discuss using Sphinx (http://sphinx-doc.org) for the Mesos documentation. Pros: - you can generate HTML docs, PDF, single-page HTML - you can generate man-pages for the user commands - there's more markup - supports indexing, cross-referencing

promises, futures and process::Queue

2015-12-14 Thread James Peach
Hi all, I wrote some test code that was trying to drain a process::Queue. This ended up losing values from the queue, as demonstrated by: TEST(QueueTest, Discard) { Queue q; Future get = q.get(); EXPECT_FALSE(get.isReady()); get.discard(); EXPECT_TRUE(get.hasDiscard());

Re: Exclusive resources proposal

2015-12-15 Thread James Peach
> On Dec 15, 2015, at 1:37 PM, Ian Downes wrote: > > Hello everyone, > > I'd like to propose adding the concept of exclusivity to resources. An > exclusive resource is a) not shared with any other task, b) employs > stronger isolation for more predictable

Re: promises, futures and process::Queue

2015-12-15 Thread James Peach
> On Dec 14, 2015, at 3:51 PM, James Peach <jor...@gmail.com> wrote: > > Hi all, > > I wrote some test code that was trying to drain a process::Queue. This ended > up losing values from the queue, as demonstrated by: > > TEST(QueueTest, Discard) > { >

Re: Using dolt instead of libel when possible

2016-01-05 Thread James Peach
> On Jan 5, 2016, at 12:59 AM, Benjamin Bannier > wrote: > > Hi, > > dolt is a replacement for libtool which promises to fix some performance > issues of libtool, many of which have since dolt’s release landed in some > versions of libtool. Is dolt still

Re: mesos git commit: Fixed posix filesystem isolator to not allow executors with image.

2016-01-06 Thread James Peach
n cause problems especially with > volumes that has images. But if I had the posix disk isolator enabled and happened to use a volume, would my task now fail when it previously did not? > > Tim > > On Wed, Jan 6, 2016 at 7:26 PM, James Peach <jor...@gmail.com> wrote: >&g

Re: mesos git commit: Fixed posix filesystem isolator to not allow executors with image.

2016-01-06 Thread James Peach
Hi Tim, What are the backwards compatibility implications of this? > On Jan 6, 2016, at 6:50 PM, tnac...@apache.org wrote: > > Repository: mesos > Updated Branches: > refs/heads/master c258d8af7 -> 52abf8de3 > > > Fixed posix filesystem isolator to not allow executors with image. > >

Re: mesos git commit: Fixed posix filesystem isolator to not allow executors with image.

2016-01-07 Thread James Peach
ally do >>> anything with volumes with posix filesystem, now we're just making >>> sure we don't allow it since it can cause problems especially with >>> volumes that has images. >> >> But if I had the posix disk isolator enabled and happened to use a v

shepherd for MESOS-3909

2015-12-22 Thread James Peach
Hi all, Can anyone shepherd https://issues.apache.org/jira/browse/MESOS-3909? Mesos modules depend on picojson, which AFAICT is not included in any distributions. This change installs picojson.h if Mesos was built with the bundled picojson (99% of cases IMHO). Even if you bring your own

Re: Dynamic vs. implicit roles

2015-11-30 Thread James Peach
> On Nov 30, 2015, at 6:53 PM, YongQiao Wang wrote: > > Hi All, > > Currently, there are two proposals on how to improve role management in > Mesos: > > (a) Dynamic roles (MESOS-3177): roles are stored in the registry > and queried/added/deleted/removed via HTTP

can anyone shepherd MESOS-3725

2015-11-18 Thread James Peach
Hi all, Can anyone shepherd https://issues.apache.org/jira/browse/MESOS-3725? thanks!

Re: [jira] [Comment Edited] (MESOS-2079) IO.Write test is flaky on OS X 10.10.

2015-11-20 Thread James Peach
sense of the code from [3] and [4]. >>>> >>>> (b) SIGPIPE seems to be more of a legacy mechanism to shut down a set of >>>> piped programs and the general recommendation seems to be to not bother >>>> with it and ignore it. Pro

Re: [4/5] mesos git commit: Replaced strerror calls in libprocess with os::strerror.

2015-11-20 Thread James Peach
> > On Thu, Nov 19, 2015 at 9:18 PM, James Peach <jor...@gmail.com> wrote: > This commit reverts MESOS-3708. Can we please restore the previous ABORT > message? > > > > On Nov 13, 2015, at 9:11 AM, bmah...@apache.org wrote: > > > > Rep

Re: [4/5] mesos git commit: Replaced strerror calls in libprocess with os::strerror.

2015-11-19 Thread James Peach
This commit reverts MESOS-3708. Can we please restore the previous ABORT message? > On Nov 13, 2015, at 9:11 AM, bmah...@apache.org wrote: > > Replaced strerror calls in libprocess with os::strerror. > > Review: https://reviews.apache.org/r/39007 > > > Project:

Re: Slack as the canonical chat channel

2016-06-24 Thread James Peach
Are there public archives of the slack channel > On Jun 24, 2016, at 10:31 AM, Vinod Kone wrote: > > The plan is to open them up to all. Currently, slack has a limitation that > either users have to be invited individually (which doesn't scale) or they > need to belong to

Re: Anonymous Modules "runtime context"

2016-01-11 Thread James Peach
> On Jan 8, 2016, at 9:43 PM, Marco Massenzio wrote: > > Hey folks, > > any takers? > I'd really like to have an initial conversation about MESOS-4253, I think the concept is useful, though I'm not sure that just getting Flags is enough. For example, I think it is

Re: Slave Terminology Rename Proposal

2016-02-12 Thread James Peach
compiled anyway > with the new interface right? > > On Thu, Feb 11, 2016 at 1:24 PM, James Peach <jor...@gmail.com> wrote: > >> >>> On Feb 9, 2016, at 7:23 AM, Diana J Arroyo <darr...@us.ibm.com> wrote: >>> >>> >>> >>> Hello

Re: Slave Terminology Rename Proposal

2016-02-11 Thread James Peach
> On Feb 9, 2016, at 7:23 AM, Diana J Arroyo wrote: > > > > Hello Everyone, > > The initial proposal for the slave to agent rename has been added to the > Epic JIRA item: https://issues.apache.org/jira/browse/MESOS-1478 for your > review. The link to the proposal working

Re: Install some 3rdparty packages needed for building Mesos modules

2016-01-26 Thread James Peach
stalled on the system. >>> >>>> We could also provide "exemplary scripts" that automate (most of) the >>>> tedious work and example build files, alongside documentation. >>>> If folks agree that this is a desirable alternative, I'm happy to help >

Re: Install some 3rdparty packages needed for building Mesos modules

2016-01-27 Thread James Peach
ot; to find incompatible/unexpected versions of >>>>> glog/protobuf/etc. >>>>>> in the /usr/local system dir. >>>>> >>>>> This is the reason why we want to put it inside Mesos "owned" >>>>> directories (e.g., /usr/local/include/me

Re: [jira] [Created] (MESOS-4397) Rename ContainerPrepareInfo to ContainerLaunchInfo for isolators.

2016-02-01 Thread James Peach
This is source incompatible for allocator modules. Can anyone suggest how to build the same allocator module code against multiple Mesos versions? > On Jan 15, 2016, at 9:32 AM, Jie Yu (JIRA) wrote: > > Jie Yu created MESOS-4397: > - > >

Re: [jira] [Created] (MESOS-4397) Rename ContainerPrepareInfo to ContainerLaunchInfo for isolators.

2016-02-01 Thread James Peach
alid virtual process::Future<Option > prepare( ^ src/isolator.cc:184:72: error: template argument 1 is invalid virtual process::Future<Option > prepare( > > - Jie > > On M

Re: [jira] [Created] (MESOS-4397) Rename ContainerPrepareInfo to ContainerLaunchInfo for isolators.

2016-02-01 Thread James Peach
and autoconf my project, but I was hoping to not have to do that for 3 source files :) > The whole point of the recent change is to make sure we don't have to those > ifdef in the future (by using protobufs). > > - Jie > > On Mon, Feb 1, 2016 at 4:50 PM, James Peach <jor...@gmai

Re: [3/3] mesos git commit: Plugged in docker runtime isolator.

2016-02-03 Thread James Peach
> On Feb 3, 2016, at 5:45 PM, ji...@apache.org wrote: > > Plugged in docker runtime isolator. > > Review: https://reviews.apache.org/r/43036/ > > > Project: http://git-wip-us.apache.org/repos/asf/mesos/repo > Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/0b0a3dc5 > Tree:

Re: Experimentation harnesses?

2016-02-22 Thread James Peach
> On Feb 22, 2016, at 11:57 AM, Michael Browning wrote: > > Hi all, > > I was curious if anyone with an active Mesos deployment knows of, has used, > or has developed a harness for integration and exploratory testing against > your installations. The sort of

Re: Install some 3rdparty packages needed for building Mesos modules

2016-01-19 Thread James Peach
> On Jan 19, 2016, at 2:03 PM, Kapil Arya wrote: > > Hi All, > > I wanted to get your opinion on installing the 3rdparty packages glog, > protobuf, boost and picojson[1] when installing Mesos itself. These > packages are required to build Mesos modules. An alternative

Re: [3/3] mesos git commit: New python lib with only the executor driver.

2016-03-14 Thread James Peach
FWIW I bet it would be helpful to have a general-purpose minimal executor library. > On Mar 11, 2016, at 6:55 PM, Benjamin Mahler wrote: > > +vinod > > This breaks the build for me on OS X, it appears this line is the culprit: > > EXTRA_LINK_ARGS = ['-Wl,--as-needed']

Re: Upgrade to clang-format-3.8

2016-03-19 Thread James Peach
> On Mar 17, 2016, at 10:41 AM, Yong Tang wrote: > > Hi All > > > This email is to announce that the default configuration and the recommended > version of the clang-format is being upgraded to 3.8 (from 3.5) in mesos. > > > In clang-format-3.8, the newly

Re: [02/11] mesos git commit: Added support for contender and detector modules.

2016-04-07 Thread James Peach
> On Apr 6, 2016, at 3:48 PM, ka...@apache.org wrote: > > Added support for contender and detector modules. > > > http://git-wip-us.apache.org/repos/asf/mesos/blob/cbbc8f0b/src/tests/module.cpp > -- > diff --git

Re: [Proposal] Remove the default value for agent work_dir

2016-04-12 Thread James Peach
> On Apr 12, 2016, at 3:58 PM, Greg Mann wrote: > > Hey folks! > A number of situations have arisen in which the default value of the Mesos > agent `--work_dir` flag (/tmp/mesos) has caused problems on systems in which > the automatic cleanup of '/tmp' deletes agent

Re: Compile with CFLAGS=-DWITH_NETWORK_ISOLATOR

2016-03-22 Thread James Peach
> On Mar 22, 2016, at 6:21 AM, Jay Guo wrote: > > Hi, > > I got error trying to compile Mesos > on Ubuntu > with CFLAG WITH_NETWORK_ISOLATOR > > Here's what I did: > 1. apt-get install libnl-dev > 2. ./bootstrap > 3. mkdir build && cd build > 4.

Re: Upgrade to clang-format-3.8

2016-03-21 Thread James Peach
rom > both sides to get that percentage higher (new features in clang-format + > modifying our style), and we'll continue > to make such efforts where it makes sense. > > MPark > > On 18 March 2016 at 12:45, James Peach <jor...@gmail.com> wrote: > >&

Re: Mesos Documentation Project

2016-11-09 Thread James Peach
> On Nov 9, 2016, at 4:29 PM, James Neiman wrote: > > Dear Mesos Users, Operators, Developers, and Contributors: > > My name is James Neiman. I have been working with Benjamin Hindman, Artem > Harutyunyan, Neil Conway, and Joseph Wu on improving the Mesos >

Re: Attendance for Mesos Developer Community Meeting (Nov 17)

2016-11-16 Thread James Peach
> On Nov 16, 2016, at 3:06 PM, Michael Park wrote: > > If you're planning to attend this meeting, please reply to this before Nov > 17 8am PST. If there are less than 5 people planning to attend (including > me), we'll skip it. +1 > > On Wed, Nov 16, 2016 at 11:02 AM,

Re: MESOS-6233 Allow agents to re-register post a host reboot

2016-11-29 Thread James Peach
> On Nov 28, 2016, at 6:09 PM, Yan Xu wrote: > > So one thing that was brought up during offline conversations was that if the > host reboot is associated with hardware change (e.g., a new memory stick): > > • Currently: the agent would skip the recovery (and the

Re: Building on OS X 10.12

2016-12-05 Thread James Peach
> On Dec 2, 2016, at 10:54 PM, Jie Yu wrote: > > Another tip. If you are on macOS sierra, you might notice the linking is > extremely slow using the default clang. > > Using CXXFLAGS `-fvisibility-inlines-hidden` will greatly speedup the > linking. Is there a reason we

Re: Structured logging for Mesos (or c++ glog)

2016-12-19 Thread James Peach
> On Dec 19, 2016, at 9:43 AM, Zhitao Li wrote: > > Hi, > > I'm looking at how to better utilize ElasticSearch to perform log analysis > for logs from Mesos. It seems like ElasticSearch would generally work better > for structured logging, but Mesos still uses glog

Re: thread_local supported on Apple

2016-12-19 Thread James Peach
> On Dec 19, 2016, at 3:00 PM, Joris Van Remoortere wrote: > > Thanks for your input Zameer. > > Is it common for developers on mac to use XCode as their compilation > environment as well? I would think if you used clang on the command line > then you could still install

Re: protbuf to json not compatible

2017-03-23 Thread James Peach
> On Mar 23, 2017, at 7:58 PM, James Peach <jor...@gmail.com> wrote: > >> >> On Mar 23, 2017, at 1:54 AM, Olivier Sallou <olivier.sal...@irisa.fr> wrote: >> >> Hi, >> >> when transforming a protobug message to json with MessageToJs

Re: protbuf to json not compatible

2017-03-23 Thread James Peach
> On Mar 23, 2017, at 1:54 AM, Olivier Sallou wrote: > > Hi, > > when transforming a protobug message to json with MessageToJson, the > json is not compatible with the json format expected by Mesos master. This is because you generated the protobuf bindings with

Re: protbuf to json not compatible

2017-03-24 Thread James Peach
't use > strings on the output side). > > On Fri, Mar 24, 2017 at 12:44 AM, Olivier Sallou <olivier.sal...@irisa.fr> > wrote: > >> >> >> On 03/24/2017 04:02 AM, James Peach wrote: >>>> On Mar 23, 2017, at 7:58 PM, James Peach <jor...

RFC: constraining UPIDs in libprocess messages

2017-04-05 Thread James Peach
Hi all, Currently, libprocess messages contain a UPID, which is send by the peer in the HTTP message header. There's no validation of this, so generally messages are trusted to be from the UPID they claim to be. As an RFC, I've pushed https://reviews.apache.org/r/58224/. This patch constrains

Re: RFC: constraining UPIDs in libprocess messages

2017-04-20 Thread James Peach
really just one type of a multi-homed host configuration, so it demonstrates that this configuration will break. > > E.g. how does this affect the use of proxies, multihomed hosts, our testing > facilities for message spoofing, etc. > > On Tue, Apr 18, 2017 at 2:07 PM, James Peach <j

Re: One question about src/Makefile.am

2017-03-13 Thread James Peach
> On Mar 13, 2017, at 9:20 AM, Yu Wei wrote: > > Hi guys, > > > In src/Makefile.am, there is two lines as below, > > MESOS_CPPFLAGS += -I$(top_srcdir)/include > MESOS_CPPFLAGS += -I../include This one refers to the directory you are building in, which might not be the

Re: RFC: constraining UPIDs in libprocess messages

2017-04-07 Thread James Peach
rks for the case where UPID is a unix address in the future? For > instance, what will `socket->peer();` returns for domain socket? I can look into that. So you would consider this approach a reasonable mitigation? > > - Jie > > On Wed, Apr 5, 2017 at 3:27 PM, James Peach <jor...@

Re: RFC: constraining UPIDs in libprocess messages

2017-04-18 Thread James Peach
views.apache.org/r/58517/). Is anyone able to shepherd this? > > - Jie > > On Fri, Apr 7, 2017 at 8:37 AM, James Peach <jor...@gmail.com> wrote: > >> >>> On Apr 5, 2017, at 5:42 PM, Jie Yu <yujie@gmail.com> wrote: >>> >>> One com

Re: Future Mesos Developer Community Meetings

2017-08-10 Thread James Peach
> On Aug 9, 2017, at 10:58 AM, Michael Park wrote: > > A few announcements here: > > - I'll no longer be hosting Mesos Developer Community Meetings going > forward. There's a lot of work involved in hosting/running good meetings. I > feel that I have not been putting

how to wait for nested container launch in tests

2017-06-30 Thread James Peach
Hi all, I'm trying to write a nested container test for an isolator. It turns out that the default executor sends TASK_RUNNING immediately after receiving the LAUNCH_NESTED_CONTAINER response. However, at this time the nested container is not actually up, and the command specified in the task

Re: how to wait for nested container launch in tests

2017-07-01 Thread James Peach
> On Jun 30, 2017, at 11:23 AM, Jie Yu <yujie@gmail.com> wrote: > > One way is to define a health check? Good idea, I'll give that a crack > > - Jie > > On Fri, Jun 30, 2017 at 3:36 AM, James Peach <jor...@gmail.com> wrote: > >> Hi all, >>

seeking shepherd for MESOS-7675 (network ports isolator)

2017-07-03 Thread James Peach
Hi all, I'm looking for a shepherd for https://issues.apache.org/jira/browse/MESOS-7675, which implements a network/ports isolator for ensuring correct ports resource usage on the host network. thanks, James

Re: Metrics for committing code for contributors

2017-07-03 Thread James Peach
> On Jul 1, 2017, at 1:07 AM, Benjamin Mahler wrote: [snip] > I know reviewing code from newer contributors is often hard work and can > sometimes be thankless, but it's really important. So I just wanted to > celebrate and thank all those that have helped to grow the

Re: RFC: removing process implementations from common headers

2017-06-28 Thread James Peach
er to be within the src/ > directory? There are 2 options for libprocess. Put the internal headers in the src/ directory, or keep them in include/ but don't install them (use noinst_HEADERS). The former gives better protection against accidentally consuming the internal headers from Mesos. >

Re: RFC: constraining UPIDs in libprocess messages

2017-04-26 Thread James Peach
What will libprocess do when it finds the IP doesn't match? Drop and > log? It responds with an InternalServerError. > > On Thu, Apr 20, 2017 at 9:16 AM, James Peach <jor...@gmail.com> wrote: > >> >>> On Apr 19, 2017, at 5:24 PM, Benjamin Mahler <bmah...@apache

documenting test expactations

2017-04-29 Thread James Peach
Hi all, In a couple of reviews, I've been asked to avoid emitting explanatory messages from the EXPECT() macro. The rationale for this is that tests usually use comments. However, I think that emitting the reason for a failed expectation into the test log is pretty helpful and we should do it

Re: Deprecating `--disable-zlib` in libprocess

2017-08-08 Thread James Peach
> On Aug 8, 2017, at 10:57 AM, Chun-Hung Hsiao wrote: > > Hi all, > > In libprocess, we have an optional `--disable-zlib` flag, but it's > currently not used > for conditional compilation and we always use zlib in libprocess, > and there's a requirement check in Mesos to

Re: [Proposal] Use jemalloc as default memory allocator for Mesos

2017-08-18 Thread James Peach
> On Aug 18, 2017, at 3:49 AM, Benno Evers wrote: > > Hi all, > > I would like to propose bundling jemalloc as a new dependency > under `3rdparty/`, and to link Mesos against this new memory > allocator by default. I support doing this for all the Mesos executable

Re: An independent server communicating between master and client

2017-06-21 Thread James Peach
> On Jun 20, 2017, at 11:23 AM, Wenzhao Zhang wrote: > > Hello, All: > > I'm working on an independent server, which should be able to talk to the > master via HTTP POST requests. > I setup a Jersey REST server. My initial plan is to use *JSON/XML* to map > Entities, as

RFC: removing process implementations from common headers

2017-06-23 Thread James Peach
Hi all, There is a common Mesos pattern where a subsystem is implemented by a facade class that forwards calls to an internal Process class, eg. Fetcher and FetcherProcess, or zookeeper::Group and zookeeper::GroupProcess. Since the Process is an internal implementation detail, I'd like to

Re: Isolating metrics collection from master/agent slowness

2017-05-22 Thread James Peach
> On May 19, 2017, at 11:35 AM, Zhitao Li wrote: > > Hi, > > I'd like to start a conversation to talk about metrics collection endpoints > (especially `/metrics/snapshot`) behavior. > > Right now, these endpoints are served from the same master/agent's > libprocess, and

Re: New YouTube channel to house working group recordings?

2017-05-18 Thread James Peach
> On May 18, 2017, at 4:53 PM, Michael Park wrote: > > Is there a reason why you want to use new YouTube channel? I think I would > prefer to use the existing channel and house them in a different playlist. Is there a link to this from mesos.apache.org? I couldn't find one

Re: Added task status update reason for health checks

2017-05-22 Thread James Peach
> On May 22, 2017, at 5:28 AM, Andrei Budnik wrote: > > Hi All, > > The new reason is REASON_TASK_HEALTH_CHECK_STATUS_UPDATED. > The corresponding ticket is https://issues.apache.org/jira/browse/MESOS-6905 Is there any documentation about how executors ought to use this

Re: Work group on Community

2017-06-16 Thread James Peach
> On Jun 15, 2017, at 10:57 AM, Vinod Kone wrote: > > Hi folks, > > Seeing that our first official containerizer WG is off to a good start, we > want to use that momentum to start new WGs. > > I'm proposing that we start a new work group on community. The mission of >

Re: documenting test expactations

2017-05-08 Thread James Peach
plaining > what the test is doing, then I tend to ignore it and read the test instead, > so it would be helpful to discuss some examples to get a better sense. :) > > On Sat, Apr 29, 2017 at 10:02 AM, James Peach <jor...@gmail.com> wrote: > >> Hi all, >> >> I

Re: Choice between LOG(FATAL) and EXIT(EXIT_FAILURE)

2017-05-08 Thread James Peach
> On May 8, 2017, at 2:02 PM, Zhitao Li wrote: > > Hi Vinod, > > I'm reviving this old conversation from last year. > > We are feeling some operational pain again, mostly due to journald > truncates the stderr of Mesos agent so we cannot see a full exit message > even

Re: Sending TASK_STARTING in the built-in executors

2017-08-23 Thread James Peach
> On Aug 23, 2017, at 2:38 AM, Benno Evers wrote: > > Hi all, > > when starting a task, an executor can send out the following status updates: > > - [optional] TASK_STARTING: Sent by the executor when it received the > launch command > - TASK_RUNNING: Sent by the

  1   2   >