Re: Review Request 22066: Added timeout to rescind unused offers

2014-08-12 Thread Benjamin Mahler
Hey Kapil, it looks like Tim had been following up with a separate review for this: https://reviews.apache.org/r/22796/ On Mon, Aug 11, 2014 at 8:09 PM, Mesos ReviewBot dev@mesos.apache.org wrote: --- This is an automatically generated

Re: 4.8.0 Cxx11 compilation issue

2014-08-12 Thread Benjamin Mahler
Just curious, do you see this with gcc 4.8.1 / 4.8.2 or only with 4.8.0? On Tue, Aug 12, 2014 at 3:07 PM, Chinmaya Manjunath chinm...@hedviginc.com wrote: Hello Guys: I am trying to build mesos on Centos6.5 and 4.8.0 g++ and am hitting the following issue, help is appreciated. Thanks!

Re: 4.8.0 Cxx11 compilation issue

2014-08-12 Thread Benjamin Mahler
this. Would think that it could happen with 4.8.1 as well. This error disappears if I configure without cxx11 support, but I see that it is a deprecated setting. Benjamin Mahler benjamin.mah...@gmail.com August 12, 2014 4:05 PM Just curious, do you see this with gcc 4.8.1 / 4.8.2 or only

Re: RB 2.0.5

2014-08-14 Thread Benjamin Mahler
Thanks Jake! On Wed, Aug 13, 2014 at 9:07 PM, Vinod Kone vinodk...@gmail.com wrote: Thanks to Jake Farrell, we now have an upgraded RB server (1.6.x to 2.0.x)! Apart from the UI flourishes, the thing I'm excited about is that this should fix our long standing problem of review updates

Design Review: Maintenance Primitives

2014-08-25 Thread Benjamin Mahler
Hi all, I wanted to take a moment to thank Alexandra Sava, who completed her OPW internship this past week. We worked together in the second half of her internship to create a design document for maintenance primitives in Mesos (the original ticket is MESOS-1474

Re: Design Review: Maintenance Primitives

2014-08-26 Thread Benjamin Mahler
even when the deadline has passed if tasks are still running? This is not explicit in the document and we want to make sure operators have the information about this and could avoid unfortunate rolling restarts. On Aug 25, 2014 9:25 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: Hi all

Re: Shutdown by timeout in mesos

2014-09-02 Thread Benjamin Mahler
Are you still wondering about this? ShutdownProcess is inside the libmesos executor driver and ensures that we forcibly shutdown an executor if it doesn't comply with the shutdown request within the timeout. The second bullet in your list is the Command Executor, which is the executor that is

Re: Design Review: Maintenance Primitives

2014-09-02 Thread Benjamin Mahler
a link between a previous offerID and this but then I saw the Resource field. Wouldn't it be clearer to have InverseOfferID? Thanks for the work! I really want to have these primitives. On Aug 26, 2014 10:59 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: You're right, we don't account

Re: Shutdown by timeout in mesos

2014-09-02 Thread Benjamin Mahler
the same thing: after a certain timeout perform hard shutdown. Maybe it makes sense to choose one approach and apply it everywhere for consistency? On Tue, Sep 2, 2014 at 8:56 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: Are you still wondering about this? ShutdownProcess

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #2379

2014-09-03 Thread Benjamin Mahler
+jake Are we able to install libcurl on this machine? On Wed, Sep 3, 2014 at 2:54 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/2379/changes Changes: [bmahler] Count pending tasks as

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #2380

2014-09-04 Thread Benjamin Mahler
Alright, I'm going to remove the H11 slave from the label expression to cut the noise. Filed a ticket for getting libcurl installed: https://issues.apache.org/jira/browse/INFRA-8308 On Thu, Sep 4, 2014 at 4:59 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See

Re: [jira] [Resolved] (MESOS-1740) Bad error message when docker containerizer isn't enabled

2014-09-11 Thread Benjamin Mahler
Can you include the commit log for this change in the ticket? Makes it easier to do cherry picking, especially since this one is going in 0.20.1. On Thu, Sep 11, 2014 at 12:01 PM, Timothy Chen (JIRA) j...@apache.org wrote: [

0.20.1 Release Manager

2014-09-11 Thread Benjamin Mahler
Do we have a volunteer to be the 0.20.1 release manager? Looks like a number of tickets are being added at this point for 0.20.1: https://issues.apache.org/jira/issues/?jql=project%20%3D%20MESOS%20AND%20%22Target%20Version%2Fs%22%20%3D%200.20.1

Re: 0.20.1 Release Manager

2014-09-12 Thread Benjamin Mahler
, anyone volunteer for the release manager? - Jie On Thu, Sep 11, 2014 at 6:04 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: Do we have a volunteer to be the 0.20.1 release manager? Looks like a number of tickets are being added at this point for 0.20.1: https://issues.apache.org

Re: Completed tasks remains in TASK_RUNNING when framework is disconnected

2014-09-15 Thread Benjamin Mahler
To ensure that the architecture of mesos remains a scalable one, we want to persist state in the leaves of the system as much as possible. This is why the master has never persisted tasks, task states, or status updates. Note that status updates can contain arbitrarily large amounts of data at the

Re: Completed tasks remains in TASK_RUNNING when framework is disconnected

2014-09-15 Thread Benjamin Mahler
On Mon, Sep 15, 2014 at 3:11 PM, Niklas Nielsen nik...@mesosphere.io wrote: Thanks for your input Ben! (Comments inlined) On 15 September 2014 12:35, Benjamin Mahler benjamin.mah...@gmail.com wrote: To ensure that the architecture of mesos remains a scalable one, we want to persist

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2374

2014-09-16 Thread Benjamin Mahler
+Tim Chen Can you take a look at the health check failure? https://issues.apache.org/jira/browse/MESOS-1802 I'll take a look at the Registrar test: https://issues.apache.org/jira/browse/MESOS-1803 On Tue, Sep 16, 2014 at 4:01 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See

Re: [jira] [Resolved] (MESOS-1809) Modify docker pull to use docker inspect after a successful pull

2014-09-18 Thread Benjamin Mahler
Please include the commit log guys, makes cherry picking so much easier! Sent from my iPhone On Sep 18, 2014, at 2:08 PM, Timothy Chen (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/MESOS-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2390

2014-09-23 Thread Benjamin Mahler
Adding google test's xml output, sorry for the noise. Might be a bit more noise coming. On Tue, Sep 23, 2014 at 7:43 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See

Jenkins Test Results

2014-09-24 Thread Benjamin Mahler
I added google test's xml output into a post-build step on Jenkins, you can see the slowest tests if you sort the time column: https://builds.apache.org/view/M-R/view/Mesos/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/2391/testReport/(root)/ Ian's reaper

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME #2123

2014-09-24 Thread Benjamin Mahler
Nope, will fix this. On Wed, Sep 24, 2014 at 2:18 PM, Vinod Kone vinodk...@gmail.com wrote: ben is this expected? On Wed, Sep 24, 2014 at 1:34 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See

Re: Build failed in Jenkins: Mesos-Ubuntu-distcheck #355

2014-09-24 Thread Benjamin Mahler
Fixed. On Wed, Sep 24, 2014 at 2:25 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Ubuntu-distcheck/355/changes Changes: [yujie.jay] Added support for getting socket diagnosis information. --

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2397

2014-09-29 Thread Benjamin Mahler
Looks like a stall of the disk FWICT, I will bump the store timeout up from 5 seconds to 10 seconds to match the rest of our tests. On Sun, Sep 28, 2014 at 1:05 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2397

2014-09-29 Thread Benjamin Mahler
https://reviews.apache.org/r/26141/ On Mon, Sep 29, 2014 at 11:14 AM, Benjamin Mahler benjamin.mah...@gmail.com wrote: Looks like a stall of the disk FWICT, I will bump the store timeout up from 5 seconds to 10 seconds to match the rest of our tests. On Sun, Sep 28, 2014 at 1:05 PM, Apache

Re: scheduler.killExecutor()

2014-09-30 Thread Benjamin Mahler
Why can't the executor just commit suicide if all running tasks are killed? If you're simultaneously launching two tasks for each executor, you'll only see this race if you kill very quickly after launching. Your scheduler is informed when both tasks are running as well, so that could gate the

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2408

2014-10-01 Thread Benjamin Mahler
https://issues.apache.org/jira/browse/MESOS-1854 On Tue, Sep 30, 2014 at 6:29 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/2408/changes Changes: [yujie.jay]

Re: Review Request 26199: Eliminated redundant resource accounting in the master.

2014-10-01 Thread Benjamin Mahler
A bit worried that slave-resources() could be confused with slave-info.resources(). Maybe slave-allocated() feels better to you? Callers will have the type available at the call-site, since we have static typing to force them to understand what type is being returned: hashmapFrameworkID,

Re: Build failed in Jenkins: mesos-reviewbot #1900

2014-10-08 Thread Benjamin Mahler
+Kapil, benh Can you guys take a look? Kapil, can you use the pre-commit hook to catch this kind of error? http://mesos.apache.org/documentation/latest/mesos-developers-guide/ https://github.com/apache/mesos/blob/master/support/hooks/pre-commit#L10 On Wed, Oct 8, 2014 at 4:32 PM, Apache Jenkins

Re: Large changes on the codebase due to MESOS-1872

2014-10-15 Thread Benjamin Mahler
- almost all existing RRs will possibly get invalid Why is that Till? Are you thinking of merge conflicts? If you work in a function that can get cleaned up, clean it up. Maybe clean up the entire file if you're making changes to multiple functions. But please separate the patches. :) git

Re: [2/2] git commit: Minor style fix from https://reviews.apache.org/r/25184/

2014-10-15 Thread Benjamin Mahler
Are you using the git commit hook in support/? Sent from my iPhone On Oct 15, 2014, at 12:14 PM, tstcl...@apache.org wrote: Minor style fix from https://reviews.apache.org/r/25184/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

Re: updating website copy

2014-10-15 Thread Benjamin Mahler
Bump. :) I would also like to see the Features list updated: -Slaves in mesos are fault tolerant as well. (we only say the master is fault tolerant in the copy). -Should we highlight Docker support? -Containerization and Isolation are now flexible and pluggable. -Resource monitoring. -We're also

Re: Review Request 26951: Add dispatch and http request event counters to Scheduler driver

2014-10-21 Thread Benjamin Mahler
Shouldn't we only expose meaningful metrics? Not sure whether users of the driver need consistent metrics vs master at the cost of having a meaningless one. Up to you. Sent from my iPhone On Oct 21, 2014, at 9:46 AM, Dominic Hamon dha...@twopensource.com wrote: On Oct. 20, 2014, 6:07

Cutting 0.21.0.

2014-10-21 Thread Benjamin Mahler
Hi all, We would like to cut 0.21.0 very soon to release the task reconciliation work that has been completed recently. I spoke with Ian Downes who was willing to be the release manager. I will let him reply here with a ticket and with other features that have made it in the 0.21.0 release.

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2473

2014-10-23 Thread Benjamin Mahler
Taking a look. On Wed, Oct 22, 2014 at 4:50 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/2473/changes Changes: [dhamon] Differentiate between slave and offer

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2473

2014-10-23 Thread Benjamin Mahler
() @ 0x490aca main @ 0x2b891a707ec5 (unknown) @ 0x49dfa8 (unknown) On Thu, Oct 23, 2014 at 11:15 AM, Benjamin Mahler benjamin.mah...@gmail.com wrote: Taking a look. On Wed, Oct 22, 2014 at 4:50 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See

Re: Mesos default build flags

2014-10-23 Thread Benjamin Mahler
Fantastic, just one question: Still a bit confused about -g1. From the GCC page, it seems to say that -g1 provides line number tables, is that not the case for the backtraces from glog? Does -g1 have any impact on line numbers within a core dump?

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2488

2014-10-26 Thread Benjamin Mahler
+Cody Hm.. this test failure used to dump a pure virtual stack trace (see below for example). Did we lose that cody? Any clue why there's no stacktrace now for the segfault? F0910 19:26:51.395694 16920 logging.cpp:57] RAW: Pure virtual method called @ 0x2ba2cbfc59bd

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #2495

2014-10-27 Thread Benjamin Mahler
+timchen, benh Hey guys, looks like these are too new, can we guard the svn.hpp calls with #ifdefs based on the svn version? Looks pretty easy: https://subversion.apache.org/docs/api/1.7/svn__version_8h.html On Mon, Oct 27, 2014 at 10:46 AM, Apache Jenkins Server jenk...@builds.apache.org

Re: Review Request 27243: Support both 1.8+ and earlier versions of svn library

2014-10-27 Thread Benjamin Mahler
, and if it's not svndiff2 (by checking for 1.4) then I'm not sure what that is. Tim On Mon, Oct 27, 2014 at 4:14 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: What's the harm? We pass 0 anyway for the version argument, which svn_txdelta_to_svndiff2 is making explicit. On Mon, Oct 27

Re: git commit: Add --enable-debug and --enable-optimize flag for controlling building debug and optimized verisons of libprocess

2014-10-28 Thread Benjamin Mahler
We try to keep the commit messages short: *5) Follow the format of commit messages. The three important bits are (a) be clear and explicit in the commit message and (b) include the link to the review and © use 72 character columns. See support/apply-review.sh for committing someone else’s code

Re: git commit: Add --enable-debug and --enable-optimize flag for controlling building debug and optimized verisons of libprocess

2014-10-28 Thread Benjamin Mahler
had ran support/apply-review.sh and had not trim'd the commit message. -Tim - Original Message - From: Benjamin Mahler benjamin.mah...@gmail.com To: dev dev@mesos.apache.org Cc: comm...@mesos.apache.org Sent: Tuesday, October 28, 2014 4:38:49 PM Subject: Re: git

Re: Review Request 15285: stringify() for flag values.

2013-12-10 Thread Benjamin Mahler
Thanks! On Tue, Dec 10, 2013 at 12:30 PM, Niklas Nielsen n...@qni.dk wrote: On Dec. 10, 2013, 7:36 p.m., Ben Mahler wrote: Hey Nik, it appears this broke 'make distcheck' because the stringifier file was not added to src/Makefile.am, can you send out a fix? Shoot - sorry about that.

Re: Questions about Executor

2013-12-20 Thread Benjamin Mahler
+dev This is a great question for the mailing list. Things have changed a little bit since Vinod and I first wrote the Hadoop port, but my answers here should still be valid. First, in using Mesos with Hadoop, why does every task in Mesos need to launch a TaskTracker ? Why not just launch one

Re: [VOTE] Release Apache Mesos 0.15.0 (rc5)

2014-01-08 Thread Benjamin Mahler
+1: make check passing on OS X 10.8 and CentOS 5.5. On Wed, Jan 8, 2014 at 9:08 AM, Chris Mattmann mattm...@apache.org wrote: +1 from me. SIGS pass, CHECKSUMS pass: [chipotle:~/tmp/apache-mesos-0.15.0-rc5] mattmann% $HOME/bin/stage_apache_rc mesos 0.15.0

Distcc on Mesos.

2014-01-10 Thread Benjamin Mahler
I wrote a simple a simple framework for doing distributed C++ compilation through distcc: https://github.com/mesos/mesos-distcc Distcc is a distributed C++ compiler hosted here: https://code.google.com/p/distcc/ The mesos-distcc tool will dynamically create a distcc cluster for the duration of

Re: Question about resource allocator

2014-01-13 Thread Benjamin Mahler
Hi Huojing, Can you provide more information? What in particular has not been very suitable with DRF? I ask because with the current implementation of DRF, one has to make use of reservations to ensure fairness. This is because we do not have revocation of offers implemented, and so a greedy

Re: [jira] [Created] (MESOS-933) AllocatorZooKeeperTest/0.SlaveReregistersFirst runs forever.

2014-01-21 Thread Benjamin Mahler
Is this related to MESOS-928? On Tue, Jan 21, 2014 at 9:04 AM, Jie Yu (JIRA) j...@apache.org wrote: Jie Yu created MESOS-933: Summary: AllocatorZooKeeperTest/0.SlaveReregistersFirst runs forever. Key: MESOS-933

Re: Review Request 17130: Removal of --without-curl

2014-01-22 Thread Benjamin Mahler
Sounds good On Wed, Jan 22, 2014 at 11:45 AM, Timothy St. Clair tstcl...@redhat.comwrote: On Jan. 22, 2014, 7:41 p.m., Ben Mahler wrote: Hey Tim, this looks good. I'm just wondering about the checks for libcrypto and libssl, do we need to check for these? Wouldn't checking for

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #1849

2014-01-22 Thread Benjamin Mahler
Have a fix incoming shortly. On Wed, Jan 22, 2014 at 2:01 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: This was me, taking a look. On Wed, Jan 22, 2014 at 1:57 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #1850

2014-01-22 Thread Benjamin Mahler
Apologies for the hiccup, fix has been committed to master. On Wed, Jan 22, 2014 at 2:04 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/1850/changes Changes: [bmahler] Added another

Re: git commit: Updated upgrades.md for 0.15.0 - 0.16.0.

2014-01-22 Thread Benjamin Mahler
Maybe in the future we should provide some of the reasoning as well so that we can remember why this particular upgrade order was needed. :) On Wed, Jan 22, 2014 at 4:22 PM, vinodk...@apache.org wrote: Updated Branches: refs/heads/master 586e7eb65 - 1acb9e804 Updated upgrades.md for

Re: Review Request 17474: Updated the CHANGELOG for 0.17.0.

2014-01-30 Thread Benjamin Mahler
Cool, blog post would be great! I would also encourage you to write documentation for the docs/ folder to help those who want to learn more about the replicated log, and how to use it. On Thu, Jan 30, 2014 at 11:57 AM, Jie Yu yujie@gmail.com wrote: Good question! What about a blog post?

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #1863

2014-01-31 Thread Benjamin Mahler
Looks like my zombie check caught an un-reaped executor! Will file a ticket. On Fri, Jan 31, 2014 at 3:07 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/1863/changes

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #1865

2014-02-03 Thread Benjamin Mahler
Commented on MESOS-960. On Mon, Feb 3, 2014 at 11:00 AM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/1865/changes Changes: [dlester] Adds Medidata Solutions to

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui #1867

2014-02-03 Thread Benjamin Mahler
I have a fix out for this, see MESOS-960. On Mon, Feb 3, 2014 at 1:08 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Disable-Java-Disable-Python-Disable-Webui/1867/

Re: [VOTE] Release Apache Mesos 0.16.0 (rc5)

2014-02-04 Thread Benjamin Mahler
Looks like we the 'm4' directory in stout was not added to the distribution: $ ./bootstrap ... m4/acx_pthread.m4:363: ACX_PTHREAD is expanded from... configure.ac:87: the top level autoreconf: configure.ac: adding subdirectory 3rdparty/stout to autoreconf autoreconf: Entering directory

Re: [VOTE] Release Apache Mesos 0.16.0 (rc5)

2014-02-04 Thread Benjamin Mahler
0.15.0 has this same issue actually. Probably we should either not bundle ./bootstrap, or bundle ./bootstrap and ensure it works from a distribution. On Tue, Feb 4, 2014 at 12:41 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: Looks like we the 'm4' directory in stout was not added

Re: [VOTE] Release Apache Mesos 0.16.0 (rc5)

2014-02-05 Thread Benjamin Mahler
to track the fix? Meanwhile, I don't think this should be a blocker for releasing this? If you agree, I'm still looking for 2 more votes. On Tue, Feb 4, 2014 at 12:47 PM, Benjamin Mahler benjamin.mah...@gmail.com wrote: 0.15.0 has this same issue actually. Probably we should either

Re: Stateful Master

2014-02-07 Thread Benjamin Mahler
questions / feedback. On Thu, Oct 31, 2013 at 5:02 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: Hi All, I'd like to mention some changes that have been discussed amongst the committers but have not yet been shared broadly with the list. The central component of Mesos is the Master

Re: Review Request 18001: Disable SIGPIPE on MacOS upon socket creation

2014-02-12 Thread Benjamin Mahler
Ah sorry, that is because it must be 'inline' if defined in the header, since this header is likely included in a few compilation units: inline Tryint socket(...) { ... } On Wed, Feb 12, 2014 at 12:26 PM, Nikita Vetoshkin nikita.vetosh...@gmail.com wrote: On Feb. 12, 2014, 7:09 p.m.,

Re: #mesos and #aurora IRC chatlogs now archived

2014-02-14 Thread Benjamin Mahler
I'm still a bit of an IRC novice, is there a way to have an IRC client consume this data so that we don't have to check the archives manually? On Fri, Feb 14, 2014 at 11:23 AM, hades dark hades.o...@gmail.com wrote: that's good news :) On Sat, Feb 15, 2014 at 12:51 AM, Dave Lester

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #1902

2014-02-19 Thread Benjamin Mahler
https://issues.apache.org/jira/browse/MESOS-1019 On Wed, Feb 19, 2014 at 10:10 AM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/1902/changes Changes: [dlester] Updates #PoweredByMesos list to

Re: Mesos Apache Infra Update w/github

2014-02-19 Thread Benjamin Mahler
There is still the definite blocker that committers cannot close pull requests: https://github.com/apache/mesos/pulls benh: Having pull requests become ReviewBoard reviews seems a little odd. The author will need to learn how to use ReviewBoard to continue the process, unless there is some

Re: Mesos Apache Infra Update w/github

2014-02-20 Thread Benjamin Mahler
I think we're on the same page, but I would really like to see this in action before we start having bringing people through the process. Can you please send some trivial pull requests, with and without JIRA tickets? I want to make sure they can be closed and we don't further the mess in

Re: Mesos Apache Infra Update w/github

2014-02-20 Thread Benjamin Mahler
Ah good to see Jake's comment. Thanks for taking the next steps, looking forward to this! On Thu, Feb 20, 2014 at 12:02 PM, Dave Lester d...@ischool.berkeley.eduwrote: On Thu, Feb 20, 2014 at 10:53 AM, Benjamin Mahler benjamin.mah...@gmail.com wrote: I would really like to see

Re: Review Request 18333: Updated Makefile.am for the new interval set tests.

2014-02-21 Thread Benjamin Mahler
No need to publish if the diff is empty: https://reviews.apache.org/r/18333/diff/1-2/ https://reviews.apache.org/r/18333/diff/2-3/ Saves having to read email :) -- Forwarded message -- From: Jie Yu yujie@gmail.com Date: Fri, Feb 21, 2014 at 11:24 AM Subject: Re: Review

Re: [VOTE] Release Apache Mesos 0.17.0 (rc2)

2014-02-24 Thread Benjamin Mahler
+1 (binding) Ran make check on OS X with gcc 4.8. On Mon, Feb 24, 2014 at 4:14 PM, Jie Yu yujie@gmail.com wrote: Hi all, Please vote on releasing the following candidate as Apache Mesos 0.17.0. 0.17.0 includes the following:

Re: Path forward to C++11.

2014-02-26 Thread Benjamin Mahler
, Benjamin Mahler benjamin.mah...@gmail.comwrote: Thanks for the heads up, we're likely to upgrade to 3.3.6, but I've yet to confirm that it builds with c++11. On Thu, Oct 24, 2013 at 8:10 AM, Tim St Clair tstcl...@redhat.com wrote: +1 to the approach. FWIW made a quick update

Re: Path forward to C++11.

2014-02-26 Thread Benjamin Mahler
out certain platforms for development. Ideally, we'd be able to say something like 0.19.0 builds on g++4.7 and clang 3.3 or greater and 0.20.0 builds on g++4.8 and clang 3.4 or greater instead of blanket C++11 support. On Wed, Feb 26, 2014 at 10:20 AM, Benjamin Mahler benjamin.mah

Re: Review Request 18386: Option reference cleanup in mesos

2014-02-27 Thread Benjamin Mahler
Well, why would they be extending the lifetime of a temporary if they don't understand the semantics in the first place? :) They should understand the difference between: const T t = foo(); // Returns T. const T t = option.get(); // Ok. const T t = (temporaryOption()).get(); // Bad! This

Re: make check fail for issue MESOS-969

2014-03-03 Thread Benjamin Mahler
One way to work around this is to do the check in slave/main.cpp instead, this means you don't have to update the integration tests, but you will likely still have to update the example framework tests. The alternative is you'll have to fix all the tests. On Mon, Mar 3, 2014 at 11:29 AM, hades

Re: make check fail for issue MESOS-969

2014-03-05 Thread Benjamin Mahler
then. off to main.cpp then :) On Tue, Mar 4, 2014 at 1:21 AM, Benjamin Mahler benjamin.mah...@gmail.com wrote: One way to work around this is to do the check in slave/main.cpp instead, this means you don't have to update the integration tests, but you will likely still have to update the example

Re: What happens when I call reconcileTasks and database divergence

2014-03-10 Thread Benjamin Mahler
This is a great question and is the primary motivation behind: https://issues.apache.org/jira/browse/MESOS-295 To guarantee frameworks can maintain a consistent view of their tasks (without a custom reconciliation mechanism, as is used in Aurora), we will be implementing the Registrar to persist

Re: Question on executors

2014-03-10 Thread Benjamin Mahler
I have the status of TASK_COMPLETED being sent via the driver, followed by a wait of about 5 secs This is needed because of https://issues.apache.org/jira/browse/MESOS-243. A 1 second sleep should be ample. However, I'd still like to hear any thoughts on the approach of using one task per

Re: Question on executors

2014-03-11 Thread Benjamin Mahler
If you're just loading a .jar then I suppose you are ok, but I'm not sure if this is a wise design for running arbitrary .jars. You'll be able to share the JVM overhead but you'll also be sharing the same JVM runtime, is that well supported? What happens if both your executor .jar and the task

Re: Review Request 18966: change the datatype of cpushare from size_t to uint64_t because The actual type of size_t is platform-dependent .

2014-03-14 Thread Benjamin Mahler
This was me adding myself to shepherd. Didn't realize it would appear as if Archana was updating the review! On Fri, Mar 14, 2014 at 12:51 PM, Archana kumari archanakumari...@gmail.com wrote: This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18966/

Re: [1/5] git commit: Added a --registry_strict_operations flag that must be false for now.

2014-03-14 Thread Benjamin Mahler
/b1b6e07d Branch: refs/heads/master Commit: b1b6e07d0875b559fd077f1bedd34969b7d453fd Parents: 90a7c50 Author: Benjamin Mahler bmah...@twitter.com Authored: Wed Mar 12 11:26:04 2014 -0700 Committer: Benjamin Mahler bmah...@twitter.com Committed: Fri Mar 14 15:32:15 2014 -0700

Re: [Request] contributors list request

2014-03-14 Thread Benjamin Mahler
I can't find your username, nor your account after searching your name, can you point me to your JIRA profile? On Fri, Mar 14, 2014 at 5:10 PM, Alexandra Sava alexandrasav...@gmail.comwrote: Hi guys, I have a fix for MESOS-1067 ticket. Can you please add me to the 'contributors' list and

Re: Load simulator/benchmark tool

2014-03-21 Thread Benjamin Mahler
You can run N slaves on one machine, or you can run meta-slaves (slaves within slaves). We've used meta-slaves in the past to run scaling simulations as it is more accurate and easier than stubbing out the task launching. On Fri, Mar 21, 2014 at 12:55 PM, Sharma Podila spod...@netflix.com wrote:

Re: StackExchange Forwarding

2014-03-24 Thread Benjamin Mahler
Cool! Would it be better suited for the user@ list though? On Mon, Mar 24, 2014 at 1:01 PM, Till Toenshoff toensh...@me.com wrote: Dear Dev-List, I have just enabled a filter-forwarding of StackExchange questions on anything tagged mesos into this list. This will send a daily digest of all

Re: Shepherding on ExternalContainerizer

2014-03-25 Thread Benjamin Mahler
Hey Till, We want to foster a healthy review culture, and so, as you observed, we thought we would try out the notion of having a shepherd for each review. In the past we've had some reviews stagnate because there was no clear accountability for getting it committed. Meaning, various committers

Re: Mesos Wire Protocol Documentation

2014-04-07 Thread Benjamin Mahler
Unfortunately you will need to learn this by looking at the code in libprocess, as the message passing format is not explicitly documented at the current time. Start with calls like ProtobufProcess::send() and dig your way down. On Sat, Apr 5, 2014 at 7:52 AM, Vladimir Vivien

Re: Load simulator/benchmark tool

2014-04-07 Thread Benjamin Mahler
Jie recently pointed me to the Sparrow talk: http://www.youtube.com/watch?v=A4k0WqjUY9A In light of the concerns over the latency penalty of centralized scheduler systems, it would be awesome to measure task / update / message latencies when dealing with very large clusters. Does mesosaurus aim

Re: Question about LOST status on custom executor

2014-04-07 Thread Benjamin Mahler
should inform RUNNING, FINISHED, and FAILED? On Mon, Apr 7, 2014 at 4:54 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: Why is your executor failing? When you say failing, is your executor crashing or simply exiting after doing the required work? You will need to manage the task

Re: Review Request 20106: Added support for flattening from Try and Result objects into Future objects as suggested in the issue MESOS-1160.

2014-04-07 Thread Benjamin Mahler
Hi Ritwik, please add 'mesos' to the 'Groups' field on the review as well, this ensures it is sent out on the dev@ list. On Mon, Apr 7, 2014 at 2:33 PM, Ritwik ritwik.ya...@gmail.com wrote: +dev@mesos.apache.org -- Forwarded message -- From: Ritwik Yadav

Re: Mesos Wire Protocol Documentation

2014-04-08 Thread Benjamin Mahler
. Sender is encoded in User-Agent header, e.g: libprocess/slave(1)@127.0.0.1:5051. Body contains protobuf message, Transfer-Encoding is always chunked. On Mon, Apr 7, 2014 at 10:42 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: Unfortunately you will need to learn

Re: Mesos Wire Protocol Documentation

2014-04-08 Thread Benjamin Mahler
Vivien vladimir.viv...@gmail.comwrote: Ben, That is exactly what I am asking. Is that something coming up soon, is there a JIRA I can look at? I wanna get early start on a native json Go api or even help out if possible. On Tue, Apr 8, 2014 at 3:25 PM, Benjamin Mahler benjamin.mah

Re: Mesos Wire Protocol Documentation

2014-04-09 Thread Benjamin Mahler
for scheduling. But, it's really administrative. I thought that would have been an opportunity for a Go binding that did not require the C++ libraries. Thanks anyway. On Tue, Apr 8, 2014 at 4:52 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: Sorry, I was not referring to implementing

Re: [jira] [Commented] (MESOS-1199) Subprocess is slow - gated by process::reap poll interval

2014-04-09 Thread Benjamin Mahler
Ian, process::reap always uses waitpid() as we didn't implement the thread-per-pid wait() optimization. On Wed, Apr 9, 2014 at 4:41 PM, Ian Downes (JIRA) j...@apache.org wrote: [

Re: Review Request 20431: Used LogStorage for all tests.

2014-04-16 Thread Benjamin Mahler
Actually, I will update this to include the RegistrarTests as well. On Wed, Apr 16, 2014 at 3:59 PM, Ben Mahler benjamin.mah...@gmail.comwrote: This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20431/ Review request for mesos, Benjamin Hindman and

Re: Trying to get task reconciliation to work

2014-04-18 Thread Benjamin Mahler
unknown, lost, or will nothing respond? On Thursday, April 17, 2014, Sharma Podila spod...@netflix.com wrote: No problem, I have a better understanding now. And it was useful to see the three items you listed explicitly. On Thu, Apr 17, 2014 at 2:39 PM, Benjamin Mahler

Re: Trying to get task reconciliation to work

2014-04-18 Thread Benjamin Mahler
for frameworks that fail to failover in a timely manner, and then ask for tasks that belonged to their previous FrameworkID. On Fri, Apr 18, 2014 at 1:55 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: Vinod, David is asking about tasks that belong to the framework in that they were

Re: Review Request 20502: Introduced exponential backoff for slave registration retries.

2014-04-18 Thread Benjamin Mahler
Vinod can you review this one? On Fri, Apr 18, 2014 at 3:09 PM, Jiang Yan Xu y...@jxu.me wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20502/

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME #2081

2014-04-23 Thread Benjamin Mahler
https://issues.apache.org/jira/browse/MESOS-1152 On Wed, Apr 23, 2014 at 1:08 AM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Trunk-Ubuntu-Build-Out-Of-Src-Set-JAVA_HOME/2081/ -- [...truncated

Re: Build failed in Jenkins: Mesos-Ubuntu-distcheck #51

2014-04-24 Thread Benjamin Mahler
This issue should be resolved now with 397dc81. On Thu, Apr 24, 2014 at 10:48 AM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Mesos-Ubuntu-distcheck/51/changes Changes: [benjamin.hindman] Cleanups in configure.ac for libjvm detection.

Re: Review Request 19176: Eliminated Framework.id in favor of Framework.info.id.

2014-04-24 Thread Benjamin Mahler
I will take a look, thanks Adam! On Wed, Apr 23, 2014 at 6:55 PM, Adam B a...@mesosphere.io wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/19176/

Re: Review Request 20807: [MESOS-1259]: Enrich the Java Docs in the src/java files.

2014-04-29 Thread Benjamin Mahler
Thanks for the javadoc pointer, your indentation changes SGTM! On Mon, Apr 28, 2014 at 11:03 PM, Bernardo Gomez Palacio bernardo.gomezpala...@gmail.com wrote: This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20807/ On April 29th, 2014, 1:03 a.m.

Re: Mesos Wire Protocol Documentation

2014-04-30 Thread Benjamin Mahler
nikita.vetosh...@gmail.com wrote: BTW, there is also somehow related ticket https://issues.apache.org/jira/browse/MESOS-930 On Wed, Apr 9, 2014 at 9:54 PM, Benjamin Mahler benjamin.mah...@gmail.comwrote: I thought the low-level api being referred

Re: OPW Summer 2014

2014-04-30 Thread Benjamin Mahler
Welcome! Looking forward to seeing your contributions! On Tue, Apr 29, 2014 at 5:44 PM, Benjamin Hindman b...@eecs.berkeley.eduwrote: Welcome Isabel! On Mon, Apr 28, 2014 at 3:35 PM, Vinod Kone vinodk...@gmail.com wrote: Welcome and good luck with your internship! Also, see here

Re: Build failed in Jenkins: Mesos-Trunk-Ubuntu-Build-In-Src-Set-JAVA_HOME #1821

2014-04-30 Thread Benjamin Mahler
Is this being tracked? I've found another issue perhaps: [ RUN ] ExternalContainerizerTest.Launch ../../src/tests/cluster.hpp:462: Failure (wait).failure(): External containerizer failed (status: 1) F0430 15:44:34.437077 13360 logging.cpp:55] RAW: Pure virtual method called @

  1   2   3   4   5   6   7   8   9   10   >