Re: Problems with Hadoop on Mesos

2014-01-23 Thread Dave Lester
Just bumping this thread, and cc'ing Brenden Matthews who is the most-active maintainer of Hadoop on Mesos. On Fri, Jan 17, 2014 at 10:09 AM, HUO Jing huoj...@ihep.ac.cn wrote: Hi, I am trying to run Hadoop on Mesos, but the stderr shows: Exception in thread main

[jira] [Created] (MESOS-941) CPU limit not correctly set when executor launched with no memory resource

2014-01-23 Thread Lin Zhao (JIRA)
Lin Zhao created MESOS-941: -- Summary: CPU limit not correctly set when executor launched with no memory resource Key: MESOS-941 URL: https://issues.apache.org/jira/browse/MESOS-941 Project: Mesos

[jira] [Updated] (MESOS-941) Memory limit not correctly set when no memory resource set on executor level

2014-01-23 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zhao updated MESOS-941: --- Summary: Memory limit not correctly set when no memory resource set on executor level (was: CPU limit not

[jira] [Updated] (MESOS-941) Memory limit not correctly set when no memory resource set on executor level

2014-01-23 Thread Lin Zhao (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zhao updated MESOS-941: --- Description: When a framework is launched with memory resource only set on the tasks, and non set on the

Re: Review Request 17229: Fixed slave to checkpoint boot id immediately after recovery.

2014-01-23 Thread Ben Mahler
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17229/#review32635 --- Ship it!

Re: Review Request 17229: Fixed slave to checkpoint boot id immediately after recovery.

2014-01-23 Thread Vinod Kone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17229/ --- (Updated Jan. 23, 2014, 6:11 p.m.) Review request for mesos, Benjamin Hindman

Review Request 17249: Added more overloads for strings::join().

2014-01-23 Thread Vinod Kone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17249/ --- Review request for mesos and Ben Mahler. Bugs: MESOS-940

Re: Review Request 17249: Added more overloads for strings::join().

2014-01-23 Thread Ben Mahler
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17249/#review32642 --- Ship it! Ship It! - Ben Mahler On Jan. 23, 2014, 6:12 p.m.,

[jira] [Resolved] (MESOS-940) Slave should checkpoint bootid after recovery instead of after registration

2014-01-23 Thread Vinod Kone (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kone resolved MESOS-940. -- Resolution: Fixed commit d259083342d205a266322017139fdd66807be41c Author: Vinod Kone vi...@twitter.com

[jira] [Commented] (MESOS-937) Fix pure virtual method called bug in zookeeper::ProcessWatcher

2014-01-23 Thread Yan Xu (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880178#comment-13880178 ] Yan Xu commented on MESOS-937: -- https://reviews.apache.org/r/17221/

Review Request 17222: Fixed a bug which caused “pure virtual method called” error.

2014-01-23 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17222/ --- Review request for mesos, Benjamin Hindman, Ben Mahler, and Vinod Kone. Bugs:

Re: Review Request 17221: Added a function that captures the stack trace when a pure virtual method is called.

2014-01-23 Thread Jie Yu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17221/#review32645 --- src/logging/logging.cpp

Re: Review Request 16150: Containerizer - isolators (part 3)

2014-01-23 Thread Niklas Nielsen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16150/#review32553 --- Ship it! src/Makefile.am

[jira] [Created] (MESOS-942) The link on http://mesos.apache.org/documentation/latest/mesos-code-internals/

2014-01-23 Thread Bernardo Gomez Palacio (JIRA)
Bernardo Gomez Palacio created MESOS-942: Summary: The link on http://mesos.apache.org/documentation/latest/mesos-code-internals/ Key: MESOS-942 URL: https://issues.apache.org/jira/browse/MESOS-942

[jira] [Updated] (MESOS-942) The link on App/Framework development guide is broken on the Mesos Code Internals page.

2014-01-23 Thread Bernardo Gomez Palacio (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bernardo Gomez Palacio updated MESOS-942: - Description: In the Mesos Code Internal page

[jira] [Updated] (MESOS-942) The link on App/Framework development guide is broken on the Mesos Code Internals page

2014-01-23 Thread Bernardo Gomez Palacio (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bernardo Gomez Palacio updated MESOS-942: - Summary: The link on App/Framework development guide is broken on the Mesos Code

[jira] [Assigned] (MESOS-942) The link on App/Framework development guide is broken on the Mesos Code Internals page

2014-01-23 Thread Dave Lester (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Lester reassigned MESOS-942: - Assignee: Dave Lester The link on App/Framework development guide is broken on the Mesos Code

Review Request 17255: Add observe endpoint to master.

2014-01-23 Thread Charlie Carson
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17255/ --- Review request for mesos, Benjamin Hindman and Jeff Currier. Bugs:

Re: Review Request 16432: Containerizer - cgroup isolators (part 4)

2014-01-23 Thread Niklas Nielsen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16432/#review32647 --- Ship it! Again, good stuff :) A few easy style nits/questions.

[jira] [Created] (MESOS-943) Provide an abstraction for asynchronous launching of subprocesses.

2014-01-23 Thread Benjamin Mahler (JIRA)
Benjamin Mahler created MESOS-943: - Summary: Provide an abstraction for asynchronous launching of subprocesses. Key: MESOS-943 URL: https://issues.apache.org/jira/browse/MESOS-943 Project: Mesos

Review Request 17257: Minor fix to make Slave::detected() public for testing.

2014-01-23 Thread Vinod Kone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17257/ --- Review request for mesos and Jiang Yan Xu. Repository: mesos-git Description

Re: Review Request 17013: Containerizer - updated tests (part 5)

2014-01-23 Thread Niklas Nielsen
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17013/#review32657 --- Is this patch final/reviewable? Or do you plan to follow up with a

Re: Review Request 17257: Minor fix to make Slave::detected() public for testing.

2014-01-23 Thread Jiang Yan Xu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17257/#review32658 --- Ship it! Ship It! - Jiang Yan Xu On Jan. 23, 2014, 11:45 a.m.,

[jira] [Commented] (MESOS-943) Provide an abstraction for asynchronous launching of subprocesses.

2014-01-23 Thread Ian Downes (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880322#comment-13880322 ] Ian Downes commented on MESOS-943: -- Could you clarify the reasoning behind moving the

[jira] [Resolved] (MESOS-916) add .gitignore-template file for ./bootstrap generated files

2014-01-23 Thread Charlie Carson (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Carson resolved MESOS-916. -- Resolution: Fixed add .gitignore-template file for ./bootstrap generated files

[jira] [Resolved] (MESOS-902) add post to libprocess

2014-01-23 Thread Charlie Carson (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Carson resolved MESOS-902. -- Resolution: Fixed add post to libprocess -- Key:

[jira] [Commented] (MESOS-943) Provide an abstraction for asynchronous launching of subprocesses.

2014-01-23 Thread Benjamin Mahler (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880421#comment-13880421 ] Benjamin Mahler commented on MESOS-943: --- A bit of both (you'll see the TODO in

[jira] [Commented] (MESOS-943) Provide an abstraction for asynchronous launching of subprocesses.

2014-01-23 Thread Jie Yu (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880425#comment-13880425 ] Jie Yu commented on MESOS-943: -- A good reference:

[jira] [Updated] (MESOS-941) Memory limit not correctly set when no memory resource set on executor level

2014-01-23 Thread Benjamin Mahler (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Mahler updated MESOS-941: -- Fix Version/s: 0.17.0 Memory limit not correctly set when no memory resource set on executor

Re: Review Request 15542: Offer an execvp like interface for running tasks.

2014-01-23 Thread Ben Mahler
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15542/#review32671 --- Ship it! Thanks for making the driver updates, mostly nits below.

Re: Review Request 15542: Offer an execvp like interface for running tasks.

2014-01-23 Thread Ben Mahler
On Jan. 23, 2014, 10:45 p.m., Ben Mahler wrote: src/sched/sched.cpp, line 876 https://reviews.apache.org/r/15542/diff/14/?file=433711#file433711line876 Let's not say that 'value' is deprecated, in response to your earlier comment, most utilities I see provide the convenience of

Re: Discuss mesos + helix

2014-01-23 Thread kishore g
Hi Jeff, For some reason this ended up in spam folder. I will look at Mesos-695 and get back to you. Where can I get more info on what is Wilson? thanks, Kishore G On Fri, Jan 10, 2014 at 12:58 PM, Jeff Currier jcurr...@twitter.com wrote: Kishore, We've begun on work on some Helix like

[jira] [Commented] (MESOS-939) assignment of bool to Stout JSON::Value yields JSON::Double

2014-01-23 Thread Charlie Carson (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880539#comment-13880539 ] Charlie Carson commented on MESOS-939: -- slight complication. there is ambiguity

Review Request 17286: Allowed log::catchup to retry to tolerate network blips.

2014-01-23 Thread Jie Yu
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17286/ --- Review request for mesos and Benjamin Hindman. Repository: mesos-git

[jira] [Commented] (MESOS-816) Allow delegation to shell scripts for isolation

2014-01-23 Thread Niklas Quarfot Nielsen (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880586#comment-13880586 ] Niklas Quarfot Nielsen commented on MESOS-816: -- Here is a preliminary

Re: Review Request 16432: Containerizer - cgroup isolators (part 4)

2014-01-23 Thread Chi Zhang
On Jan. 23, 2014, 7:32 p.m., Niklas Nielsen wrote: Again, good stuff :) A few easy style nits/questions. Hi Niklas, Thanks for taking the time to review this. A new version has been pushed up and will be incorporated into Ian's branch and reflected here. I can't close issues here since I

Re: Review Request 16147: Containerizer (part 1)

2014-01-23 Thread Adam B
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/16147/#review32670 --- Finally got around to reviewing the new containerizer files. Looks

Re: Review Request 17286: Allowed log::catchup to retry to tolerate network blips.

2014-01-23 Thread Benjamin Hindman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17286/#review32686 --- Ship it! src/log/catchup.hpp

[jira] [Assigned] (MESOS-941) Memory limit not correctly set when no memory resource set on executor level

2014-01-23 Thread Vinod Kone (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kone reassigned MESOS-941: Assignee: Vinod Kone Memory limit not correctly set when no memory resource set on executor level

Review Request 17295: Fixed slave to work correctly when executor resources are not specified.

2014-01-23 Thread Vinod Kone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17295/ --- Review request for mesos, Benjamin Hindman, Ben Mahler, Brenden Matthews, and

[jira] [Commented] (MESOS-941) Memory limit not correctly set when no memory resource set on executor level

2014-01-23 Thread Vinod Kone (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880624#comment-13880624 ] Vinod Kone commented on MESOS-941: -- https://reviews.apache.org/r/17295/ Memory limit not

Re: Review Request 17295: Fixed slave to properly do memory isolation when executor resources are not specified.

2014-01-23 Thread Vinod Kone
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17295/ --- (Updated Jan. 24, 2014, 2:14 a.m.) Review request for mesos, Benjamin Hindman,

Re: Review Request 16631: Added average system load and cpu count in master and slave stats end-points.

2014-01-23 Thread Niklas Nielsen
On Jan. 21, 2014, 11:10 a.m., Vinod Kone wrote: Ship It! BenM suggested that we'd move this to common HTTP handler for system metrics in libprocess e.g. /system. What are your thoughts on that approach? In that case, I'd close this RR and start a new one. - Niklas

Re: Review Request 17295: Fixed slave to properly do memory isolation when executor resources are not specified.

2014-01-23 Thread Ben Mahler
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17295/#review32692 --- Ship it! Ship It! - Ben Mahler On Jan. 24, 2014, 2:14 a.m.,

Re: Review Request 16631: Added average system load and cpu count in master and slave stats end-points.

2014-01-23 Thread Vinod Kone
On Jan. 21, 2014, 7:10 p.m., Vinod Kone wrote: Ship It! Niklas Nielsen wrote: BenM suggested that we'd move this to common HTTP handler for system metrics in libprocess e.g. /system. What are your thoughts on that approach? In that case, I'd close this RR and start a new one.

Re: Review Request 17295: Fixed slave to properly do memory isolation when executor resources are not specified.

2014-01-23 Thread Ian Downes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17295/#review32694 --- Ship it! Ship It! - Ian Downes On Jan. 24, 2014, 2:14 a.m.,

Re: Review Request 17295: Fixed slave to properly do memory isolation when executor resources are not specified.

2014-01-23 Thread Brenden Matthews
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17295/#review32696 --- Ship it! Nice! - Brenden Matthews On Jan. 24, 2014, 2:14 a.m.,

Re: Re: Fw: Re: Problems with Hadoop on Mesos

2014-01-23 Thread HUO Jing
Yes, I followed the instructions. I put the hadoop-mesos.jar in hadoop-2.0.0-mr1-cdh4.2.2/lib/ and tar it to hadoop-2.0.0-mr1-cdh4.2.2.tar.gz then upload it to HDFS. -原始邮件- 发件人: Brenden Matthews bren...@diddyinc.com 发送时间: 2014年1月24日 星期五 收件人: HUO Jing huoj...@ihep.ac.cn 抄送: dev

Review Request 17305: Update the slave to use the libprocess Reaper.

2014-01-23 Thread Ben Mahler
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17305/ --- Review request for mesos, Benjamin Hindman, Ian Downes, and Jie Yu. Bugs:

Review Request 17304: Added a child Reaper utility in libprocess.

2014-01-23 Thread Ben Mahler
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17304/ --- Review request for mesos, Benjamin Hindman, Ian Downes, and Jie Yu. Bugs:

[jira] [Commented] (MESOS-943) Provide an abstraction for asynchronous launching of subprocesses.

2014-01-23 Thread Benjamin Mahler (JIRA)
[ https://issues.apache.org/jira/browse/MESOS-943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13880778#comment-13880778 ] Benjamin Mahler commented on MESOS-943: --- https://reviews.apache.org/r/17304/

Re: Review Request 17304: Added a child Reaper utility in libprocess.

2014-01-23 Thread Benjamin Hindman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17304/#review32704 --- Ship it! 3rdparty/libprocess/include/process/reaper.hpp

Re: Review Request 17305: Update the slave to use the libprocess Reaper.

2014-01-23 Thread Benjamin Hindman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17305/#review32706 --- Ship it! src/launcher/executor.cpp