Re: How to sizing memory in mesos

2015-03-15 Thread haosdent
:06 PM Subject: Re: How to sizing memory in mesos The only way you can increase or decrease memory for an executor is by launching/killing tasks. So you could presumably use no-op tasks to achieve what you want. On Fri, Mar 13, 2015 at 7:51 AM, haosdent haosd...@gmail.com wrote

Re: Zookeeper integration for Mesos-DNS

2015-03-21 Thread haosdent
/tree/zk and provide us with any feedback on the code or the documentation. Thanks -- Christos -- Best Regards, Haosdent Huang

How to sizing memory in mesos

2015-03-13 Thread haosdent
Hello, I write a redis service based on Mesos. And I have a problem: when I launch a executor with a resource offer, how could I allocate more memory or reduce memory for this running executor? Are there any API relates to this? Thank you in advance. -- Best Regards, Haosdent Huang

Re: Docker 1.6 and Registry 2.0 support

2015-04-21 Thread haosdent
and Registry 2.0 release article - http://blog.docker.com/2015/04/faster-and-better-image-distribution-with-registry-2-0-and-engine-1-6/ -- Best Regards, Haosdent Huang

Re: Debugging hadoop-mesos

2015-05-08 Thread haosdent
You run everything in root? On Fri, May 8, 2015 at 3:38 PM, haosdent haosd...@gmail.com wrote: Seems you don't have permission for this directory: java.io.IOException: Could not create job user log directory: file:/usr/lib/hadoop/logs/userlogs/job_201505080220_0001

Re: Debugging hadoop-mesos

2015-05-08 Thread haosdent
I think you could export HADOOP_LOG_DIR=/tmp to temp. And try again. On Fri, May 8, 2015 at 3:43 PM, Brian Topping brian.topp...@gmail.com wrote: Mesos runs as root, hadoop is as a separate user. On May 8, 2015, at 2:41 PM, haosdent haosd...@gmail.com wrote: You run everything in root

Re: Debugging hadoop-mesos

2015-05-08 Thread haosdent
I didn't post. I changed hadoop.log.dir=/var/log/hadoop in /etc/hadoop/conf.pseudo.mr1/log4j.properties, but it didn't make any difference. Just getting back into it now. On May 8, 2015, at 1:56 PM, haosdent haosd...@gmail.com wrote: Could you post the log in executors which run jobtracker

Re: Debugging hadoop-mesos

2015-05-06 Thread haosdent
-- Best Regards, Haosdent Huang

Re: mesos framework already registered

2015-05-09 Thread haosdent
And when you create MesosSchedulerDriver and pass a FrameworkInfo which contains a vaild FrameworkID, the driver will attempt to failover. On Sun, May 10, 2015 at 3:27 AM, haosdent haosd...@gmail.com wrote: I think this log is a normal info log. Could you provide more details about you problem

Re: make[3]: *** [check-local] Aborted (core dumped) in make test

2015-05-18 Thread haosdent
On Sun, May 17, 2015 at 6:24 PM, haosdent haosd...@gmail.com wrote: Thank you for your reply, I fill this issue https://issues.apache.org/jira/browse/MESOS-2744 On Sun, May 17, 2015 at 5:08 AM, Joerg Maurer dev-ma...@gmx.net wrote: Hello haosdent, See (1) and (2), just executed

Re: make[3]: *** [check-local] Aborted (core dumped) in make test

2015-05-17 Thread haosdent
Thank you for your reply, I fill this issue https://issues.apache.org/jira/browse/MESOS-2744 On Sun, May 17, 2015 at 5:08 AM, Joerg Maurer dev-ma...@gmx.net wrote: Hello haosdent, See (1) and (2), just executed in that order. Results make for me - from a blackbox point of view - no sense

Re: Changing Mesos Minimum Compiler Version

2015-04-12 Thread haosdent
versions will be: GCC 4.8, GCC 4.9 Clang 3.5, Clang 3.6 For reference Compilers by Distribution Version: http://goo.gl/p1t1ls C++11 features supported by each compiler: https://gcc.gnu.org/projects/cxx0x.html http://clang.llvm.org/cxx_status.html -- Best Regards, Haosdent Huang

Re: Shenzhen MUG First Meetup !

2015-04-17 Thread haosdent
Email: zhipe...@uci.edu Office: Calit2 Building Room 2402 OpenStack, OPNFV, OpenDaylight, OpenCompute Aficionado -- Best Regards, Haosdent Huang

Re: [DISCUSS] Renaming Mesos Slave

2015-06-02 Thread haosdent
name(s). 4. How will we phase in the new name and phase out the old name? Please voice your thoughts and opinions below. Thanks! -Adam- P.S. My personal thoughts: 1. Mesos Worker [Node] 2. Mesos Worker or Agent 3. No 4. Carefully -- Best Regards, Haosdent Huang

Re: mesos be aware of hdfs location using spark

2015-06-23 Thread haosdent
to mesos_worker_2, do all Data have to be copied ? How are handling this ? Regards Sébastien -- Best Regards, Haosdent Huang

Re: mesos be aware of hdfs location using spark

2015-06-23 Thread haosdent
:58 PM, haosdent haosd...@gmail.com wrote: For your second question, I think unless you already have data replica in new hdfs datanode, otherwise hdfs would copy the block from other exist datanode. On Tue, Jun 23, 2015 at 7:51 PM, Sebastien Brennion sebastien.brenn...@leanbi.ch wrote: ​Hi

Re: Minor Documentation Correction

2015-06-23 Thread haosdent
--- Mufeed Usman My LinkedIn http://www.linkedin.com/pub/mufeed-usman/28/254/400 | My Social Cause http://www.vision2016.org.in/ | My Blogs : LiveJournal http://mufeed.livejournal.com -- Best Regards, Haosdent Huang

Re: git / chronos-marathon integration

2015-06-24 Thread haosdent
, mesos is getting and using that version (for marathon and chronos)… Do somebody already have something similar ? Regards, Sébastien -- Text by Jeff, typos by iPhone -- Best Regards, Haosdent Huang

Re: Documentation

2015-06-24 Thread haosdent
.org.in/ | My Blogs : LiveJournal http://mufeed.livejournal.com -- Best Regards, Haosdent Huang

Re: mesos-slave service cannot be started when change default containerizers from mesos to docker

2015-06-19 Thread haosdent
-- Best Regards, Haosdent Huang

Re: Failed to make check and run example framework

2015-06-01 Thread haosdent
-225015-16777343-5050-14668-' I0601 23:02:44.881921 14828 sched.cpp:1589] Asked to stop the driver Any help will be appreciated, thanks! -- Best Regards, Haosdent Huang

Re: step-step guide for New-to-Mesos

2015-07-01 Thread haosdent
Sorry, marthon should be marathon https://mesosphere.github.io/marathon/ On Wed, Jul 1, 2015 at 9:23 PM, haosdent haosd...@gmail.com wrote: Hi, @Hajira Next step is to run tasks in containers in Mesos. You want to run somethinng like web application in docker or others? You could try

Re: step-step guide for New-to-Mesos

2015-07-01 Thread haosdent
other alternatives are there? Thanks, Andras -- Best Regards, Haosdent Huang

Re: Hadoop on Mesos. HDFS question.

2015-07-03 Thread haosdent
the instructions on the mesosphere link that installs HDFS ? -- Best Regards, Haosdent Huang

Re: Introducing the ceph-mesos framework

2015-06-28 Thread haosdent
, China +862161166500 -- Best Regards, Haosdent Huang

Re: Mesos Whitelist syntax

2015-08-13 Thread haosdent
hierarchical.hpp:635] Updated slave whitelist: { * } I0812 11:13:42.996763 10920 hierarchical.hpp:635] Updated slave whitelist: { 10.66.69.19 } Thanks much, Jeremy -- Best Regards, Haosdent Huang

Re: MesosExecutorDriver hard dependency on libcurl4-nss-dev in 0.23.0

2015-08-17 Thread haosdent
: libcurl4-nss-dev,libcurl4-gnutls-dev, libcurl4-openssl-dev It's not a new dependency, same applies to all 0.2x releases. Tomas On 15 August 2015 at 04:17, haosdent haosd...@gmail.com wrote: Hello, libcurl-nss is provider openssl functions. In http://mesos.apache.org

Re: service discovery in Mesos on CoreOS

2015-06-29 Thread haosdent
the containers to. Con: I can have only as many instances of a service as many slaves I have because they bind to the same port. What other alternatives are there? Thanks, Andras -- Best Regards, Haosdent Huang

Re: How to measure the ZooKeeper Resilience on mesos cluster

2015-08-02 Thread haosdent
with the zookeeper usage? -- Deshi Xiao Twitter: xds2000 E-mail: xiaods(AT)gmail.com -- Best Regards, Haosdent Huang

Re: Proposing a fatal log for not finding mesos-fetcher

2015-07-30 Thread haosdent
/usr/local/libexec/mesos (default) Just a thought. -- Best Regards, Haosdent Huang

Re: Custom executor

2015-07-28 Thread haosdent
and executors? (ie one is python one is C++) Thanks, Aaron -- Best Regards, Haosdent Huang

Re: Problem building 0.23.0 under mock for RHEL7

2015-08-04 Thread haosdent
not name a type const std::functionvoid(void) connected, ^ / ``` On Wed, Aug 5, 2015 at 10:21 AM, Jeff Schroeder jeffschroe...@computer.org wrote: Because gcc can compile mesos? On Tuesday, August 4, 2015, haosdent haosd...@gmail.com wrote: Why the compiler in your

Re: Problem building 0.23.0 under mock for RHEL7

2015-08-04 Thread haosdent
/b606fa77b73984cfa02d62cc1c90f4ae736fae0a/build.log -- Jeff Schroeder Don't drink and derive, alcohol and analysis don't mix. http://www.digitalprognosis.com -- Cheers, Timothy St. Clair Red Hat Inc. -- Best Regards, Haosdent Huang

Re: How about shift mesos agent to golang?

2015-08-07 Thread haosdent
Hello, https://github.com/yifan-gu/go-mesos is a golang binding to connect mesos and call mesos api. And this project has already migrate to https://github.com/mesos/mesos-go (see this commit https://github.com/mesos/mesos-go/commit/c064fce89845d4bfb789c2111e8065cab519dc68 ) .If you want to use

Re: Ambari and Mesos

2015-08-11 Thread haosdent
Hadoop in the sense that it will distribute out resource but how would you couple that with Ambari? Any advice is greatly appreciated. Thanks -- Best Regards, Haosdent Huang

Re: Mesos slave help

2015-08-06 Thread haosdent
are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. -- Best Regards, Haosdent Huang

Re: Mesos slave help

2015-08-06 Thread haosdent
+++ On Thu, Aug 6, 2015 at 2:36 PM, haosdent haosd...@gmail.com wrote: You use service mesos-slave to start slave failed so that it could not connect to master, right? Does it have any log about this? On Thu, Aug 6, 2015 at 6:30 PM, Stephen Knight skni...@pivotal.io wrote: Hi, Yes, I

Re: Mesos slave help

2015-08-06 Thread haosdent
Or you could try systemctl cat mesos-slave.service and show us the file content. On Thu, Aug 6, 2015 at 6:49 PM, haosdent haosd...@gmail.com wrote: From this message, I think systemctl status mesos-slave.service -l run mesos-slave with uncorrect flags. And the status out of it is the help

Re: Metering for Mesos

2015-08-06 Thread haosdent
, Sam Chen usultra...@gmail.com wrote: Haosdent , Let me bring one example on the table . We are using Mesos and Marathon , and deployed two tier application (web tier is Tomcat , database layer is mysql) . We are frustrated in terms of how to charge this service, so that we are thinking

Re: Metering for Mesos

2015-08-06 Thread haosdent
is , Is there any solution for metering ? then billing . Since we want to have our platform online and have pay-as-you-go mode . Anyone have any suggsetion ? Very appreciated . Sam -- Best Regards, Haosdent Huang

Re: Hello Guys

2015-08-06 Thread haosdent
, Haosdent Huang

Re: Mesos slave help

2015-08-06 Thread haosdent
:2181/mesos /dev/null 21 Thanks for your help, really appreciate it. On Thu, Aug 6, 2015 at 3:03 PM, haosdent haosd...@gmail.com wrote: Hm, need pass your master location, for example: /usr/sbin/mesos-slave --master=x.x.x.x:5050 if you use zookeeper, need use the format like: /usr/sbin

Re: Mesos slave help

2015-08-06 Thread haosdent
RestartSec=20 LimitNOFILE=16384 CPUAccounting=true MemoryAccounting=true [Install] WantedBy=multi-user.target What are the required flags to start it manually? On Thu, Aug 6, 2015 at 2:51 PM, haosdent haosd...@gmail.com wrote: Or you could try systemctl cat mesos-slave.service

Re: Mesos web ui sandbox help

2015-08-07 Thread haosdent
Tian -- Best Regards, Haosdent Huang

Re: Slave asked to shut down by master because 'health check timed out', what specific things does master check and what factor may causes timed out?

2015-08-07 Thread haosdent
be kind to give more explaination? So we can get away from 'health check timed out'. Thanks very much and best regards! -- Best Regards, Haosdent Huang

Re: Can't start master properly (stale state issue?); help!

2015-08-13 Thread haosdent
2606 http.cpp:516] HTTP request for '/master/state.json' I0813 10:20:06.577448 2609 http.cpp:352] HTTP request for '/master/redirect' -- Best Regards, Haosdent Huang

Re: Problem with launching docker containers on Mesos 0.23.0

2015-08-14 Thread haosdent
. On 14 Aug 2015, at 18:24, haosdent haosd...@gmail.com wrote: From the log error, seems mesos could not found docker command. You run the mesos in docker? On Fri, Aug 14, 2015 at 9:46 PM, Grzegorz Graczyk gregor...@gmail.com wrote: Environment: CoreOS 723.3.0 (latest stable) Docker 1.6.2

Re: Problem with launching docker containers on Mesos 0.23.0

2015-08-14 Thread haosdent
appreciate any kind of help. -- Best Regards, Haosdent Huang

Re: Ambari and Mesos

2015-08-12 Thread haosdent
would you couple that with Ambari? Any advice is greatly appreciated. Thanks -- Cheers, Timothy St. Clair Red Hat Inc. -- Best Regards, Haosdent Huang

Re: Is it possible to run mesos master/slave in private IP and exhibit mesos cluster status with public IP?

2015-07-27 Thread haosdent
with slaves and frameworks with private IP and building http server with public IP for serving external http requests? Any suggestions will be appreciated. Best regards! -- Best Regards, Haosdent Huang

Re: Docker Private Registry problem when update from 0.23 to 0.25

2015-10-23 Thread haosdent
>>>> E-post: joachim.anders...@resurs.se Webb: www.resursbank.se >>>> >>>> >>>> >>>> *Från:* Jan Stabenow [mailto:j.stabe...@livespottingmedia.com] >>>> *Skickat:* den 13 oktober 2015 15:52 >>>> *Till:* user@mesos.apache.org >>>> *Ämne:* Re: Docker Private Registry problem when update from 0.23 to >>>> 0.25 >>>> >>>> >>>> >>>> Hey! >>>> >>>> >>>> >>>> I had the same problems when upgrading 0.23 > 0.24.1 +! marathon 0.10 > >>>> 0.11 >>>> >>>> Have you set the disk-limit in your app-config? If not, set this >>>> ("disk": "value") and try it again. >>>> >>>> >>>> >>>> Looks like there's a problem with Marathon, but not sure. >>>> >>>> >>>> >>>> Best Regards, >>>> >>>> Jan >>>> >>>> >>>> >>>> >>>> >>>> Am 13.10.2015 um 14:14 schrieb Joachim Andersson < >>>> joachim.anders...@resurs.se>: >>>> >>>> >>>> >>>> >>>> >>>> When i deploed with forcePullImage=true it dosn't work in Marathon 0.11 >>>> but when I downgraded to Marathon 0.10 it works, >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> *Joachim Andersson* >>>> >>>> *Systemutvecklare* >>>> >>>> *IT | Utveckling* >>>> >>>> >>>> >>>> Resurs Bank AB >>>> >>>> Ekslingan 9 >>>> >>>> Box 22209, SE-250 24 Helsingborg >>>> >>>> >>>> >>>> Direkt Tfn: >>>> >>>> +46 700 528171 >>>> >>>> Mobil: >>>> >>>> +46 700 528171 >>>> >>>> Växel: >>>> >>>> +46 42 38 20 00 >>>> >>>> E-post: >>>> >>>> joachim.anders...@resurs.se >>>> >>>> Webb: >>>> >>>> www.resursbank.se >>>> >>>> >>>> >>>> >>>> >>>> *Från:* Joachim Andersson [mailto:joachim.anders...@resurs.se >>>> <joachim.anders...@resurs.se>] >>>> *Skickat:* den 13 oktober 2015 13:24 >>>> *Till:* user@mesos.apache.org >>>> *Ämne:* Docker Private Registry problem when update from 0.23 to 0.25 >>>> >>>> >>>> >>>> Hi, I updated from 0.23 to 0.25 of mesos and to Marathon 0.11 >>>> >>>> >>>> >>>> When running docker containers from the public repository it works fine. >>>> >>>> But when I try to run from my local repository the images don't start. >>>> >>>> >>>> >>>> If I start them on my slave with docker run repository:80/image it >>>> works fine. >>>> >>>> >>>> >>>> Anyone have any simmular problem or any idea what it could be? >>>> >>>> >>>> >>>> >>>> >>>> //Joachim >>>> >>>> >>>> >>>> >>>> >>>> *Joachim Andersson* >>>> >>>> *Systemutvecklare* >>>> >>>> *IT | Utveckling* >>>> >>>> >>>> >>>> Resurs Bank AB >>>> >>>> Ekslingan 9 >>>> >>>> Box 22209, SE-250 24 Helsingborg >>>> >>>> >>>> >>>> Direkt Tfn: >>>> >>>> +46 700 528171 >>>> >>>> Mobil: >>>> >>>> +46 700 528171 >>>> >>>> Växel: >>>> >>>> +46 42 38 20 00 >>>> >>>> E-post: >>>> >>>> joachim.anders...@resurs.se >>>> >>>> Webb: >>>> >>>> www.resursbank.se >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>>> >>> >> >> > > > -- > > https://github.com/mindscratch > https://www.google.com/+CraigWickesser > https://twitter.com/mind_scratch > https://twitter.com/craig_links > > -- Best Regards, Haosdent Huang

Re: Recover docker containers when mesos-slave is contained in docker as well

2015-10-22 Thread haosdent
And if your slave id change after restart, the slave would be treated as a new slave and could not recover successfully. It would recover the docker containers which start with "mesos-${slave_id}". On Thu, Oct 22, 2015 at 7:08 PM, haosdent <haosd...@gmail.com> wrote: > As

Re: How to enable docker container in Mesos-Agent within a Docker

2015-10-27 Thread haosdent
try add -e MESOS_LAUNCHER=posix On Oct 28, 2015 9:49 AM, "Klaus Ma" wrote: > Hi team, > > I'd like to start a mesos-agent in Docker with docker container, I can run > sleep docker within a ubuntu docker with following args; but I can not > start an Mesos Agent. Refer to

Re: How to enable docker container in Mesos-Agent within a Docker

2015-10-27 Thread haosdent
could use `cat /proc/self/mountinfo` to check this. On Wed, Oct 28, 2015 at 10:26 AM, haosdent <haosd...@gmail.com> wrote: > maybe it is because of you cgroup mount point is /sys/fs/cgroup, not > /cgroup > > On Wed, Oct 28, 2015 at 10:25 AM, Klaus Ma <klaus198

Re: How to tell master which ip to connect.

2015-10-27 Thread haosdent
y can’t not bind a public ip via —ip > flag), thus masters can’t connect slaves.How can the slave to tell master > which ip master should connect(I can’t find any flags like —advertise_ip > in master). > -- Best Regards, Haosdent Huang

Re: How to tell master which ip to connect.

2015-10-27 Thread haosdent
aves into different IaaS is PROD-READY. > > 发件人: haosdent <haosd...@gmail.com> > 答复: "user@mesos.apache.org" <user@mesos.apache.org> > 日期: 2015年10月28日 星期三 上午10:23 > 至: user <user@mesos.apache.org> > 主题: Re: How to tell master w

Re: How to enable docker container in Mesos-Agent within a Docker

2015-10-27 Thread haosdent
>> the docker. >> >> On Wed, Oct 28, 2015 at 9:54 AM, haosdent <haosd...@gmail.com> wrote: >> >>> try add -e MESOS_LAUNCHER=posix >>> On Oct 28, 2015 9:49 AM, "Klaus Ma" <klaus1982...@gmail.com> wrote: >>> >>>>

Re: Can't start docker container when SSL_ENABLED is on.

2015-10-28 Thread haosdent
t. >> > > Ok. So we should expose advertise_ip and advertise_port as command line > options for mesos-slave as well (instead of using the environment > variables)? Opened https://issues.apache.org/jira/browse/MESOS-3809. > > >> >> Another question. Do masters and s

Re: Can't start docker container when SSL_ENABLED is on.

2015-10-28 Thread haosdent
will register fail(That means the > ssl work well right?) > > As I said the odd thing is the container nerver run(`docker ps –a show > nothing`). So it can’t have any stdout or stderr. > > 发件人: haosdent <haosd...@gmail.com> > 答复: "user@mesos.apache.org" <user

Re: Mesos .26 failing on centos7

2015-11-09 Thread haosdent
s/isolators/filesystem/.deps/libmesos_no_3rdparty_la-linux.Tpo > slave/containerizer/mesos/isolators/filesystem/.deps/libmesos_no_3rdparty_la-linux.Plo > mv -f log/.deps/liblog_la-coordinator.Tpo > log/.deps/liblog_la-coordinator.Plo > mv -f log/.deps/liblog_la-recover.Tpo log/.deps/liblog_la-recover.Plo > > -- Best Regards, Haosdent Huang

Re: Mesos and Zookeeper TCP keepalive

2015-11-08 Thread haosdent
being sent. > > > I've trolled through JIRA, git, etc and cannot easily determine if this is > expected behavior or should be an enhancement request. Any ideas? > > > Thanks much! > > -Jeremy > > -- Best Regards, Haosdent Huang

Re: mess slave can't register to master via master ip:port

2015-11-10 Thread haosdent
r@mesos.apache.org" <user@mesos.apache.org> > 主题: Re: mess slave can't register to master via master ip:port > > I filed a jira ticket https://issues.apache.org/jira/browse/MESOS-3822 to > trace this. Thanks. > > On Tue, Nov 3, 2015 at 2:02 PM, haosdent <haosd...@gmail.c

Re: Can't start docker container when SSL_ENABLED is on.

2015-11-01 Thread haosdent
quot;reconnect" --recovery_timeout="15mins" >> --registration_backoff_factor="1secs" >> --resource_monitoring_interval="1secs" --revocable_cpu_low_priority="true" >> --sandbox_directory="/mnt/mesos/sandbox" --strict=&quo

Re: How to tell master which ip to connect.

2015-11-01 Thread haosdent
asters can’t connect slaves.How can the slave to tell master >> which ip master should connect(I can’t find any flags like —advertise_ip >> in master). >> > > > > -- > Deshi Xiao > Twitter: xds2000 > E-mail: xiaods(AT)gmail.com > > -- Best Regards, Haosdent Huang

Re: Can't start docker container when SSL_ENABLED is on.

2015-11-01 Thread haosdent
@Xiaodong I create a ticket to trace this https://issues.apache.org/jira/browse/MESOS-3815 and post a patch in it. Feel free to review and test it together. Thank you! On Sun, Nov 1, 2015 at 4:54 PM, haosdent <haosd...@gmail.com> wrote: > Hi, @Xiaodong I could reproduce your prob

Re: mess slave can't register to master via master ip:port

2015-11-02 Thread haosdent
mesos does not support such mode, please refer to > https://github.com/apache/mesos/blob/master/src/slave/main.cpp#L105-L111 > for the format of "--master". Thanks! > > On Tue, Nov 3, 2015 at 12:28 PM, haosdent <haosd...@gmail.com> wrote: > >> After checking code,

Re: Welcome Kapil as Mesos committer and PMC member!

2015-11-05 Thread haosdent
! > > Looking forward to lots more of your contributions! > > Thanks > Till -- Best Regards, Haosdent Huang

Re: Docker Multi-Host Networking and Mesos Isolation Strategies

2015-11-04 Thread haosdent
tand how these may or may not > converge in the future. > > John > > > -- Best Regards, Haosdent Huang

Re: spark shuffle service failing to start on slaves

2015-11-03 Thread haosdent
s and affiliates, > "Orchard") makes no representation regarding the accuracy or completeness > of the information contained herein. The intended recipient is advised to > consult its own professional advisors, including those specializing in > legal, tax and accounting matters. Orchard does not provide legal, tax or > accounting advice. > -- Best Regards, Haosdent Huang

Re: How does Mesos parse hadoop command??

2015-11-04 Thread haosdent
on the PATH. >> 59 HDFS() >> 60 : hadoop(os::getenv("HADOOP_HOME").isSome() >> 61 ? path::join(os::getenv("HADOOP_HOME").get(), >> "bin/hadoop") >> 62 : "hadoop") {} >> 63 >> 64 // Check if hadoop client is available at the path that was >> set. >> 65 // This can be done by executing `hadoop version` command and >> 66 // checking for status code == 0. >> 67 Try available() >> 68 { >> 69 Try command = strings::format("%s version", >> hadoop); >> 70 >> 71 CHECK_SOME(command); >> 72 >> 73 // We are piping stderr to stdout so that we can see the >> error (if >> 74 // any) in the logs emitted by `os::shell()` in case of >> failure. >> 75 Try out = os::shell(command.get() + " 2>&1"); >> 76 >> 77 if (out.isError()) { >> 78 return Error(out.error()); >> 79 } >> 80 >> 81 return true; >> 82 } >> >> It puzzled me for a while, am I missing something obviously? >> Thanks in advance. >> >> >> -- Best Regards, Haosdent Huang

Re: How does Mesos parse hadoop command??

2015-11-04 Thread haosdent
how about add this flag when launch slave --executor_environment_variables='{"HADOOP_HOME": "/opt/hadoop-2.6.0"}' ? On Wed, Nov 4, 2015 at 5:13 PM, Du, Fan <fan...@intel.com> wrote: > > > On 2015/11/4 17:09, haosdent wrote: > >> I notice >> ```

Re: mess slave can't register to master via master ip:port

2015-11-02 Thread haosdent
050: > Authentication discarded > Authenticating with master master@172.31.43.77:5050 > Using default CRAM-MD5 authenticatee > > Is this a bug?Or it is designed like this. > > BTW: --master:zk://xxx work well. > -- Best Regards, Haosdent Huang

Re: mess slave can't register to master via master ip:port

2015-11-02 Thread haosdent
After checking code, seems Mesos only support --master=IP1:5050 or --master=zk://xx or --master=file:///. On Tue, Nov 3, 2015 at 12:15 PM, haosdent <haosd...@gmail.com> wrote: > Do your masters have already managed by zookeeper? And what is your master > start command? > > O

Re: manage jobs log files in sandboxes

2015-11-05 Thread haosdent
them. > > Is it correct to just go to the mesos agent workdir and go through each > sandbox stdout/err and rotate them? I know that could break the log UI but > it doesn't scale very well having logs of several of GB. > > Thanks! > -- Best Regards, Haosdent Huang

Re: How is Mesos doing certificate verification for resources in URIs?

2015-11-04 Thread haosdent
; > *Confidentiality:*This communication is intended for the above-named > person and may be confidential and/or legally privileged. > If it has come to you in error you must take no action based on it, nor > must you copy or show it to anyone; please delete/destroy and inform the > sender immediately. > -- Best Regards, Haosdent Huang

Re: mesos 0.25.0 in docker: Failed to mount cgroups hierarchy at '/sys/fs/cgroup/freezer': 'freezer' is already attached to another hierarchy

2015-10-14 Thread haosdent
Linux (not docker container) runs fine. > > Any ideas ? > > thanks, > Harry > -- Best Regards, Haosdent Huang

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-07 Thread haosdent
marathon also use mesos health check. When I use health check, I could saw the log like this in executor stdout. ``` Registered docker executor on x Starting task test-health-check.822a5fd2-6cba-11e5-b5ce-0a002700 Launching health check process: /home/haosdent/mesos/build/src/.libs/mesos

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-07 Thread haosdent
0-d89c54f25668-S1/frameworks/20150821-214332-1407297728-5050-18973-/executors/app-81-1-hello-app_web-v11.b89f2ceb-6d62-11e5-9827-080027477de0/runs/73dbfe88-1dbb-4f61-9a52-c365558cdbfc/mesos-health-check" > should exist on? It definitely doesn't exist on the slave, hence > execution fai

Re: Running mesos-slave as a non-root user.

2015-10-08 Thread haosdent
eness > of the information contained herein. The intended recipient is advised to > consult its own professional advisors, including those specializing in > legal, tax and accounting matters. Orchard does not provide legal, tax or > accounting advice. > -- Best Regards, Haosdent Huang

Re: Transport endpoint is not connected

2015-10-16 Thread haosdent
sconnected! Waiting >> for a new master to be elected >> >> E1015 15:21:21.104575 25191 socket.hpp:174] Shutdown failed on fd=10: >> Transport endpoint is not connected [107] >> >> E1015 15:23:31.664559 25191 socket.hpp:174] Shutdown failed on fd=10: >> Transport endpoint is not connected [107] >> >> > -- Best Regards, Haosdent Huang

Re: Tasks with failed health-checks intermittently not restarted

2015-10-11 Thread haosdent
000 Health check process launched at pid: 24720 Received task health update, healthy: false Received task health update, healthy: false Received task health update, healthy: false Killing docker task Shutting down ``` Does your network latency affect this result? On Sun, Oct 11, 2015 at 6:18

Re: Tasks with failed health-checks intermittently not restarted

2015-10-11 Thread haosdent
Could not reproduce your problem in my side. But I guess it maybe related to this ticket. MESOS-1613 <https://issues.apache.org/jira/browse/MESOS-1613> HealthCheckTest.ConsecutiveFailures is flaky On Fri, Oct 9, 2015 at 12:13 PM, haosdent <haosd...@gmail.com> wrote: > I think i

Re: Broken images in documentation on web

2015-10-06 Thread haosdent
Sequence Diagrams") > > http://mesos.apache.org/documentation/latest/oversubscription/ > (under "How does it work?") > > However, some pages are OK, e.g. > http://mesos.apache.org/documentation/latest/mesos-architecture/ > > Could someone investigate please? > > Thanks, > > Brian Candler. > > -- Best Regards, Haosdent Huang

Re: [VOTE] Release Apache Mesos 0.25.0 (rc2)

2015-10-07 Thread haosdent
/mesos/0.25.0-rc2/mesos-0.25.0.tar.gz.asc > > > The PGP key used to sign the release is here: > > https://dist.apache.org/repos/dist/release/mesos/KEYS > > > The JAR is up in Maven in a staging repository here: > > https://repository.apache.org/content/repositories/orgapachemesos-1078 > > > Please vote on releasing this package as Apache Mesos 0.25.0! > > > The vote is open until Thu Oct 8 2:30 AM PST 2015 (expediting to get out > before MesosCon EU) and passes if a majority of at least 3 +1 PMC votes are > cast. > > > [ ] +1 Release this package as Apache Mesos 0.25.0 > > [ ] -1 Do not release this package because ... > > > Thanks, > > Mpark, Joris and Niklas > > > -- Best Regards, Haosdent Huang

Re: [VOTE] Release Apache Mesos 0.25.0 (rc2)

2015-10-07 Thread haosdent
several releases now. > > Artem. > > > On Wednesday, October 7, 2015, haosdent <haosd...@gmail.com> wrote: > >> I test it in CentOS 7.1 and got these failed tests: >> >> [ FAILED ] 5 tests, listed below: >> [ FAILED ] ExamplesTest.Python

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-06 Thread haosdent
; the string "health" or "Health" if the health-check were active? None of > my master or slave logs contain the string.. > > > > On Oct 6, 2015, at 7:45 PM, haosdent <haosd...@gmail.com> wrote: > > Could you use "exit 1" instead of "sleep

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-06 Thread haosdent
ood sized code base and I'm not very > familiar with it, so my analysis this far has by no means been exhaustive. > > > > On Oct 6, 2015, at 8:41 PM, haosdent <haosd...@gmail.com> wrote: > > When health check launch, it would have a log like this in your executor >

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-06 Thread haosdent
>>>> >>>> }, >>>> >>>> "shell":false >>>> >>>> }, >>>> >>>> "container":{ >>>> >>>> "type":1, >>>> >>>> "docker":{ >>>> >>>> "image":"docker-services1a:5000/gig1/app-81-1-hello-app-103", >>>> >>>> "network":2, >>>> >>>> "port_mappings":[ >>>> >>>> { >>>> >>>> "host_port":31002, >>>> >>>> "container_port":8000, >>>> >>>> "protocol":"tcp" >>>> >>>> } >>>> >>>> ], >>>> >>>> "privileged":false, >>>> >>>> "parameters":[], >>>> >>>> "force_pull_image":false >>>> >>>> } >>>> >>>> }, >>>> >>>> "health_check":{ >>>> >>>> "delay_seconds":5, >>>> >>>> "interval_seconds":10, >>>> >>>> "timeout_seconds":10, >>>> >>>> "consecutive_failures":3, >>>> >>>> "grace_period_seconds":0, >>>> >>>> "command":{ >>>> >>>> "shell":true, >>>> >>>> "value":"sleep 5", >>>> >>>> "user":"root" >>>> >>>> } >>>> >>>> } >>>> >>>> } >>>> >>>> >>> I have searched all machines and containers to see if they ever run the >>> command (in this case `sleep 5`), but have not found any indication that it >>> is being executed. >>> >>> In the mesos src code the health-checks are invoked from >>> src/launcher/executor.cpp CommandExecutorProcess::launchTask. Does this >>> mean that health-checks are only supported for custom executors and not for >>> docker tasks? >>> >>> What I am trying to accomplish is to have the 0/non-zero exit-status of >>> a health-check command translate to task health. >>> >>> Thanks! >>> Jay >>> >>> >> > -- Best Regards, Haosdent Huang

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-06 Thread haosdent
yes, adam also help commit it to 0.23.1 and 0.24.1 https://github.com/apache/mesos/commit/8c0ed92de3925d4312429bfba01b9b1ccbcbbef0 https://github.com/apache/mesos/commit/09e367cd69aa39c156c9326d44f4a7b829ba3db7 Are you use one of this version? On Wed, Oct 7, 2015 at 10:26 AM, haosdent <ha

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-06 Thread haosdent
Could you use "exit 1" instead of "sleep 5" to see whether could see unhealthy status in your task stdout/stderr. On Wed, Oct 7, 2015 at 10:38 AM, Jay Taylor <outtat...@gmail.com> wrote: > My current version is 0.24.1. > > On Tue, Oct 6, 2015 at 7:30 PM,

Re: Old docker version deployed

2015-10-06 Thread haosdent
or its attachments. In the event of incomplete or incorrect > transmission, please return the e-mail to the sender and permanently delete > this message and any attachments. > > Messages and attachments are scanned for all known viruses. Always scan > attachments before opening them. > -- Best Regards, Haosdent Huang

Re: Old docker version deployed

2015-10-06 Thread haosdent
n deployed > > > > Paul, > > > > Are you using the same tag every time? > > Kind regards, > Radek Gruchalski > ra...@gruchalski.com <ra...@gruchalski.com> > de.linkedin.com/in/radgruchalski/ > > > *Confidentiality: *This communicatio

Re: Old docker version deployed

2015-10-06 Thread haosdent
> > > > One thing I did notice was that on the master box, docker images misses > the version that should have been deployed (ie has version 77 and 79, but > no 78) > > > > *From:* haosdent [mailto:haosd...@gmail.com] > *Sent:* Tuesday, October 06, 2015 11:52 AM &g

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-08 Thread haosdent
could compare whether argv[0] is match with the launcher_dir you see in slave initialization log. On Fri, Oct 9, 2015 at 11:56 AM, haosdent <haosd...@gmail.com> wrote: > Yes. The related code is located in > https://github.com/apache/mesos/blob/master/src/slave/main.cpp#L123 > >

Re: Can health-checks be run by Mesos for docker tasks?

2015-10-08 Thread haosdent
Jay Taylor <outtat...@gmail.com> wrote: > I see. And then how are the flags sent to the executor? > > > > On Oct 8, 2015, at 8:56 PM, haosdent <haosd...@gmail.com> wrote: > > Yes. The related code is located in > https://github.com/apache/mesos/blob/master/sr

Re: Tasks with failed health-checks intermittently not restarted

2015-10-08 Thread haosdent
still in grace period >> *W1008 19:30:38.912325 7525 main.cpp:375] Health check failed Health >> command check exited with status 1* > > > Screenshot of the task still running despite health-check exited with > status code 1: > > http://i.imgur.com/zx9GQuo.png > > The expected behavior when the health-check binary has exited w/ non-zero > status is that the task would be killed and restarted (rather than > continuing to run as outlined above). > > - > Additional note: After hard-coding the "path" string of the health-check > binary parent dir into b/src/docker/executor.cpp, I am able to at least > test the functionality. The other issue of health-checks for docker tasks > failing to start is still unresolved due to the unpropagated > MESOS_LAUNCH_DIR issue. > > -- Best Regards, Haosdent Huang

Re: After restarting cluster task disappeared

2015-10-09 Thread haosdent
>>> >>> dataDir=/var/lib/zookeeper >>> clientPort=2181 >>> tickTime=2000 >>> initLimit=10 >>> syncLimit=20 >>> >>> >>> autopurge.purgeInterval=0 >>> >>> >>> zookeeper.connection.timeout.ms=6000 >>> server.1=10.1.0.70:2888:3888 >>> server.2=10.1.0.71:2888:3888 >>> server.3=10.1.0.72:2888:3888 >>> >>> And different *myid* has been given. >>> >>> >>> Can Anyone Help!!! >>> >>> >>> >> >> >> -- >> >> https://github.com/mindscratch >> https://www.google.com/+CraigWickesser >> https://twitter.com/mind_scratch >> https://twitter.com/craig_links >> >> >> > > > -- > > https://github.com/mindscratch > https://www.google.com/+CraigWickesser > https://twitter.com/mind_scratch > https://twitter.com/craig_links > > -- Best Regards, Haosdent Huang

Re: Docker Registry 2.0 + Mesos + Marathon

2015-07-10 Thread haosdent
Currently Mesos still only support registry 1.0, it should be better if it support registry 2.0. On Fri, Jul 10, 2015 at 7:31 PM, haosdent haosd...@gmail.com wrote: Looks need do some improvements in Mesos for support docker 1.6. Could you fill a issue in https://issues.apache.org/jira/browse

Re: mesos-master resource offer details

2015-08-31 Thread haosdent
How can I list the number of slaves registered with the master and the > details of the slaves on the command line( apart from seeing it in the UI)? > > Thanks for the help. > > -- > Regards, > Haripriya Ayyalasomayajula > > -- Best Regards, Haosdent Huang

Re: Are the resource options documented?

2015-08-25 Thread haosdent
-- Best Regards, Haosdent Huang

  1   2   3   4   5   >