Re: [Replicated Log] Enable Mesos to use etcd for replicated_log

2016-07-13 Thread Shuai Lin
[1] https://github.com/apache/mesos/blob/master/src/log/network.hpp#L316 > > Shuai Lin <linshuai2...@gmail.com> wrote on 07/11/2016 00:13:12: > > > From: Shuai Lin <linshuai2...@gmail.com> > > To: dev <dev@mesos.apache.org> > > Cc: Jie Yu <j...@mesospher

Re: [Replicated Log] Enable Mesos to use etcd for replicated_log

2016-07-10 Thread Shuai Lin
> > i.e. The MasterContender is the piece that decides the "coordinator" of the > replicated log. IINM master contender/detector is not related to replicated logs. The only thing they have in common (when using zookeeper) is they both get the zookeeper servers list from the `--zk` flag. On

Re: [Compilation Error][aufs] Getting erros compiling latest code on OSX

2016-06-07 Thread Shuai Lin
; Error 1 > make[1]: *** Waiting for unfinished jobs.... > > > > I guess it has something to do with these commits? > > commit e5358ed1c132923d5fa357d1e337e037d1f29c8a > Author: Shuai Lin <linshuai2...@gmail.com> > Date: Mon Jun 6 18:05:15 2016 -0700 > > Added aufs provisioning backen

Re: mesos 0.28.2 release doesn't update version number

2016-06-07 Thread Shuai Lin
configure.ac is correct: https://github.com/apache/mesos/blob/0.28.2/configure.ac#L21 CMakeLists.txt is kinda out of date: https://github.com/apache/mesos/blob/0.28.2/CMakeLists.txt#L22-L24 On Tue, Jun 7, 2016 at 3:51 PM, Chengwei Yang wrote: > On Tue, Jun 07, 2016

Re: Documentation about debugging mesos-master : newbie

2016-06-03 Thread Shuai Lin
+1 for setting CFLAGS and CXXFLAGS, I used to call configure like this: ``` CFLAGS=-ggdb3 CXXFLAGS=-ggdb3 ../configure ... ``` On Fri, Jun 3, 2016 at 6:13 PM, Evers Benno wrote: > A random guess, but gdb tends to load shared libraries only after you do > "run" for the

Re: Does Mesos have official dailybuild packages?

2016-05-09 Thread Shuai Lin
This repo may be helpful if you want to build deb pkgs yourself: https://github.com/mesosphere/mesos-deb-packaging On Tue, May 10, 2016 at 1:17 PM, zhiwei wrote: > Hi all, > > When a user want to use Mesos from master branch, how should he do? Compile > from source code? > >

Re: mesos-logrotate-logger binary package problem?

2016-05-05 Thread Shuai Lin
That program is not meant to be executed manually. Instead you should configure the logger in the modules flags of your mesos slave. Here is a snippets of a script I used when testing the logrotate logger, you can adjust for your own use case: MODULES_JSON_FILE=/tmp/modules.json cat

Re: [02/11] mesos git commit: Added support for contender and detector modules.

2016-04-07 Thread Shuai Lin
Hi Kapil, I created a JIRA about improving the test cpp framework to be able to load detectors from modules, to make it easier for writing script tests for the etcd contender/dector module I'm working on. Actually it could benefit any contender/detector module developer. Do you think it make

Re: Looking for a shepherd for MESOS-4878

2016-03-18 Thread Shuai Lin
Ping. On Thu, Mar 10, 2016 at 3:55 PM, Shuai Lin <linshuai2...@gmail.com> wrote: > The bug is: if a framework launches a task with mesos containerizer and a > docker image, and the slave failed to fetch the image for any reason, the > task state would be stuck in STAGING for

Re: shepherd for MESOS-4735, and proposal

2016-03-14 Thread Shuai Lin
+1 for the new `filename` field for the URI. It would also be useful for implementing base64:// or data:// scheme uri fetcher, so that the scheduler can pass arbitary file blobs to the task directly without resorting to a custom executor. (https://issues.apache.org/jira/browse/MESOS-4524) On Tue,

Re: Improving the Upgrade Documentation

2016-03-12 Thread Shuai Lin
One thing I would strongly recommend is to add to the doc is "not to skip versions when upgrading" as commented by Adam in this thread: https://mail-archives.apache.org/mod_mbox/mesos-user/201512.mbox/%3ccak8jagnbphph7vso+p8ovpupmddd93znxyyvhxkqecanhqk...@mail.gmail.com%3E . With the recently

Looking for a shepherd for MESOS-4878

2016-03-09 Thread Shuai Lin
The bug is: if a framework launches a task with mesos containerizer and a docker image, and the slave failed to fetch the image for any reason, the task state would be stuck in STAGING forever. https://issues.apache.org/jira/browse/MESOS-4878 @jieyu can you shepherd it? Thanks!

Re: [jira] [Updated] (MESOS-3583) Introduce stream IDs in HTTP Scheduler API

2016-03-04 Thread Shuai Lin
s probably >> worth calling it out prominently. >> >> On Fri, Mar 4, 2016 at 12:58 AM, Shuai Lin <linshuai2...@gmail.com> >> wrote: >> >>> If I understand it correctly, this change would break all existing >>> frameworks that use the http scheduler

Re: [jira] [Updated] (MESOS-3583) Introduce stream IDs in HTTP Scheduler API

2016-03-04 Thread Shuai Lin
If I understand it correctly, this change would break all existing frameworks that use the http scheduler api, should we include a notice for it in the release note? On Fri, Mar 4, 2016 at 5:48 AM, Vinod Kone (JIRA) wrote: > > [ >

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

2016-03-04 Thread Shuai Lin
> > * [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1 > Scheduler API. > * [MESOS-4591] - Change the object of ReserveResources and CreateVolume > ACLs to `roles`. > * [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1 > Scheduler API. MESOS-4712 is

Re: Looking for shepherd of three trivial tickets

2016-03-02 Thread Shuai Lin
Hi Alex, Could you please shepherd these tickets? Thanks! On Mon, Feb 29, 2016 at 10:17 AM, Shuai Lin <linshuai2...@gmail.com> wrote: > Hi, > > Can anyone shepherd these trivial tickets? All of them are about speeding > up tests by advancing the clock. > > https://issue

Looking for shepherd of three trivial tickets

2016-02-28 Thread Shuai Lin
Hi, Can anyone shepherd these trivial tickets? All of them are about speeding up tests by advancing the clock. https://issues.apache.org/jira/browse/MESOS-3775 (RR https://reviews.apache.org/r/43329/) https://issues.apache.org/jira/browse/MESOS-4160 (RR https://reviews.apache.org/r/43524/)

Re: Framework disconnect kills running tasks

2016-02-10 Thread Shuai Lin
Hi suppandi, To make sure your tasks survive framework restarts, you need to: 1. When registering your framework, set `failover_timeout` attribute of the FrameworkInfo PB. This is how long the master would wait for your framework to reconnect. By default it's 0, that's why your tasks are killed

Re: are mesos package version names predictable?

2016-02-04 Thread Shuai Lin
+1 for removing the build number from the version number of mesosphere-released deb/rpm pkgs. On Fri, Feb 5, 2016 at 5:51 AM, Till Toenshoff wrote: > Hey Erik, > > those added values (e.g. “-0.2.190") come from Mesosphere's CI system > which adds build-numbers (the last digit)

Re: Mesos 0.27.0 release update

2016-01-22 Thread Shuai Lin
Tests all passed in ubuntu 14.04 with kernel 3.13 and docker engine 1.9.1. On Sat, Jan 23, 2016 at 3:11 AM, Timothy Chen wrote: > Hi all, > > (Kapil, MPark and I) We're still having 3 blocker issues outstanding > at this moment: > > MESOS-4449: SegFault on agent during

About MESOS-1806 (Etcd as an alternative to zookeeper)

2016-01-19 Thread Shuai Lin
Hi Benjamin and all, I'd like to talk about MESOS-1806. Since I took this ticket from halfway, and there was no design doc for it, I have created one based on the current implementation. https://docs.google.com/document/d/1ccY0XJoOODpIiGPllSVvl7t-YRrIEE_NavfbZHKPWBs/edit?usp=sharing Besides,

Looking for a shepherd for MESOS-4258

2016-01-06 Thread Shuai Lin
Hi list, I'm working on MESOS-4258 , "Generate xml test reports in the jenkins build", , It's a quite trivial patch, here is the review request: https://reviews.apache.org/r/42011 Hope someone could shepherd this, thanks! Shuai

Re: [MESOS-1865] Redirect to the leader master when current master is not a leader.

2016-01-06 Thread Shuai Lin
Regarding this issue, I see non-active marathon instance would proxy http requests to the active marathon instance. This way no matter which marathon instance the client is visiting, it would always get the correct result. Could we do the same with mesos masters? The implementation would be more

Re: Mesos build & testing environment instructions

2016-01-05 Thread Shuai Lin
+1 The current version of get-started.md lacks introduction into . Today I tried to run a docker container test case "ROOT_DOCKER_DestroyWhileFetching", but by default it's disabled unless I use "sudo make check". I'm not aware of that until I dig into the test environment/filters code. This

Re: Where's Meses design documents

2015-12-25 Thread Shuai Lin
@haosdent Good job! I think it's worth being added somewhere in the mesos dev documentation. How did you collect those doc links? Is it possible to keep it always up to date, e.g. with some script? On Sat, Dec 26, 2015 at 1:36 PM, haosdent wrote: > Recently I try to find

Re: ContainerId in TaskStatus message: can't find update in mesos.proto

2015-12-21 Thread Shuai Lin
>From what I read in the ticket, What's done is "adding the output of `docker output` to the `data` field of TaskStatus message when a task is in TASK_RUNNING state', so the related protobuf field is TaskStatus.data, not a specific 'containerid' field. See

Re: Injecting data into mesos container

2015-12-01 Thread Shuai Lin
t? > > > > 2015-11-30 23:32 GMT+08:00 Adam Medziński <adam.medzin...@gmail.com>: > > > >> Yes, but it will also make that data available in mesos web UI. I need > >> this data to be available only for task process. > >> > >> On 30 November

Re: Injecting data into mesos container

2015-12-01 Thread Shuai Lin
through all the possible http api endpoint to make sure of it. On Tue, Dec 1, 2015 at 10:12 PM, Shuai Lin <linshuai2...@gmail.com> wrote: > > On Tue, Dec 1, 2015 at 1:28 AM, Adam Medziński <adam.medzin...@gmail.com> > wrote: > >> My fault, my description of the problem was

Re: Injecting data into mesos container

2015-11-30 Thread Shuai Lin
gt; > > > > > > > > > If you use Docker container, you could use "nsenter" command > > > > > https://docs.docker.com/engine/reference/commandline/exec/ . But > > > because > > > > > you use Mesos container, I think in

Re: Anyone successfully setup CLION with mesos?

2015-11-28 Thread Shuai Lin
I would strongly recommend rtags here. https://github.com/Andersbakken/rtags. It belongs to the same family of tools that use libclang to parse the code like YouCompleteMe, but it beats all other similar open source tools I've used (youcompleteme, irony-mode, xTags, etc.). on code browsing like

Re: Anyone successfully setup CLION with mesos?

2015-11-28 Thread Shuai Lin
Some screenshots about rtags with mesos code: http://imgur.com/gallery/DbsPg On Sun, Nov 29, 2015 at 11:06 AM, Shuai Lin <linshuai2...@gmail.com> wrote: > I would strongly recommend rtags here. > https://github.com/Andersbakken/rtags. It belongs to the same family of > tools th

Re: More Project Structure in JIRA

2015-10-25 Thread Shuai Lin
+1 On Wed, Oct 21, 2015 at 12:55 AM, Greg Mann wrote: > +1 > > On Tue, Oct 20, 2015 at 9:50 AM, tommy xiao wrote: > > > +1 Yes please! > > > > 2015-10-19 16:09 GMT+08:00 Alexander Rojas : > > > > > +1 Yes please! > > > > > > > On

Re: Proposal: moving Mesos website to project codebase

2015-10-11 Thread Shuai Lin
+1 On Sat, Oct 10, 2015 at 11:41 PM, Jake Farrell wrote: > The svnpubsub mechanism in use currently only requires that the html code > for the site be committed to svn to be deployed, where the pre-generated > code lives does not matter, and agree that moving it to the main

need help/shepherd on MESOS-1806

2015-09-18 Thread Shuai Lin
Hi, I am working on MESOS-1806 (substitute zookeeper with etcd) based on the former work of Cody Maloney. After a general understanding of mesos code base, this week I rebased the code to the latest master (with necessary changes), and it compiles well. The code is here:

Re: Mesos/Marathon support for Docker extension

2015-06-06 Thread Shuai Lin
Hi Khanduja, What I understand the slave code which calls in docker cli would need this additional parameter to be passed into. I don't think mesos slave invokes docker cli directly. It calls the docker api instead. Also Is there any official documentation/introduction to docker plugin or

Please add me to jira group

2015-05-26 Thread Shuai Lin
Hi list, I asked for joining the mesos contributors jira group last week, but seems no one replied so far: https://www.mail-archive.com/dev%40mesos.apache.org/msg32459.html So could anyone please do that at your convenience? My jira username is lins05. Best Regards, Shuai Lin

Re: Please add me to mesos contributors

2015-05-26 Thread Shuai Lin
ping, anyone can help? On Sun, May 24, 2015 at 10:19 AM, Shuai Lin linshuai2...@gmail.com wrote: Hi all, I would like to contribute to the following mesos issues: MESOS-1806 MESOS-2724 Could someone add me to contributors group? My jira username is lins05. Thanks! Best