Re: Proposal for evaluating Mesos scalability and robustness through stress test.

[Vinod Kone]

Great to hear!

Haven't looked at the doc yet, but I know some folks from Twitter were also
interested this.  https://issues.apache.org/jira/browse/MESOS-6768

Probably worth to see if the ideas can be consolidated?

On Fri, Jan 6, 2017 at 6:57 PM, Zhitao Li  wrote:

> (sending this again since previous attempt seemed bumped back)
>
> Hi folks,
>
> As all of you we are super excited to use Mesos to manage thousands of
> different applications on  our large-scale clusters. When the application
> and host amount keeps increasing, we are getting more and more curious
> about what would be the potential scalability limit/bottleneck to Mesos'
> centralized architecture and what is its robustness in the face of various
> failures. If we can identify them in advance, probably we can manage and
> optimize them before we are suffering in any potential performance
> degradations.
>
> To explore Mesos' capability and break the knowledge gap, we have a
> proposal to evaluate Mesos scalability and robustness through stress test,
> the draft of which can be found at: draft_link
>  qpXzHYFQAZGWjCdS3cZA/edit?usp=sharing>.
> Please
> feel free to provide your suggestions and feedback through comment on the
> draft.
>
> Probably many of you have similar questions as we have. We will be happy to
> share our findings in these experiments with the Mesos community. Please
> stay tuned.
>
> --
> Cheers,
>
> Ao Ma & Zhitao Li
>

Proposal for evaluating Mesos scalability and robustness through stress test.

[Zhitao Li]

(sending this again since previous attempt seemed bumped back)

Hi folks,

As all of you we are super excited to use Mesos to manage thousands of
different applications on  our large-scale clusters. When the application
and host amount keeps increasing, we are getting more and more curious
about what would be the potential scalability limit/bottleneck to Mesos'
centralized architecture and what is its robustness in the face of various
failures. If we can identify them in advance, probably we can manage and
optimize them before we are suffering in any potential performance
degradations.

To explore Mesos' capability and break the knowledge gap, we have a
proposal to evaluate Mesos scalability and robustness through stress test,
the draft of which can be found at: draft_link
.
Please
feel free to provide your suggestions and feedback through comment on the
draft.

Probably many of you have similar questions as we have. We will be happy to
share our findings in these experiments with the Mesos community. Please
stay tuned.

-- 
Cheers,

Ao Ma & Zhitao Li

Re: [MESOS-6240] Allow executor/agent communication over non-TCP/IP stream socket.

[Greg Mann]

Hi Bingqiang,
I've had some recent discussions with folks about this feature; it's
something we are interested in doing but I'm not sure what its priority is
in relation to other tickets.

While the AF_UNIX address type has been added to libprocess, libprocess
does not currently accept domain socket connections. Domain sockets are
used by the I/O switchboard in the Mesos agent to communicate with running
containers, but this is mostly application-level code. Libprocess currently
exposes a single server-side TCP socket [1] for incoming connections. To
support executor communication via domain sockets, we would need to add a
new server-side domain socket to libprocess.

Are there any particular goals or use cases you have in mind for this
feature?

Cheers,
Greg

[1]
https://github.com/apache/mesos/blob/be127e6eca1312bf8c2b039646f6909fa42cd342/3rdparty/libprocess/src/process.cpp#L571



On Mon, Dec 19, 2016 at 3:54 AM, pangbingqiang 
wrote:

> Hi all:
>
>What’s the latest information about MESOS-6240
> https://issues.apache.org/jira/browse/MESOS-6240 ,have any demo or design
> achieve?
>
> I see libprocess have support domain socket communication, does agent and
> executor have support communication by domain socket too?
>
> If have any related imformation, please let me know, thanks~.
>
>
>
> [image: cid:image001.png@01D0E8C5.8D08F440]
>
>
>
> Bingqiang Pang(庞兵强)
>
>
>
> Distributed and Parallel Software Lab
>
> Huawei Technologies Co., Ltd.
>
> Email:pangbingqi...@huawei.com 
>
>
>
>
>

Re: cron-like scheduling in mesos framework?

[Radek Gruchalski]

Chronos launches a task on Mesos whenever a scheduled event is bound to
happen.
You can run a container task with Chronos, n problem:

https://mesos.github.io/chronos/docs/api.html#job-configuration

Check the container field.

–
Best regards,
Radek Gruchalski
ra...@gruchalski.com


On January 6, 2017 at 7:17:36 PM, l vic (lvic4...@gmail.com) wrote:

Chronos is a separate service... I have database cluster running as Mesos
framework. I have to  periodically schedule data backups using shell
scripts within running docker container. Is that possible with Chronos?

On Fri, Jan 6, 2017 at 11:47 AM, Radek Gruchalski 
wrote:

> There are two options:
>
> - https://github.com/dcos/metronome
> - https://github.com/mesos/chronos
>
> while Metronome, apparently, being a successor of Chronos.
>
> –
> Best regards,
> Radek Gruchalski
> ra...@gruchalski.com
>
>
> On January 6, 2017 at 5:40:45 PM, l vic (lvic4...@gmail.com) wrote:
>
> Hi,
> Is there a way to schedule mesos framework task for execution at certain
> day/time?
> Thank youm
> -V
>
>

Re: cron-like scheduling in mesos framework?

[l vic]

Chronos is a separate service... I have database cluster running as Mesos
framework. I have to  periodically schedule data backups using shell
scripts within running docker container. Is that possible with Chronos?

On Fri, Jan 6, 2017 at 11:47 AM, Radek Gruchalski 
wrote:

> There are two options:
>
> - https://github.com/dcos/metronome
> - https://github.com/mesos/chronos
>
> while Metronome, apparently, being a successor of Chronos.
>
> –
> Best regards,
> Radek Gruchalski
> ra...@gruchalski.com
>
>
> On January 6, 2017 at 5:40:45 PM, l vic (lvic4...@gmail.com) wrote:
>
> Hi,
> Is there a way to schedule mesos framework task for execution at certain
> day/time?
> Thank youm
> -V
>
>

Re: cron-like scheduling in mesos framework?

[Erb, Stephan]

Apache Aurora does also support cron scheduling (in addition to adhoc jobs and 
long running services). In contrast to chronos however, it does not support 
dependency chains.

From: l vic lvic4...@gmail.com
Reply-To: "user@mesos.apache.org" 
Date: Friday, 6 January 2017 at 17:40
To: "user@mesos.apache.org" 
Subject: cron-like scheduling in mesos framework?

Hi,
Is there a way to schedule mesos framework task for execution at certain 
day/time?
Thank youm
-V

Re: cron-like scheduling in mesos framework?

[Steven Schlansker]

Singularity also supports this well, https://github.com/HubSpot/Singularity 
(and it is a framework where you can do both "regular" and "scheduled" tasks 
through one interface)

> On Jan 6, 2017, at 8:47 AM, Tomas Barton  wrote:
> 
> Hi,
> 
> try Chronos framework https://mesos.github.io/chronos/
> 
> Tomas
> 
> On 6 January 2017 at 17:40, l vic  wrote:
> Hi,
> Is there a way to schedule mesos framework task for execution at certain 
> day/time?
> Thank youm
> -V
> 



signature.asc
Description: Message signed with OpenPGP using GPGMail

Re: cron-like scheduling in mesos framework?

[Tomas Barton]

Hi,

try Chronos framework https://mesos.github.io/chronos/

Tomas

On 6 January 2017 at 17:40, l vic  wrote:

> Hi,
> Is there a way to schedule mesos framework task for execution at certain
> day/time?
> Thank youm
> -V
>

Re: cron-like scheduling in mesos framework?

[Radek Gruchalski]

There are two options:

- https://github.com/dcos/metronome
- https://github.com/mesos/chronos

while Metronome, apparently, being a successor of Chronos.

–
Best regards,
Radek Gruchalski
ra...@gruchalski.com


On January 6, 2017 at 5:40:45 PM, l vic (lvic4...@gmail.com) wrote:

Hi,
Is there a way to schedule mesos framework task for execution at certain
day/time?
Thank youm
-V

Re: cron-like scheduling in mesos framework?

[haosdent]

You may try https://github.com/mesos/chronos or
https://github.com/farmapromlab/rundeck-mesos-plugin

On Sat, Jan 7, 2017 at 12:40 AM, l vic  wrote:

> Hi,
> Is there a way to schedule mesos framework task for execution at certain
> day/time?
> Thank youm
> -V
>



-- 
Best Regards,
Haosdent Huang

cron-like scheduling in mesos framework?

[l vic]

Hi,
Is there a way to schedule mesos framework task for execution at certain
day/time?
Thank youm
-V