Re: Welcome Andrei Sekretenko as a new committer and PMC member!

Congratulations! On Wed, Jan 22, 2020 at 5:42 AM Benjamin Mahler wrote: > Please join me in welcoming Andrei Sekretenko as the newest committer and > PMC member! > > Andrei has been active in the project for almost a year at this point and > has been a productive and collaborative member of the

Re: Welcome Benno Evers as committer and PMC member!

Congratulations! -- Klaus On Thu, Jan 31, 2019 at 7:31 PM Andrei Budnik wrote: > Congratulations! > > On Thu, Jan 31, 2019 at 2:41 AM Benjamin Mahler > wrote: > >> Welcome Benno! Thanks for all the great contributions >> >> On Wed, Jan 30, 2019 at 6:21 PM Alex R wrote: >> >> > Folks, >> >

Re: Welcome Zhitao Li as Mesos Committer and PMC Member

Congrats ! Da (Klaus), Ma (马达) | PMP® | Kubernetes Maintainer, Architect IBM Cloud Private, IBM Spectrum Computing, IBM System +86-10-8245 4084 | mad...@cn.ibm.com | @k82cn <http://github.com/k82cn> On Tue, Mar 13, 2018 at 7:44 AM, Yan Xu <y...@jxu.me> wrote: > Congrats! >

Re: Welcome Andrew Schwartzmeyer as a new committer and PMC member!

t; > > Here is his committer candidate checklist for your perusal: > > https://docs.google.com/document/d/1MfJRYbxxoX2-A- > > g8NEeryUdUi7FvIoNcdUbDbGguH1c/ > > > > Congrats Andy! > > ~Joseph > -- Regards, Da (Klaus), Ma (马达), PMP® | Software Architect IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me

Re: Welcome James Peach as a new committer and PMC memeber!

Congrats !! Da (Klaus), Ma (马达) | PMP® | R of IBM Cloud private IBM Spectrum Computing, IBM System +86-10-8245 4084 | mad...@cn.ibm.com | @k82cn <http://github.com/k82cn> On Thu, Sep 7, 2017 at 3:08 PM, tommy xiao <xia...@gmail.com> wrote: > Congrats James! Well deserved! &g

Re: Welcome Greg Mann as a new committer and PMC member!

Congrats! > On 14 Jun 2017, at 06:29, Ben Lin wrote: > > Congrats Greg, well deserved! > > From: Jie Yu > Sent: Wednesday, June 14, 2017 5:54:48 AM > To: user > Cc: dev > Subject: Re: Welcome Greg Mann as a new committer and PMC member! > >

Re: Welcome Gilbert Song as a new committer and PMC member!

Congrats! > On 25 May 2017, at 03:39, Greg Mann > wrote: > > Congratulations Gilbert!! :D > > On Wed, May 24, 2017 at 12:01 PM, Avinash Sridharan > wrote: > Congrats Gilbert !! Very well

Re: Welcome Gilbert Song as a new committer and PMC member!

t;>> > > >> > >>> > > Gilbert has been working on Mesos project for 1.5 years now. His >> > main >> > >>> > > contribution is his work on unified containerizer, nested >> container >> > >>> (aka >

Re: Could mesos be a replacement for yarn?

em on mesos? Do these > work: Hive, Oozie, Sqoop, MRv2, Pig? > > Thanks in advance and best regards > -- Regards, Da (Klaus), Ma (马达), PMP® | Software Architect IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me

Re: Structured logging for Mesos (or c++ glog)

g. I'm thinking of event > logging formats are customizable by the operator and allow the > interpolation of context-specific data item (eg. HTTP access logs from many > different server implementations). > > J > > > > > -- > Cheers, > > Zhitao Li > -- Regards, Da (Klaus), Ma (马达), PMP® | Software Architect IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me

Re: How to shutdown mesos-agent gracefully?

> 2016-10-11 14:47 GMT+08:00 haosdent <haosd...@gmail.com>: > > > > > gracefully means not affect running tasks? > > > > > > On Tue, Oct 11, 2016 at 2:36 PM, Klaus Ma <klaus1982...@gmail.com> > > wrote: > > > > > >> It see

How to shutdown mesos-agent gracefully?

It seems there's not a way to shutdown mesos-agent gracefully. Maintenance feature expect the agents re-register back in the future. Thanks Klaus -- Regards, Da (Klaus), Ma (马达), PMP® | Software Architect IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm

Re: How many roles are we supported?

frameworks; > - up to low tens of thousands of agents. > > On Thu, Sep 8, 2016 at 12:42 AM, Klaus Ma <klaus1982...@gmail.com> wrote: > > > any suggestion? > > > > On Wed, Sep 7, 2016 at 11:35 AM Klaus Ma <klaus1982...@gmail.com> wrote: > > > >>

Re: How many roles are we supported?

any suggestion? On Wed, Sep 7, 2016 at 11:35 AM Klaus Ma <klaus1982...@gmail.com> wrote: > + user@ > > > On Wed, Sep 7, 2016 at 11:31 AM Klaus Ma <klaus1982...@gmail.com> wrote: > >> IMO, it does not make sense to let user to try it :). It's better for us >

Re: How many roles are we supported?

+ user@ On Wed, Sep 7, 2016 at 11:31 AM Klaus Ma <klaus1982...@gmail.com> wrote: > IMO, it does not make sense to let user to try it :). It's better for us > (Mesos Dev) to provide suggestion :). > > On Wed, Sep 7, 2016 at 11:27 AM Zhitao Li <zhitaoli...@gmail.com> wro

RE: Request offers based on Slave Attributes

Hi Nihal, Currently, the Mesos master/allocator will ignore "requestResources"; as Guangya said, please filter out the necessary by slave's attributes when you got offers. ----Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10

RE: 1.0 Release Candidate

v1.0, exciting :). Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me > Date: Sun, 29 May 2016 02:31:47 -0700 > Subject: Re: 1.0 Release Candidate > From: a...@meso

Re: interplay of reservations and quotas

Currently (0.28+), the reserved resources are also account into quota. For your case, the framework will get the 50 reserved CPU and 50 CPU from "*"; the other 100 CPU will NOT offer to this framework even no other frameworks. Da (Klaus), Ma (马达) | PMP® | Advisory Software Enginee

Re: Change the role of a framework

maybe we can create a document for it in FAQ umbrella :). Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Fri, Apr 29, 2016 at 11:13 AM, Vinod Kone <vinodk...@apache.org>

Re: Altering agent resrouces after startup

eworks > too.. > > > -- > > Aaron Carey > Production Engineer - Cloud Pipeline > Industrial Light & Magic > London > 020 3751 9150 > > -- > *From:* Klaus Ma [klaus1982...@gmail.com] > *Sent:* 20 April 2016 10:22 > *To:* user

Re: Altering agent resrouces after startup

that EBS > volume all on the same host. > > Anyone have any ideas? > > Thanks! > > > Aaron > -- Regards, Da (Klaus), Ma (马达), PMP® | Advisory Software Engineer IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me

Re: Checking success of resource reservations

Please try "curl -s http://mesos_master:5050/roles | python -m json.tool" to get roles's info including reservation. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On S

Re: Framework taking default resources even though a role is specified

Which version are you using? For your requirement, I think you can try Quota; currently, the resources beyond quota will not offer to the framework whose quota satisfied. Quota will also include reserved resources. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource

Re: [Proposal] Remove the default value for agent work_dir

+1 Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Wed, Apr 13, 2016 at 11:14 PM, Paul <arach...@gmail.com> wrote: > +1 > > On Apr 13, 2016, at 11:01 AM,

Re: Failed to locate systemd cgroups hierarchy

alize systemd: Failed to locate systemd cgroups hierarchy: > does not exist > > > Rinaldo -- Regards, Da (Klaus), Ma (马达), PMP® | Advisory Software Engineer IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me

RE: Port Resource Offers

Yes, all port resources must be ranges for now, e.g. 31000-35000. There’s already JIRA (MESOS-4627: Improve Ranges parsing to handle single values) on that, patches are pending on review :). Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG

Re: Can mesos support supports multi-datacenter and multi-region configurations for failure isolation and scalability.

There's some discussion at https://issues.apache.org/jira/browse/MESOS-3548 . Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Sat, Mar 19, 2016 at 8:16 PM, tommy xiao <

Re: Unstability on Mesos 0.27

If Mesos daemon crashed, I'd suggest to log a JIRA and append more detail, e.g. steps, master/agent log. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Thu, Mar 17, 2016 at 8

Re: Mesos 0.27 and docker

Hi Walter, I think you're talking about Docker in Mesos without Marathon; if so, please check the second doc: http://mesos.apache.org/documentation/latest/docker-containerizer/ Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245

Re: mesos master 0.27.1 needs g++ to execute ?

Hi KR, Can you share the error message? Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Sun, Mar 6, 2016 at 8:22 PM, kr di <k...@outlook.com> wrote: > I have docke

Re: limiting nodes to specific frameworks

):16"), Marathon (--mesos_roles="master" or --mesos_roles="agent") can only get resources from one of them: "master" or "agent". There's EPIC to support multiple roles in Mesos (MESOS-1763). Da (Klaus), Ma (马达) | PMP® | Advisory Softwar

Re: Mesos sometimes not allocating the entire cluster

@Tom, one more question: how about your task run time? If the task run time is too short, e.g. 100ms, the resources will be return to allocator when task finished and will allocate it until next allocation cycle. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource

Re: Reusing Task IDs

-registering back T4: agent_1 re-registered back; master'll crash because of `CHECK` when add task (t1) back to master Is there any special case that framework has to re-use the TaskID; if no special case, I think we should ask framework to avoid reuse TaskID. Da (Klaus), Ma (马达) | PMP® | Advisory

RE: Mesos sometimes not allocating the entire cluster

Hi Tom, What's the allocation interval, can you try to reduce filter's timeout of framework? According to the log, ~12 frameworks on cluster with ~42 agents; the filter duration is 5sec, and there're ~60 times filtered in each seconds (e.g. 65 in 18:08:34). For example, framework

Re: Specifying a preferred host with a Resource Request

the API of >>>> "requestResources"? >>>> It would be great if you can append some background for your request so >>>> that the community can evaluate how to move this forward. >>>> >>>> Thanks, >>>> >>>> Guangya >

Re: Managing Persistency via Frameworks (HDFS, Cassandra)

esosphere/cassandra-mesos > [3] https://github.com/mesosphere/hdfs/issues/23 > [4] https://github.com/mesosphere/cassandra-mesos/issues/137 > -- Regards, Da (Klaus), Ma (马达), PMP® | Advisory Software Engineer IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me

Re: Specifying a preferred host with a Resource Request

pecify the preferredHost with >>> the resource request. >>> >>> Is there a way to specify a preferred host with the resource request in >>> Mesos? >>> >>> I currently do: >>> >>> driver.requestResources (resources); >>

Re: Mesos sometimes not allocating the entire cluster

Can you share the whole log of master? I'll be helpful :). Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Thu, Jan 21, 2016 at 11:57 PM, Tom Arnfeld <t...@duedil.com>

Re: Mesos sometimes not allocating the entire cluster

Yes, it seems Hadoop framework did not consume all offered resources: if framework launch task (1 CPUs) on offer (10 CPUs), the other 9 CPUs will return back to master (recoverResouces). Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86

Re: Mesos sometimes not allocating the entire cluster

set of frameworks, starving others. > > On 21 January 2016 at 13:17, Klaus Ma <klaus1982...@gmail.com> wrote: > >> Yes, it seems Hadoop framework did not consume all offered resources: if >> framework launch task (1 CPUs) on offer (10 CPUs), the other 9 CPUs will >&g

Re: Mesos sometimes not allocating the entire cluster

US; the other 15 CPUS will return back to master and did not re-offer until filter timeout (5s). I had pull a request to make Swarm's parameters configurable, refer to https://github.com/docker/swarm/pull/1585. I think you can check this case by master log. If any comments, please let me know. -

Re: Share GPU resources via attributes or as custom resources (INTERNAL)

Yes, "attributes" is the way for now. But after Marathon supporting Mesos' Multiple Roles (MESOS-1763), you can use role info to define resource groups. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform OpenSource Technology, STG, IBM GCG +86-10-8245 4084 |

Re: How to start two slaves on a single machine?

The resources of slave can be defined by "--resources"; but can not define 50% cpu by default. There's a module in Agent to report how many resources can be used by current slave. For this case, "--resources" is enough for him :). Da (Klaus), Ma (马达) | PMP® | Adviso

Re: Why are FrameworkToExecutorMessage and ExecutorToFrameworkMessage transmitted along different paths?

lave failover case. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Tue, Jan 5, 2016 at 10:47 PM, sujz.buaa <sujz.b...@qq.com> wrote: > Hi, all: >

Re: Running mesos slave in Docker on CoreOS

@ Graham, just check mesosphere/mesos-slave; it seems not include docker binaries images; so I think you can try to mount docker binaries into this docker image (please pay attention to dependencies), or re-build the image yourself. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer

Re: make slaves not getting tasks anymore

uot;, it's used when there're some tasks took too long time to finish; so Operator can task action to shut them down. For the agent restart with new attributes, there's a JIRA (MESOS-1739) about it. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development &

Re: More filters on /master/tasks enpoint and filters on /master/state

+1 It'll also reduce master's workload; but instead of label, I'd like to make master simpler: return tasks page by page and let framework/dashboard to filter it themself. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG

Re: The issue of "Failed to shutdown socket with fd xx: Transport endpoint is not connected" on Mesos master

It seems Kubernetes is down; would you help to check kubernetes's status (km)? Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Mon, Dec 28, 2015 at 6:35 PM,

Re: Can tasks from multiple frameworks simultaneously run on the same slave node?

everal features to enhance multi-tenant, such as Quota (MESOS-1791 <https://issues.apache.org/jira/browse/MESOS-1791>), Optimistic Offer ( MESOS-1607 <https://issues.apache.org/jira/browse/MESOS-1607>) and Implicit/Dynamic Roles and so on. Da (Klaus), Ma (马达) | PMP® | Advisory So

Re: Multiple active masters

If the running two agent in slave host, the two clusters will share resource all the time. One option I can image is to use meta framework to connect to the two cluster, and balance the resources between the two cluster. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform

Re: Multiple active masters

That's interesting :). but as far as I known, there's no such migration feature in Mesos. Maybe you can start an EPIC for this requirement. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | klaus

Re: Failed to authenticate

would you help to log a JIRA to trace it? Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me On Tue, Nov 10, 2015 at 5:12 PM, Pradeep Kiruvale <pradeepkiruv...@gm

Re: spark mesos shuffle service failing under marathon

Can you share more logs? I used to start spark shuffle in Mesos + Marathon cluster; logs will be helpful to identify issues. Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | klaus1982...@gmail.com |

How to enable docker container in Mesos-Agent within a Docker

Hi team, I'd like to start a mesos-agent in Docker with docker container, I can run sleep docker within a ubuntu docker with following args; but I can not start an Mesos Agent. Refer to the following for the detail of output: $sudo docker run --privileged --net=host -v /cgroup:/cgroup -v

Re: How to enable docker container in Mesos-Agent within a Docker

ail.com> wrote: > try add -e MESOS_LAUNCHER=posix > On Oct 28, 2015 9:49 AM, "Klaus Ma" <klaus1982...@gmail.com> wrote: > >> Hi team, >> >> I'd like to start a mesos-agent in Docker with docker container, I can >> run sleep docker within a ubuntu

Re: How to enable docker container in Mesos-Agent within a Docker

It worked by adding -v /sys:/sys, but not sure whether any security concern. On Wed, Oct 28, 2015 at 10:22 AM, Klaus Ma <klaus1982...@gmail.com> wrote: > :(. It does not work. Both linux & posix are tested. And according to the > description of launcher, linux is necessary

Any ready deb package of Mesos

Hi team, Is there any ready deb package of Mesos to download? -- Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://www.cguru.net

RE: Is there any APIs for status monitering, how did the Webui got the status of mesos?

Hi Chong,I think you can use Mesos’s REST API to achieve that; please refer to the following URL for more detail:http://mesos.apache.org/documentation/latest/monitoring/ Da (Klaus), Ma (马达) | PMP® | Advisory Software Engineer Platform Symphony/DCOS Development & Support, STG, IBM GCG

[Behavior Update] Command-line flags will take precedence over OS Env variables

let me know. Regards,Klaus Ma (马达), PMP® | http://www.cguru.net CallSend SMSCall from mobileAdd to SkypeYou'll need Skype CreditFree via SkypeCallSend SMSCall from mobileAdd to SkypeYou'll need Skype CreditFree via Skype

Re: Setting maximum per-node resources in offers

suggest alternatives? Thanks, RJ -- Klaus Ma (马达), PMP® | http://www.cguru.net

RE: Basic installation question

Can you share the command line of master & slave? According the following information, it seems master run without "--zk" option. Regards,Klaus Ma (马达), PMP® | http://www.cguru.net CallSend SMSCall from mobileAdd to SkypeYou'll need Skype CreditFree via SkypeCallSen

Re: How does mesos determine how much memory on a node is available for offer?

"cpus:4;mem:1024;disk:2”) The default value for memory is here: https://github.com/apache/mesos/blob/master/src/slave/constants.cpp#L46 -anand -- Klaus Ma (马达), PMP® | http://www.cguru.net

RE: Can't start master properly (stale state issue?); help!

: mapping IP (e.g. 192.168.1.100) with hostname ... BTW, please also clear-up the log directory and re-start ZK Mesos. If any more comments, please let me know. Regards,Klaus Ma (马达), PMP® | http://www.cguru.net CallSend SMSCall from mobileAdd to SkypeYou'll need Skype CreditFree via

Re: Ambari and Mesos

and start related daemon by Mesos; not only YARN, but also Kafka, Storm and others Regards -- Klaus Ma (马达), PMP® | Advisory Software Engineer Platform Symphony MapReduce Development Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://www.cguru.net On 08/12/2015 03

Re: Mesos slave help

Hi Stephen, Would you share the log of master slave? Thanks Klaus On 2015年08月06日 16:07, Stephen Knight wrote: Hi, I was wondering if anyone can help me. I have a test setup, 1 master/zookeeper and 2 slaves on Ubuntu 14.04. When I initialize the slaves the first time it all works and they