Re: mess slave can't register to master via master ip:port

; >> If that so. I think this document should be modified. >> >> http://mesos.apache.org/documentation/latest/configuration/#SlaveOptions >> >> >> Right? >> >> >> 发件人: Guangya Liu <gyliu...@gmail.com> >> 答复: "user@mesos.apache

Re: many outstanding chronos offers

I think it should be "5mins" or "30secs", please refer to https://github.com/mesosphere/mesos/blob/master/3rdparty/libprocess/3rdparty/stout/include/stout/duration.hpp#L55-L69 for detail, thanks! On Thu, Nov 5, 2015 at 9:04 PM, craig w wrote: > Looks like it would be

Re: mess slave can't register to master via master ip:port

Seems mesos does not support such mode, please refer to https://github.com/apache/mesos/blob/master/src/slave/main.cpp#L105-L111 for the format of "--master". Thanks! On Tue, Nov 3, 2015 at 12:28 PM, haosdent wrote: > After checking code, seems Mesos only support

Re: Welcome Kapil as Mesos committer and PMC member!

Congrats Kapil! On Thu, Nov 5, 2015 at 6:02 PM, Till Toenshoff wrote: > I'm happy to announce that Kapil Arya has been voted a Mesos committer and > PMC member! > > Welcome Kapil, and thanks for all of your great contributions to the > project so far! > > Looking forward to

Re: Is there any APIs for status monitering, how did the Webui got the status of mesos?

Hi Marco, I think that you are mentioning http://:5050/master/state There is JIRA ticket https://issues.apache.org/jira/browse/MESOS-3568 planning to add this to mesos document. Thanks, Guangya On Thu, Oct 8, 2015 at 4:44 PM, Marco Massenzio

Re: Running a task in Mesos cluster

ramework (C++) with checkpointing disabled and capabilities [ ] > I1007 11:24:59.700251 32393 hierarchical.hpp:515] Added framework > 89b179d8-9fb7-4a61-ad03-a9a5525482ff-0020 > E1007 11:24:59.700253 32399 process.cpp:1912] Failed to shutdown socket > with fd 13: Transport endpoint is n

Re: Running a task in Mesos cluster

; scheduler-a8deafaa-cf10-401c-a61c-515340560c49@127.0.1.1:58843 > I1007 12:16:42.775126 8005 master.cpp:5571] Removing framework > 0ccab17d-20e8-4ab8-9de4-ae60691f8c8e-0003 (Balloon Framework (C++)) at > scheduler-a8deafaa-cf10-401c-a61c-515340560c49@127.0.1.1:58843 > I1007 12:16:42.775324

Xian-Mesos-User-Group: Apache Mesos Startup In Xi'an China

Hi All, The first Mesos Meetup in Xi'an China will be held on 2015-09-19 hosted by IBM CSTL! For more detail, please refer to http://www.meetup.com/Xian-Mesos-User-Group/events/225153460/?a=ra1_te , welcome to join us! Because it is a local meetup in China, so the content are written in Chinese

Re: Setting maximum per-node resources in offers

g and not available now. epic: https://issues.apache.org/jira/browse/MESOS-1791 Design doc: https://docs.google.com/document/d/16iRNmziasEjVOblYp5bbkeBZ7pnjNlaIzPQqMTHQ-9I/edit?pli=1#heading=h.9g7fqjh6652v > > RJ > > > > On Sep 8, 2015, at 11:47 PM, Guangya Liu <gyliu...@gma

Re: Setting maximum per-node resources in offers

want. Spark could be > deployed in standalone mode on top of Aurora on top of Mesos. :) > > Funny enough, two of my colleagues (Tim St. Clair and Erik Erlandson) seem > to be tracking and commenting on the epic you linked to. :) > > On Wed, Sep 9, 2015 at 12:59 AM, Guangya Liu &l

Re: Documentation for Multi-Tenancy support

Hi Stephen, This is a project under going in mesos community, you may wan to refer to the following two JIRA ticket to get more details. [1] https://issues.apache.org/jira/browse/MESOS-1791 [2] https://issues.apache.org/jira/browse/MESOS-2936 Thanks, Guangya On Wed, Sep 16, 2015 at 8:04 AM,

Re: Running a task in Mesos cluster

Hi Pradeep, Please check some of my questions in line. Thanks, Guangya On Fri, Oct 2, 2015 at 12:55 AM, Pradeep Kiruvale wrote: > Hi All, > > I am new to Mesos. I have set up a Mesos cluster with 1 Master and 3 > Slaves. > > One slave runs on the Master Node

Re: Running a task in Mesos cluster

gt;>> I1002 10:01:12.754132 7413 master.cpp:2553] Deactivating slave >>> 6a11063e-b8ff-43bd-86cf-e6eef0de06fd-S62 at slave(1)@127.0.1.1:5051 >>> (192.168.0.116) >>> I1002 10:01:12.754237 7416 hierarchical.hpp:768] Slave >>> 6a11063e-b8ff-43bd-86cf-e6eef0de06fd-S62 deactivated >>> I1002 10:01:12.754240 7

Re: Running a task in Mesos cluster

your reply. > > I just want to know how did you launch the tasks. > > 1. What processes you have started on Master? > 2. What are the processes you have started on Slaves? > > I am missing something here, otherwise all my slave have enough memory and > cpus to launch the

Re: Setting maximum per-node resources in offers

Hi RJ, I think that your final goal is that you want to use framework running on top of mesos to execute some tasks. Such logic should be in the framework part. The netflix open sourced a framework scheduler library named as fenzo, you may want to take a look at this one to see if it can help

Re: Reservations for multiple different agents

HI Rinaldo, I think that you can use dynamic reservation feature to achieve this: You can launch your tasks after reservation succeeds. Actually, all of the dynamic reservation feature with endpoint has been finished except ACL part, so you can use this feature now if you do not care ACL part.

Re: Reservations for multiple different agents

. < rdigior...@pace.edu> wrote: > > On Sep 21, 2015, at 19:33, Guangya Liu <gyliu...@gmail.com> wrote: > > HI Rinaldo, > > I think that you can use dynamic reservation feature to achieve this: You > can launch your tasks after reservation succeeds. Actually, all of

Re: Scheduling tasks based on dependancy

ce > offer will help? > > Can you please give me more information? > > > -Pradeep > > > > On 5 October 2015 at 17:45, Guangya Liu <gyliu...@gmail.com> wrote: > >> Hi Pradeep, >> >> I think that you can try Chronos and Marathon which can help you

Re: Running a task in Mesos cluster

reezer': 'freezer' is already > attached to another hierarchy > > I took that out from the cluster for now. The tasks are getting scheduled > on the other two slave nodes. > > Thanks for your timely help > > -Pradeep > > On 5 October 2015 at 10:54, Guangya Liu &

Re: Running a task in Mesos cluster

ramework > 77539063-89ce-4efa-a20b-ca788abbd912-0055 () at > scheduler-b1bc0243-b5be-44ae-894c-ca318c24ce6d@127.0.1.1:47259 > > > Can you please tell me what is the reason? The client is in the same > network as well. But it does not run any master or slave processes. > > Thanks

Re: Running a task in Mesos cluster

-4efa-a20b-ca788abbd912-0065 > I1005 13:24:04.642654 4826 slave.cpp:1980] Asked to shut down framework > 77539063-89ce-4efa-a20b-ca788abbd912-0066 by master@192.168.0.102:5050 > W1005 13:24:04.642812 4826 slave.cpp:1995] Cannot shut down unknown > framework 77539063-89ce-4efa-a20b-ca

Re: Scheduling tasks based on dependancy

f other > hardware > features other than CPU,MEM, DISK like IO, PCI devices that exists with > the node etc? > > Thanks, > Pradeep > > On 5 October 2015 at 17:45, Guangya Liu <gyliu...@gmail.com> wrote: > >> Hi Pradeep, >> >> I think that you can

Re: Can tasks from multiple frameworks simultaneously run on the same slave node?

Just want to show more detail for offer_timeout, currently, there is no default value for it, you may want to specify a value such as "5s" when start up mesos master. Then if the offer was not handled in 5s, it will be returned to master automatically. Cited from

Re: Dynamic Reservations - API to See them

I think there is no API for pure dynamic reservation but there are indeed API for reservations including both static and dynamic reservations. You can query the endpoint /state or /slaves on master to check the reservations status. You may want to file a JIRA ticket if only want to get dynamic

Re: Mesos on OpenShift 3.1

Hi Den, Yes, you can try to build your own km, as you are using Kubernetes 1.1, so possibly you can follow this https://github.com/kubernetes/kubernetes/blob/release-1.1/docs/getting-started-guides/mesos.md Thanks, Guangya On Tue, Jan 5, 2016 at 3:54 PM, Den Cowboy

Re: [Proposal] Fine Granularity Resource Allocation

There is already a JIRA ticket here https://issues.apache.org/jira/browse/MESOS-3765 tracing the fine-grained resource offers, after some discussion in community, it is suggested to reach an agreement in community before we move forward. You can append some of your ideas there. Actually for your

Re: Multiple active masters

There is a JIRA ticket here https://issues.apache.org/jira/browse/MESOS-3548 , you can possibly append your thinking and use case there to push this move forward? Thanks! On Fri, Nov 27, 2015 at 11:16 PM, Elouan Keryell-Even < elouan.kery...@gmail.com> wrote: > Hi, > > I don't think this is

Re: Force Allocator to provide all available offers to a framework

Yes, it is suggested to use dynamic reservation or persistent volume, please refer to https://issues.apache.org/jira/browse/MESOS-4616 for detail. Thanks, Guangya On Thu, Jun 2, 2016 at 9:33 PM, haosdent wrote: > >How do I prevent the allocator from reducing the length of

Re: Running Mesos agent with --containerizers=docker option on Mac

There is a JIRA tracking this https://issues.apache.org/jira/browse/MESOS-3821 , you can apply the patch https://reviews.apache.org/r/39939/ from @haosdent to have a try. Thanks, Guangya On Sat, Jun 4, 2016 at 8:12 AM, Bogdan Ghit wrote: > Hi all, > > I am trying to run

Re: "Appropriating" an existing process into mesos task

Hi Krishnanarayanan, How did you create your VM on baremetal servers with Mesos? Are you leveraging mesos executor or some other components? The framework have checkpoint logic which can recover tasks in one framework back to original state, please refer to

Re: Request offers based on Slave Attributes

I think that you can filter the offers based on slave attribute, all of the offers are assigned agent attributes in the offer: https://github.com/apache/mesos/blob/master/src/master/master.cpp#L5637 On Tue, May 31, 2016 at 2:33 PM, Nihal Harish wrote: > Hi, > > The

Re: Mesos and Openstack

The public (floating) IP in OpenStack was generated by some NAT or iptables rules, and this will not be shown via `ifconfig`. I think that you can try private IP for your whole cluster. Thanks, Guangya On Thu, May 26, 2016 at 10:12 AM, haosdent wrote: > Hi, @Omar > May you

Re: 0.28.2

+1 to Jie for this. mesos-execute is hot recently, deferring this to 1.0 sounds more reasonable. On Mon, May 30, 2016 at 6:43 AM, Jie Yu wrote: > June, per Vinod's response, we typically only backport bug fixes. This is > more like a feature to me as well. > > However, I

Re: [VOTE] Release Apache Mesos 0.28.2 (rc1)

+1 to this. Only one minor comment: I saw that there are indeed someone using mesos CLI, such as `mesos ps` etc. I did minor enhancement for mesos CLI recently to improve debug-ability, it would be great if we can have those in 0.28.2. The following are the three patches for mesos CLI

Re: Mesos persistent volumes as Docker volumes

Hi Hendrik, You can take a look for how Mesos 1.0 support docker volume driver integration with Mesos Containerizer from here https://github.com/apache/mesos/blob/master/docs/docker-volume.md Both Mesos Containerizer and Docker Containerizer support integration with docker volume driver now, you

Re: Share GPU resources via attributes or as custom resources (INTERNAL)

I think that you can use 'curl' to test, please refer to https://open.mesosphere.com/advanced-course/advanced-usage-of-marathon/ On Fri, Jan 15, 2016 at 4:22 PM, wrote: > Thanks Haosdent, > > > > If what you say about Marathon is right (i.e., that Marathon’s

Re: Unable to receive offers / long delays when starting or restarting.

Which version of mesos are you using? I suspect that your resources might have been filtered out by the allocator, can you please also attach some logs for mesos master? On Tue, Feb 2, 2016 at 11:29 PM, tommy xiao wrote: > interesting on this case, please follow Shuai Lin's

Re: Specifying a preferred host with a Resource Request

Hi Jagadish, Even though Mesos have the interface of "requestResources", it was not implemented in the built-in allocator at the moment, so the call of "driver.requestResources (resources);" will not work. Is it possible that you update your framework logic as this: 1) framework get resoruce

Re: Specifying a preferred host with a Resource Request

can start to service a request.) >>>>> >>>>> I'm sure many stateful services have similar requirements. >>>>> >>>>> >> Is it possible that you update your framework logic as this: >>>>> 1) framework get resoruce offer f

Re: Unable to start mesos slave 0.25+ in docker

I think that you can take a look at https://issues.apache.org/jira/browse/MESOS-3793 to see if it helps. On Fri, Jan 29, 2016 at 4:41 PM, Giulio Eulisse wrote: > Ciao, > > I filed: > > https://issues.apache.org/jira/browse/MESOS-4543 > > about not being able to start a

Re: Mesos sometimes not allocating the entire cluster

on, Feb 22, 2016 at 5:16 PM, Tom Arnfeld <t...@duedil.com> wrote: > No roles, no reservations. > > We're using the default filter options with all frameworks and default > allocation interval. > > On 21 Feb 2016, at 08:10, Guangya Liu <gyliu...@gmail.com> wrote:

Re: Can Marathon ensure single instance of a service at any give time?

Marathon is designed for long running services no matter the service is stateless or stateful with HA by default. The Marathon will help restart your services if it is down. Thanks, Guangya On Tue, Feb 23, 2016 at 6:06 PM, Petr Novak wrote: > Hello, > if I need to run

Re: Mixed use workloads in Mesos 0.25 agents/slaves

t the same time on Mesos >>>> agents/slaves. >>>> >>>> I see from the mesos-slave command help that there is a >>>> 'containerizers' option in the CLI & it will enforce the usage of >>>> containers to be used. It d

Re: Mixed use workloads in Mesos 0.25 agents/slaves

/tjkxmH7S > > I still cannot get a docker job to run from Aurora. I am verifying if > something needs to done to configure Aurora properly too. > > > > > -- > κρισhναν > > On Sun, Feb 28, 2016 at 6:16 PM, Guangya Liu <gyliu...@gmail.com> wrote: >

Re: Mesos sometimes not allocating the entire cluster

e agents. > > > I don’t think that’s correct, this is likely to be an offer for a slave > where 9CPUs are currently allocated to an executor. > > I can verify via the agent configuration and HTTP endpoints that most of > the agents do not have a role, and none of the frameworks do. > >

Re: Mesos sometimes not allocating the entire cluster

ing this way in a test > environment. > > Tom. > > On 22 Feb 2016, at 15:39, Guangya Liu <gyliu...@gmail.com> wrote: > > If non of the framework has role, then no framework can consume reserved > resources, so I think that at least the framework > 20160219-164457-673

Re: Mesos sometimes not allocating the entire cluster

Can you please help check if some outstanding offers in cluster which does not accept by any framework? You can check this via the endpoint of /master/state.json endpoint. If there are some outstanding offers, you can start the master with a offer_timeout flag to let master rescind some offers if

Re: Mesos integration with OpenStack HEAT AutoScaling

Hi Peter, Have you ever tried Magnum (https://github.com/openstack/magnum) which is the container service in OpenStack leveraging HEAT to integrate with Kubernetes, Swarm and Mesos. With Magnum, you do not need to maintain your own HEAT template but just let Magnum do this for you, it is more

Re: Mesos integration with OpenStack HEAT AutoScaling

Hi Petr, It would be great if you can also share your use case here, I can post your feedback/use case to Magnum community to improve Magnum support for Mesos. Thanks, Guangya On Tue, Feb 16, 2016 at 4:20 PM, Guangya Liu <gyliu...@gmail.com> wrote: > Hi Peter, > > Have you ev

Re: Mesos sometimes not allocating the entire cluster

> > Hope there’s something here that highlights the issue, we can’t find > anything that we can’t explain. > > Cheers, > > Tom. > > On 19 Feb 2016, at 03:02, Guangya Liu <gyliu...@gmail.com> wrote: > > Hi Tom, > > After the patch was applied, there is no nee

Re: Mixed use workloads in Mesos 0.25 agents/slaves

ners to be used. It > doesn't seem to support non-containerized workloads. > > Is my analysis correct? > > Also, if the above is correct, how does one tell the frameworks > (Aurora/Marathon/Cassandra frameworks) to use containerized vs > non-containerized workload slaves to sched

Re: [VOTE] Release Apache Mesos 0.28.0 (rc1)

There are also issues related with overlayfs, the overlayfs will not work if linux kernel is greater than 4.2, and also there is no document related to overlayfs. There are already patches and JIRA tickets for both issues. https://reviews.apache.org/r/44421/ https://reviews.apache.org/r/44391/

Re: rkt / appc support

Hi Dick, This is new functionality, you can refer to https://issues.apache.org/jira/browse/MESOS-2840 for more detail, there are also some design document link append in the JIRA ticket. Thanks, Guangya On Wed, Mar 16, 2016 at 5:24 PM, Dick Davies wrote: > Quick

Re: Hybrid application deployments (container/VM/bare metal) in Mesos

If you do not want to provision VM or PM on demand, then mesos plus marathon can help. There is also a JIRA talking about support Qemu/KVM in mesos https://issues.apache.org/jira/browse/MESOS-2717 On Wed, Apr 13, 2016 at 2:17 PM, tommy xiao wrote: > mesos + marathon natively

Re: Current state of the oversubscription feature

https://issues.apache.org/jira/browse/MESOS-4967 is planning to introduce "Oversubscription for reservation", can you please help check if this help? Thanks, Guangya On Mon, Mar 21, 2016 at 8:54 PM, Erb, Stephan wrote: > Hi everyone, > > I am interested in the

Re: 0.28.0 release

I think that we also need to include https://reviews.apache.org/r/44258/ ( https://issues.apache.org/jira/browse/MESOS-4831) in 0.28 cause this issue will lead two inverse offers with one maintain call. Thanks, Guangya On Fri, Mar 4, 2016 at 9:44 AM, Vinod Kone wrote: >

Re: Scheduler for distributed builds

The Chronos may also help for your case http://mesos.github.io/chronos/ On Wed, Apr 27, 2016 at 6:40 AM, David Greenberg wrote: > http://github.com/twosigma/cook could be a good fit for this. It supports > scheduling arbitrary jobs within seconds of submission, and it

Re: DC/OS dynamic reservation dosen't work

Gaojin, Some questions and suggestions here: 1) How did you deploy the nginx with new marathon URI? I did not found that I can configure the new marathon URI with nginx. 2) Can you please send out the curl output for your master node: a) curl "http://master-ip:5050/master/slaves

Re: Setting constraints

roprietary information and material for the sole use of the intended > recipient(s). Any review, use or distribution that has not been expressly > authorized by Stem, Inc. is strictly prohibited. If you are not the > intended recipient, please contact the sender and delete all copies. Thank > y

Re: Setting constraints

Hi Scott, I think only setting "constraints": [["hostname", "UNIQUE"] is good enough, please refer to https://github.com/mesosphere/marathon/blob/master/docs/docs/constraints.md#unique-operator Thanks, Guangya On Sun, May 22, 2016 at 12:59 AM, Scott Kinney wrote: > I

Re: Setting constraints

t(s). Any review, use or distribution that has not been expressly >> authorized by Stem, Inc. is strictly prohibited. If you are not the >> intended recipient, please contact the sender and delete all copies. Thank >> you. >> -- >> *From:* Guangya L

Re: Deploying MySQL and WordPress Docker Containers through Marathon

Just FYI, the dc/os does have near term roadmap to enable support for "external volume storage": https://github.com/dcos/dcos-docs/blob/master/1.7/overview/roadmap.md#pluggable-external-volumes , once this was enabled in open source dc/os, you can use this feature to manage your stateful services.

Re: DC/OS dynamic reservation dosen't work

n with dev role >> >> ``` >> ./bin/start --master 127.0.0.1:5050 --zk zk://10.10.120.61:2181/marathon >> --mesos_role dev >> ``` >> >> 3. start task >> >> ``` >> $ cat task.json >> { >> "id": "/test-health"

Re: Hybrid application deployments (container/VM/bare metal) in Mesos

some bare metal cluster nodes. Without > the mentioned JIRA implemented, I guess there will be no VM at all and all > non-container apps have to run on physical machine directly? Does Marathon > still use cgroups to limit the resource usage of these apps even they are > not containerized? &

Re: "Appropriating" an existing process into mesos task

, 2016 at 6:09 PM, Krishnanarayanan VR <krishna...@phonepe.com > wrote: > Guangya: > > Thanks for your response. > > yeah, the VMs are created by the mesos executor. I'll take a look at the > checkpointing and see if it works. > > > > On Wed, May 25, 2016 at 10:57

Allocator slack channel

Hi, I created an #allocator slack channel in mesos.slack.com, please join this if you want to have some discussion for allocator related issues, such as allocator performance, optimistic offer, revocable resource etc. @bmahler and @vinodkone, I also posted a RR here

Re: Monitoring at container level

Have you ever tried prometheus + Grafana? Please take a look at https://prometheus.io/docs/visualization/grafana/ to see if it helps. On Fri, Jul 8, 2016 at 5:51 AM, David Kesler wrote: > We use a combination of new relic for application level monitoring and a > custom python

Re: Welcome Neil Conway as Mesos Committer and PMC member!

Congrats Neil!! On Sat, 21 Jan 2017 at 12:34 Vinod Kone wrote: > Hi folks, > > Please welcome Neil Conway as the newest committer and PMC member of the > Apache Mesos project. > > Neil has been an active contributor to Mesos for more than a year now. As > part of his work,

Re: resource offers

This depends, it may be caused by that one of the offer is declined and then got a filter, this will cause the filtered offer will be offered after the expire time. Did you set filters when decline offer? If you are enabling GLOG_v=2 for mesos master, you will get some log as "Framework xxx

Re: Support for tasks groups aka pods in Mesos

The answer is No, the taskGroup can be treated as Pod in Kubernetes, it will be a set of containers co-located and co-managed on an agent that share some resources (e.g., network namespace, volumes). For your case, you may want to split your 50 tasks to small task groups. Also the `execute` cli

Re: Does Mesos 1.0 support GPU ?

Just FYI, the current GPU support only support Mesos Containerizer but not Docker Containerizer. There is a patch chain for Docker Containerizer GPU support here: https://reviews.apache.org/r/50123/ Thanks, Guangya On Tue, Aug 23, 2016 at 9:41 AM, David Greenberg

Re: Does Mesos 1.0 support GPU ?

miconductor Manufacturing Company > > > > |---------> > |Guangya Liu | > |<gyliu...@gmail.com> | > | | > | | > |