I notice from mates of mine, several issues with mesos 0.28.1. Specially on the master election stability. When a master is elected, after a minute it disconnect re-electing another master. Anyone of you have this issue? This is not my issue, since im running 0.27.2 which is much more stable. Il 25/apr/2016 11:33, "Adam Bordelon" <a...@mesosphere.io> ha scritto:
> Seems like you're trying to start Marathon with multiple Mesos roles > "spark;sparkr;ms;qa", but Marathon may be interpreting this as a single > role that happens to include semi-colons. Mesos does not yet support > multiple roles in a single framework. See > https://issues.apache.org/jira/browse/MESOS-1763 > Note that the acceptedResourceRoles feature in Marathon currently only > applies to the "*" (unreserved) role vs. the value of --mesos_role > > On Wed, Apr 20, 2016 at 5:19 AM, Rodrick Brown <rodr...@orchard-app.com> > wrote: > >> On Apr 20 2016, at 1:36 am, Jian Qiu <gothicqiuj...@gmail.com> wrote: >> >>> It is not necessary to configure --role on master. Actually it should >>> work if you configure --default_role='sparkr' on agent and start marathon >>> with --mesos_role=sparkr. Which version of mesos are you using? And could >>> you attach the master log? >>> >> >> This is Marathon 0.15 and Mesos 0.28.1 >> >> on my masters I have the following attribute set >> $ cat /etc/marathon/conf/mesos_role >> spark;sparkr;ms;qa >> >> On the slave I have the following set in the agent >> $ cat /etc/mesos-slave/default_role >> sparkr >> >> $ cat /etc/mesos-slave/resources >> cpus:10;mem:100000 >> >> $ cat attributes >> rack:sparkr >> >> I'm trying to launch a simple task from marathon on this agent with >> following configs >> >> $ cat rstudio-mesos-shuffle-server.marathon.json >> { >> "id": "/mesos/rstudio-shuffle-service", >> "cmd": ". /opt/spark-1.6.1/conf/spark-env.sh . >> /opt/spark-1.6.1/sbin/spark-config.sh && . >> /opt/spark-1.6.1/bin/load-spark-env.sh && env && >> /opt/spark-1.6.1/bin/spark-class >> org.apache.spark.deploy.mesos.MesosExternalShuffleService 1", >> "cpus": 0.5, >> "mem": 1524, >> "disk": 100, >> "user": "mesos", >> "instances": 1, >> "requirePorts": true, >> "acceptedResourceRoles": ["sparkr"], >> "ports": >> [ >> 31338 >> ], >> "constraints": [ >> [ >> "hostname","UNIQUE" >> ], >> [ >> "rack", "LIKE", "sparkr" >> ] >> ], >> "env": { >> "SPARK_HOME": "/opt/spark-1.6.1", >> "SPARK_SCALA_VERSION": "2.11" >> }, >> "healthChecks": [ >> { >> "gracePeriodSeconds": 5, >> "intervalSeconds": 10, >> "maxConsecutiveFailures": 3, >> "portIndex": 0, >> "protocol": "TCP", >> "timeoutSeconds": 5 >> } >> ], >> "maxLaunchDelaySeconds": 3, >> "backoffFactor": 1.20, >> "upgradeStrategy": { >> "minimumHealthCapacity": 0.5, >> "maximumOverCapacity": 0.5 >> } >> } >> >> In the marathon logs this is what I see >> >> 20 12:11:42 prod-mesos-m-3.aws.xxx.com marathon[29617]: [2016-04-20 >> 12:11:42,807] INFO Offer ID: >> [50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O13166461]. Considered resources with >> roles: [sparkr]. Not all basic resources satisfied: cpu not in offer, disk >> not in offer, mem not in offer >> (mesosphere.mesos.ResourceMatcher$:marathon-akka.actor.default-dispatcher-9) >> >> Thanks. >> >> >> >>> On Wed, Apr 20, 2016 at 11:11 AM, Rodrick Brown <rodr...@orchard-app.com >>> > wrote: >>> >>> I'm confused do roles need to be configured on masters and slaves or >>> just slaves? >>> The docs says --roles has been deprecated on mesos-master but doesn't >>> state an alternate method. >>> >>> >>> on my slaves i'm using default_role='sparkr' and in marathon I've added >>> --mesos_role=sparkr however I'm not able to get any tasks to run on this >>> server do I need to set it on the masters also ? >>> >>> Please advise thanks. >>> >>> --RB >>> >>> >>> >>> -- >>> >>> *Rodrick Brown* / Systems Engineer >>> >>> +1 917 445 6839 / rodr...@orchardplatform.com >>> <char...@orchardplatform.com> >>> >>> *Orchard Platform* >>> >>> 101 5th Avenue, 4th Floor, New York, NY 10003 >>> >>> http://www.orchardplatform.com >>> >>> Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace >>> Lending Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/> >>> >>> *NOTICE TO RECIPIENTS*: This communication is confidential and intended >>> for the use of the addressee only. If you are not an intended recipient of >>> this communication, please delete it immediately and notify the sender by >>> return email. Unauthorized reading, dissemination, distribution or copying >>> of this communication is prohibited. This communication does not constitute >>> an offer to sell or a solicitation of an indication of interest to purchase >>> any loan, security or any other financial product or instrument, nor is it >>> an offer to sell or a solicitation of an indication of interest to purchase >>> any products or services to any persons who are prohibited from receiving >>> such information under applicable law. The contents of this communication >>> may not be accurate or complete and are subject to change without notice. >>> As such, Orchard App, Inc. (including its subsidiaries and affiliates, >>> "Orchard") makes no representation regarding the accuracy or completeness >>> of the information contained herein. The intended recipient is advised to >>> consult its own professional advisors, including those specializing in >>> legal, tax and accounting matters. Orchard does not provide legal, tax or >>> accounting advice. >>> >>> >>> >> *NOTICE TO RECIPIENTS*: This communication is confidential and intended >> for the use of the addressee only. If you are not an intended recipient of >> this communication, please delete it immediately and notify the sender >> by return email. Unauthorized reading, dissemination, distribution or >> copying of this communication is prohibited. This communication does not >> constitute >> an offer to sell or a solicitation of an indication of interest to purchase >> any loan, security or any other financial product or instrument, nor is it >> an offer to sell or a solicitation of an indication of interest to purchase >> any products or services to any persons who are prohibited from receiving >> such information under applicable law. The contents of this communication >> may not be accurate or complete and are subject to change without notice. >> As such, Orchard App, Inc. (including its subsidiaries and affiliates, >> "Orchard") makes no representation regarding the accuracy or >> completeness of the information contained herein. The intended recipient is >> advised to consult its own professional advisors, including those >> specializing in legal, tax and accounting matters. Orchard does not >> provide legal, tax or accounting advice. >> > >
