Seems like you're trying to start Marathon with multiple Mesos roles "spark;sparkr;ms;qa", but Marathon may be interpreting this as a single role that happens to include semi-colons. Mesos does not yet support multiple roles in a single framework. See https://issues.apache.org/jira/browse/MESOS-1763 Note that the acceptedResourceRoles feature in Marathon currently only applies to the "*" (unreserved) role vs. the value of --mesos_role
On Wed, Apr 20, 2016 at 5:19 AM, Rodrick Brown <rodr...@orchard-app.com> wrote: > On Apr 20 2016, at 1:36 am, Jian Qiu <gothicqiuj...@gmail.com> wrote: > >> It is not necessary to configure --role on master. Actually it should >> work if you configure --default_role='sparkr' on agent and start marathon >> with --mesos_role=sparkr. Which version of mesos are you using? And could >> you attach the master log? >> > > This is Marathon 0.15 and Mesos 0.28.1 > > on my masters I have the following attribute set > $ cat /etc/marathon/conf/mesos_role > spark;sparkr;ms;qa > > On the slave I have the following set in the agent > $ cat /etc/mesos-slave/default_role > sparkr > > $ cat /etc/mesos-slave/resources > cpus:10;mem:100000 > > $ cat attributes > rack:sparkr > > I'm trying to launch a simple task from marathon on this agent with > following configs > > $ cat rstudio-mesos-shuffle-server.marathon.json > { > "id": "/mesos/rstudio-shuffle-service", > "cmd": ". /opt/spark-1.6.1/conf/spark-env.sh . > /opt/spark-1.6.1/sbin/spark-config.sh && . > /opt/spark-1.6.1/bin/load-spark-env.sh && env && > /opt/spark-1.6.1/bin/spark-class > org.apache.spark.deploy.mesos.MesosExternalShuffleService 1", > "cpus": 0.5, > "mem": 1524, > "disk": 100, > "user": "mesos", > "instances": 1, > "requirePorts": true, > "acceptedResourceRoles": ["sparkr"], > "ports": > [ > 31338 > ], > "constraints": [ > [ > "hostname","UNIQUE" > ], > [ > "rack", "LIKE", "sparkr" > ] > ], > "env": { > "SPARK_HOME": "/opt/spark-1.6.1", > "SPARK_SCALA_VERSION": "2.11" > }, > "healthChecks": [ > { > "gracePeriodSeconds": 5, > "intervalSeconds": 10, > "maxConsecutiveFailures": 3, > "portIndex": 0, > "protocol": "TCP", > "timeoutSeconds": 5 > } > ], > "maxLaunchDelaySeconds": 3, > "backoffFactor": 1.20, > "upgradeStrategy": { > "minimumHealthCapacity": 0.5, > "maximumOverCapacity": 0.5 > } > } > > In the marathon logs this is what I see > > 20 12:11:42 prod-mesos-m-3.aws.xxx.com marathon[29617]: [2016-04-20 > 12:11:42,807] INFO Offer ID: > [50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O13166461]. Considered resources with > roles: [sparkr]. Not all basic resources satisfied: cpu not in offer, disk > not in offer, mem not in offer > (mesosphere.mesos.ResourceMatcher$:marathon-akka.actor.default-dispatcher-9) > > Thanks. > > > >> On Wed, Apr 20, 2016 at 11:11 AM, Rodrick Brown <rodr...@orchard-app.com> >> wrote: >> >> I'm confused do roles need to be configured on masters and slaves or just >> slaves? >> The docs says --roles has been deprecated on mesos-master but doesn't >> state an alternate method. >> >> >> on my slaves i'm using default_role='sparkr' and in marathon I've added >> --mesos_role=sparkr however I'm not able to get any tasks to run on this >> server do I need to set it on the masters also ? >> >> Please advise thanks. >> >> --RB >> >> >> >> -- >> >> *Rodrick Brown* / Systems Engineer >> >> +1 917 445 6839 / rodr...@orchardplatform.com >> <char...@orchardplatform.com> >> >> *Orchard Platform* >> >> 101 5th Avenue, 4th Floor, New York, NY 10003 >> >> http://www.orchardplatform.com >> >> Orchard Blog <http://www.orchardplatform.com/blog/> | Marketplace >> Lending Meetup <http://www.meetup.com/Peer-to-Peer-Lending-P2P/> >> >> *NOTICE TO RECIPIENTS*: This communication is confidential and intended >> for the use of the addressee only. If you are not an intended recipient of >> this communication, please delete it immediately and notify the sender by >> return email. Unauthorized reading, dissemination, distribution or copying >> of this communication is prohibited. This communication does not constitute >> an offer to sell or a solicitation of an indication of interest to purchase >> any loan, security or any other financial product or instrument, nor is it >> an offer to sell or a solicitation of an indication of interest to purchase >> any products or services to any persons who are prohibited from receiving >> such information under applicable law. The contents of this communication >> may not be accurate or complete and are subject to change without notice. >> As such, Orchard App, Inc. (including its subsidiaries and affiliates, >> "Orchard") makes no representation regarding the accuracy or completeness >> of the information contained herein. The intended recipient is advised to >> consult its own professional advisors, including those specializing in >> legal, tax and accounting matters. Orchard does not provide legal, tax or >> accounting advice. >> >> >> > *NOTICE TO RECIPIENTS*: This communication is confidential and intended > for the use of the addressee only. If you are not an intended recipient of > this communication, please delete it immediately and notify the sender by > return email. Unauthorized reading, dissemination, distribution or copying > of this communication is prohibited. This communication does not constitute > an offer to sell or a solicitation of an indication of interest to purchase > any loan, security or any other financial product or instrument, nor is it > an offer to sell or a solicitation of an indication of interest to purchase > any products or services to any persons who are prohibited from receiving > such information under applicable law. The contents of this communication > may not be accurate or complete and are subject to change without notice. > As such, Orchard App, Inc. (including its subsidiaries and affiliates, > "Orchard") makes no representation regarding the accuracy or completeness > of the information contained herein. The intended recipient is advised to > consult its own professional advisors, including those specializing in > legal, tax and accounting matters. Orchard does not provide legal, tax or > accounting advice. >