On Apr 20 2016, at 1:36 am, Jian Qiu <gothicqiuj...@gmail.com> wrote:
> It is not necessary to configure --role on master. Actually it should work
if you configure --default_role='sparkr' on agent and start marathon with
--mesos_role=sparkr. Which version of mesos are you using? And could you
attach the master log?
This is Marathon 0.15 and Mesos 0.28.1
on my masters I have the following attribute set
$ cat /etc/marathon/conf/mesos_role
spark;sparkr;ms;qa
On the slave I have the following set in the agent
$ cat /etc/mesos-slave/default_role
sparkr
$ cat /etc/mesos-slave/resources
cpus:10;mem:100000
$ cat attributes
rack:sparkr
I'm trying to launch a simple task from marathon on this agent with following
configs
$ cat rstudio-mesos-shuffle-server.marathon.json
{
"id": "/mesos/rstudio-shuffle-service",
"cmd": ". /opt/spark-1.6.1/conf/spark-env.sh . /opt/spark-1.6.1/sbin/spark-
config.sh && . /opt/spark-1.6.1/bin/load-spark-env.sh && env
&& /opt/spark-1.6.1/bin/spark-class
org.apache.spark.deploy.mesos.MesosExternalShuffleService 1",
"cpus": 0.5,
"mem": 1524,
"disk": 100,
"user": "mesos",
"instances": 1,
"requirePorts": true,
"acceptedResourceRoles": ["sparkr"],
"ports":
[
31338
],
"constraints": [
[
"hostname","UNIQUE"
],
[
"rack", "LIKE", "sparkr"
]
],
"env": {
"SPARK_HOME": "/opt/spark-1.6.1",
"SPARK_SCALA_VERSION": "2.11"
},
"healthChecks": [
{
"gracePeriodSeconds": 5,
"intervalSeconds": 10,
"maxConsecutiveFailures": 3,
"portIndex": 0,
"protocol": "TCP",
"timeoutSeconds": 5
}
],
"maxLaunchDelaySeconds": 3,
"backoffFactor": 1.20,
"upgradeStrategy": {
"minimumHealthCapacity": 0.5,
"maximumOverCapacity": 0.5
}
}
In the marathon logs this is what I see
20 12:11:42 prod-mesos-m-3.aws.xxx.com marathon[29617]: [2016-04-20
12:11:42,807] INFO Offer ID: [50ceafa4-f3c1-4738-a9eb-c5d3bf0ff742-O13166461].
Considered resources with roles: [sparkr]. Not all basic resources satisfied:
cpu not in offer, disk not in offer, mem not in offer
(mesosphere.mesos.ResourceMatcher$:marathon-akka.actor.default-dispatcher-9)
Thanks.
>
>
> On Wed, Apr 20, 2016 at 11:11 AM, Rodrick Brown <[rodrick@orchard-
app.com](mailto:rodr...@orchard-app.com)> wrote:
>
>> I'm confused do roles need to be configured on masters and slaves or just
slaves?
>>
>> The docs says --roles has been deprecated on mesos-master but doesn't state
an alternate method.
>>
>>
>>
>>
>>
>> on my slaves i'm using default_role='sparkr' and in marathon I've added
--mesos_role=sparkr however I'm not able to get any tasks to run on this
server do I need to set it on the masters also ?
>>
>>
>>
>> Please advise thanks.
>>
>>
>>
>> \--RB
>>
>>
>>
>>
>>
>>
>>
>> \--
>>
>> **Rodrick Brown** / Systems Engineer
>>
>> +1 917 445 6839 /
[rodr...@orchardplatform.com](mailto:char...@orchardplatform.com)
>>
>> **Orchard Platform**
>>
>> 101 5th Avenue, 4th Floor, New York, NY 10003
>>
>> [http://www.orchardplatform.com](http://www.orchardplatform.com/)
>>
>> [Orchard Blog](http://www.orchardplatform.com/blog/) | [Marketplace Lending
Meetup](http://www.meetup.com/Peer-to-Peer-Lending-P2P/)
>>
>>
>>
>> **NOTICE TO RECIPIENTS**: This communication is confidential and intended
for the use of the addressee only. If you are not an intended recipient of
this communication, please delete it immediately and notify the sender by
return email. Unauthorized reading, dissemination, distribution or copying of
this communication is prohibited. This communication does not constitute an
offer to sell or a solicitation of an indication of interest to purchase any
loan, security or any other financial product or instrument, nor is it an
offer to sell or a solicitation of an indication of interest to purchase any
products or services to any persons who are prohibited from receiving such
information under applicable law. The contents of this communication may not
be accurate or complete and are subject to change without notice. As such,
Orchard App, Inc. (including its subsidiaries and affiliates, "Orchard") makes
no representation regarding the accuracy or completeness of the information
contained herein. The intended recipient is advised to consult its own
professional advisors, including those specializing in legal, tax and
accounting matters. Orchard does not provide legal, tax or accounting advice.
>
>
--
*NOTICE TO RECIPIENTS*: This communication is confidential and intended for
the use of the addressee only. If you are not an intended recipient of this
communication, please delete it immediately and notify the sender by return
email. Unauthorized reading, dissemination, distribution or copying of this
communication is prohibited. This communication does not constitute an
offer to sell or a solicitation of an indication of interest to purchase
any loan, security or any other financial product or instrument, nor is it
an offer to sell or a solicitation of an indication of interest to purchase
any products or services to any persons who are prohibited from receiving
such information under applicable law. The contents of this communication
may not be accurate or complete and are subject to change without notice.
As such, Orchard App, Inc. (including its subsidiaries and affiliates,
"Orchard") makes no representation regarding the accuracy or completeness
of the information contained herein. The intended recipient is advised to
consult its own professional advisors, including those specializing in
legal, tax and accounting matters. Orchard does not provide legal, tax or
accounting advice.
