[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14576101#comment-14576101 ]
Ankur Chauhan commented on SPARK-6707: -------------------------------------- Hi Kapil, The patch is pretty much ready to go but I haven't heard from anyone of the other reviewers on the pull request so I can't say when it will be in master. > Mesos Scheduler should allow the user to specify constraints based on slave > attributes > -------------------------------------------------------------------------------------- > > Key: SPARK-6707 > URL: https://issues.apache.org/jira/browse/SPARK-6707 > Project: Spark > Issue Type: Improvement > Components: Mesos, Scheduler > Affects Versions: 1.3.0 > Reporter: Ankur Chauhan > Labels: mesos, scheduler > > Currently, the mesos scheduler only looks at the 'cpu' and 'mem' resources > when trying to determine the usablility of a resource offer from a mesos > slave node. It may be preferable for the user to be able to ensure that the > spark jobs are only started on a certain set of nodes (based on attributes). > For example, If the user sets a property, let's say > {code}spark.mesos.constraints{code} is set to > {code}tachyon=true;us-east-1=false{code}, then the resource offers will be > checked to see if they meet both these constraints and only then will be > accepted to start new executors. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org