-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi,
I am trying to figure out how to run spark jobs on a mesos cluster. The mesos cluster has some nodes that have tachyon install on some nodes and I would like the spark jobs to be started on only those nodes. Each of these nodes have been configured with attributes `tachyon:true`. Is there a way by which i can tell the spark driver/scheduler to add this to the set of constraints while accepting offers from the mesos master? The main idea here is that I want to make sure that all my spark tasks preferably run on tachyon enabled nodes (if available) and then prefer other nodes. I realize that the "prefer" part may not be possible but I atleast want to start with just getting them to run only on the tachyon enabled nodes. Also, if someone could give me a pointer to the mesos scheduler code in spark that'll be great. - -- Ankur Chauhan -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJVHZzQAAoJEOSJAMhvLp3L6GgH/1yWTJ4VE+7T1ysQTcPlqYhE ATUbT98+v1Y1qmEzhnz2STsJCm2tJhvivJGjee1xIgUzKlg5CfxQcBvQ/DmrOZXJ c4fwx7d+ZoCkAqqLsqf6Pvi+31s/TL311bhqJYcR9msOuIoVFPjyMQEI9QDV+yrE goNb684n+dKLDKJbThIou6gVCzlHw0z2FbJ7WGFMy3seYMH8RiF72Dm4pL2kmjCb V9Zc8VQJAfONFpl7Lh/gUj7njkyx2su0NY5d5a+sS+FywzwQX5dLPs43T+/7UfIg B1DhfkEsn7aNqauXh0WI13CKjKhoTaEnuFhllErl+9GzKinPQUNEZfCG5SnnXd4= =VOPR -----END PGP SIGNATURE----- --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
