cricket007 commented on issue #18209: [SPARK-20992][Scheduler] Add support for 
Nomad as a scheduler backend
URL: https://github.com/apache/spark/pull/18209#issuecomment-586386374
 
 
   > I would recommend to add interfaces in Spark code to abstract out things 
so that plugging in new schedulers would be as simple as adding a jar to the 
classpath. As a matter of fact, we are currently able to use Spark with our own 
scheduler by extending the existing interfaces. The only patching we have to do 
is 3-4 lines which is not super pain during upgrades. Seems like you need more 
than the current interfaces. - @tejasapatil 
   
   Do these such interfaces exist in Spark at present day? What efforts do you 
know of to make support for such efforts to "be as simple as adding a jar to 
the classpath"?
   
   I see https://issues.apache.org/jira/browse/SPARK-19700 is still open... 
   
   > it remains unclear whether the k8s code will be brought in as a 
first-class citizen alongside Mesos and YARN
   
   Well, looks like it's first class now. Is there historical context one can 
read on how that decision was ultimately made _instead_ of working on the 
plugin interface, as discussed? 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to