Are you sure that you must deploy spark in standalone mode?(it currently only 
support FIFO)

If you could setup Spark on Yarn or Mesos, then it has supported Fair scheduler 
in application level.

-----Original Message-----
From: Nan Zhu [mailto:[email protected]] 
Sent: Tuesday, January 14, 2014 10:13 AM
To: [email protected]
Subject: Is there any plan to develop an application level fair scheduler?

Hi, All  

Is there any plan to develop an application level fair scheduler?

I think it will have more value than a fair scheduler within the application 
(actually I didn’t understand why we want to fairly share the resource among 
jobs within the application, in usual, users submit different applications, not 
jobs)…

Best,  

--  
Nan Zhu

Reply via email to