RE: Concurrent execution of actions within a driver

2015-10-26 Thread Silvio Fiorito
There is a collectAsync action if you want to run them in parallel, but keep in mind the two jobs will need to share resources and you should use the FAIR scheduler. From: praveen S Sent: ‎10/‎26/‎2015 4:27 AM To:

Re: Concurrent execution of actions within a driver

2015-10-26 Thread Rishitesh Mishra
Spark executes tasks on an action. An action is broken down to multiple tasks. Multiple tasks from different actions run either in FIFO or FAIR mode depending on spark.scheduler.mode. Of course to get benefit of FAIR scheduling the two actions should be called by different threads. On Mon, Oct