Re: Killing Long running tasks (stragglers)

2015-06-25 Thread William Ferrell
Thank you for your reply Akhil! Here is an example of the script that we are using: https://gist.github.com/wasauce/40f3350c1a110e5cef1c Any pointers would be very helpful. Best, - Bill On Thu, Jun 25, 2015 at 2:03 AM, Akhil Das ak...@sigmoidanalytics.com wrote: That totally depends on the

Killing Long running tasks (stragglers)?

2015-06-25 Thread wasauce
in context: http://apache-spark-user-list.1001560.n3.nabble.com/Killing-Long-running-tasks-stragglers-tp23485.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr

Re: Killing Long running tasks (stragglers)

2015-06-25 Thread Akhil Das
That totally depends on the way you extract the data. It will be helpful if you can paste your code so that we will understand it better. Thanks Best Regards On Wed, Jun 24, 2015 at 2:32 PM, William Ferrell wferr...@gmail.com wrote: Hello - I am using Apache Spark 1.2.1 via pyspark. Thanks