Re: How to enable fault-tolerance?

2014-06-09 Thread Peng Cheng
ith TaskSetScheduler, so a definitely-will-fail task will fail quickly without taking more resources. However I haven't found any documentation or web page on it -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-enable-faul

Re: How to enable fault-tolerance?

2014-06-09 Thread Matei Zaharia
eng Cheng >> <mailto:pc...@uow.edu.au>> wrote: >>> >>>I speculate that Spark will only retry on exceptions that are >>>registered with >>>TaskSetScheduler, so a definitely-will-fail task will fail quickly >>>without >>>taking more resources. However I haven't found any documentation >>>or web page >>>on it >>> >>> >>> >>>-- >>>View this message in context: >>> >>> http://apache-spark-user-list.1001560.n3.nabble.com/How-to-enable-fault-tolerance-tp7250p7255.html >>> >>>Sent from the Apache Spark User List mailing list archive at >>>Nabble.com. >>> >>>

Re: How to enable fault-tolerance?

2014-06-09 Thread Peng Cheng
on it -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-enable-fault-tolerance-tp7250p7255.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: How to enable fault-tolerance?

2014-06-09 Thread Peng Cheng
l-fail task will fail quickly without taking more resources. However I haven't found any documentation or web page on it -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-enable-fault-tolerance-tp7250p7255.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: How to enable fault-tolerance?

2014-06-09 Thread Aaron Davidson
any documentation or web > page > on it > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-enable-fault-tolerance-tp7250p7255.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: How to enable fault-tolerance?

2014-06-09 Thread Peng Cheng
-user-list.1001560.n3.nabble.com/How-to-enable-fault-tolerance-tp7250p7255.html Sent from the Apache Spark User List mailing list archive at Nabble.com.