Wahey ! That serialiser snippet did the trick. It is working now after the repartition.
It still won't work directly from the input though. I can continue my work from here. However, if anyone wants me to do something to try to get to the bottom of this I am up for it. Could this is the reason ? 14/02/02 18:29:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Many thanks Frank. Hassan -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Can-t-get-a-local-job-to-parallelise-using-0-9-0-from-git-with-parquet-and-avro-tp1130p1138.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
