Hey Aviem, Thank you for noticing. You were right, I was able to run all my jobs in Spark 1.6.3. You are awesome!!!
Regards, Sathish. J On 16-Aug-2017, at 3:23 PM, Aviem Zur <aviem...@gmail.com<mailto:aviem...@gmail.com>> wrote: 2.0.0. I really doubt if its Spark setup issue. I wrote a native Spark application which does the same job that I wanted. It ran fine in local setup & also in the Azure HDInsight cluster.
