spark-submit fails after setting userClassPathFirst to true

2016-10-29 Thread sudhir patil
After i set spark.driver.userClassPathFirst=true, my spark-submit --master yarn-client fails with below error & it works fine if i remove userClassPathFirst setting. I need to add this setting to avoid class conflicts in some other job so trying to make it this setting work in simple job first & la

Re: JavaRDD to DataFrame fails with null pointer exception in 1.6.0

2016-08-16 Thread sudhir patil
Tested with java 7 & 8 , same issue on both versions. On Aug 17, 2016 12:29 PM, "spats" wrote: > Cannot convert JavaRDD to DataFrame in spark 1.6.0, throws null pointer > exception & no more details. Can't really figure out what really happening. > Any pointer to fixes? > > //convert JavaRDD to

Re: Spark Standalone cluster job to connect Hbase is Stuck

2016-02-01 Thread sudhir patil
s > > On Mon, Feb 1, 2016 at 4:25 PM, sudhir patil > wrote: > >> Spark job on Standalone cluster is Stuck, shows no logs after >> "util.AkkaUtils: Connecting to HeartbeatReceiver" on worker nodes and >> "storage.BlockmanagerInfo: Added broadcast..." on

Spark Standalone cluster job to connect Hbase is Stuck

2016-02-01 Thread sudhir patil
Spark job on Standalone cluster is Stuck, shows no logs after "util.AkkaUtils: Connecting to HeartbeatReceiver" on worker nodes and "storage.BlockmanagerInfo: Added broadcast..." on client driver side. Would be great, if you could clarify any of these ( or better all of these :) 1. Did anyone see