After i set spark.driver.userClassPathFirst=true, my spark-submit --master
yarn-client fails with below error & it works fine if i remove
userClassPathFirst setting. I need to add this setting to avoid class
conflicts in some other job so trying to make it this setting work in
simple job first & la
Tested with java 7 & 8 , same issue on both versions.
On Aug 17, 2016 12:29 PM, "spats" wrote:
> Cannot convert JavaRDD to DataFrame in spark 1.6.0, throws null pointer
> exception & no more details. Can't really figure out what really happening.
> Any pointer to fixes?
>
> //convert JavaRDD to
s
>
> On Mon, Feb 1, 2016 at 4:25 PM, sudhir patil
> wrote:
>
>> Spark job on Standalone cluster is Stuck, shows no logs after
>> "util.AkkaUtils: Connecting to HeartbeatReceiver" on worker nodes and
>> "storage.BlockmanagerInfo: Added broadcast..." on
Spark job on Standalone cluster is Stuck, shows no logs after
"util.AkkaUtils: Connecting to HeartbeatReceiver" on worker nodes and
"storage.BlockmanagerInfo: Added broadcast..." on client driver side.
Would be great, if you could clarify any of these ( or better all of these
:)
1. Did anyone see