Thanks Peter, but that doesn't help. The HiveContext class is part of
Spark-hive jars and not really part of the Hive share-lib. But Oozie just
doesn't seem to see the spark-hive jar regardless of where I put it.
Aravind
From: Peter Cseh <[email protected]>
To: [email protected]; Aravindakshan Srinivasan <[email protected]>
Sent: Tuesday, July 12, 2016 1:45 PM
Subject: Re: Spark Action and HiveContext
Hi,
Have you tried adding the hive sharelib to the action?
<configuration>
<property>
<name>oozie.action.sharelib.for.spark</name>
<value>spark,hive</value>
</property>
</configuration>
You may define this on action, workflow or global level.
Peter
On Tue, Jul 12, 2016 at 10:11 PM, Aravindakshan Srinivasan <
[email protected]> wrote:
> Team,
> Has anybody been successful using HiveContext via the Oozie Spark action?
> I get errors regardless of how I package and share the spark-hive jars.
> This is on Oozie 4.2.0.
> User class threw exception: java.lang.NoClassDefFoundError:
> org/apache/spark/sql/hive/HiveContext Wondering if folks have figured out
> some patterns or solutions for this.
> Best,Aravind
> --------------------------------------------------------------------------------------------Aravind
> Srinivasan
> http://goodcynicsports.blogspot.com
> I have decided to stick with love. Hate is too great a burden to bear.
> - MLK,
> Jr.
> --------------------------------------------------------------------------------------------
>
--
Peter Cseh
Software Engineer
<http://www.cloudera.com>
