Yeah, we don't build with -Phive on purpose. It should still work though as
long as the jars are available and packaged, no?
Aravind
From: Jeff Zhang <[email protected]>
To: [email protected]; Aravindakshan Srinivasan <[email protected]>
Sent: Tuesday, July 12, 2016 4:51 PM
Subject: Re: Spark Action and HiveContext
I suspect you didn't enable -Phive when building spark.
On Wed, Jul 13, 2016 at 7:19 AM, Aravindakshan Srinivasan <
[email protected]> wrote:
> Thanks Peter, but that doesn't help. The HiveContext class is part of
> Spark-hive jars and not really part of the Hive share-lib. But Oozie just
> doesn't seem to see the spark-hive jar regardless of where I put it.
>
> Aravind
>
> From: Peter Cseh <[email protected]>
> To: [email protected]; Aravindakshan Srinivasan <[email protected]>
> Sent: Tuesday, July 12, 2016 1:45 PM
> Subject: Re: Spark Action and HiveContext
>
> Hi,
>
> Have you tried adding the hive sharelib to the action?
> <configuration>
> <property>
> <name>oozie.action.sharelib.for.spark</name>
> <value>spark,hive</value>
> </property>
> </configuration>
> You may define this on action, workflow or global level.
> Peter
>
> On Tue, Jul 12, 2016 at 10:11 PM, Aravindakshan Srinivasan <
> [email protected]> wrote:
>
> > Team,
> > Has anybody been successful using HiveContext via the Oozie Spark action?
> > I get errors regardless of how I package and share the spark-hive jars.
> > This is on Oozie 4.2.0.
> > User class threw exception: java.lang.NoClassDefFoundError:
> > org/apache/spark/sql/hive/HiveContext Wondering if folks have figured out
> > some patterns or solutions for this.
> > Best,Aravind
> --------------------------------------------------------------------------------------------Aravind
> > Srinivasan
> > http://goodcynicsports.blogspot.com
> > I have decided to stick with love. Hate is too great a burden to bear.
> > - MLK,
> > Jr.
> --------------------------------------------------------------------------------------------
> >
>
>
>
> --
> Peter Cseh
> Software Engineer
> <http://www.cloudera.com>
>
>
>
>
--
Best Regards
Jeff Zhang
