[
https://issues.apache.org/jira/browse/OOZIE-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16175096#comment-16175096
]
Rohini Palaniswamy commented on OOZIE-2885:
-------------------------------------------
bq. Please extract the code in the try-catch block to a method w/ a describing
name
It is already in a setupHiveSite method. Please do not add another method for
this.
[~satishsaley],
I think you can actually remove
{code}
HiveConf.setHiveSiteLocation(HiveConf.class.getClassLoader().getResource("hive-site.xml"));
{code}
and it should still work fine.
bq. and add a unit test to TestSparkMain
This depends on OOZIE-2554. Any normal test in cluster mode would have caught
this. We need to fix OOZIE-2554 soon.
> Running Spark actions should not need Hive on the classpath
> -----------------------------------------------------------
>
> Key: OOZIE-2885
> URL: https://issues.apache.org/jira/browse/OOZIE-2885
> Project: Oozie
> Issue Type: Bug
> Reporter: Peter Cseh
> Assignee: Satish Subhashrao Saley
> Priority: Critical
> Attachments: OOZIE-2885-1.patch
>
>
> SparkMain references HiveConf so we need hive-common jar on the classpath
> even if the Spark job has nothing to do with Hive.
> This shouldn't be the case.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)