[
https://issues.apache.org/jira/browse/SPARK-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-1681:
-----------------------------------
Description:
When Hive support is enabled we should copy the datanucleus jars to the
packaged distribution. The simplest way would be to create a lib_managed folder
in the final distribution so that the compute-classpath script searches in
exactly the same way whether or not it's a release.
A slightly nicer solution is to put the jars inside of `/lib` and have some
fancier check for the jar location in the compute-classpath script.
We should also document how to run Spark SQL on YARN when hive support is
enabled. In particular how to add the necessary jars to spark-submit.
was:
When Hive support is enabled we should copy the datanucleus jars to the
packaged distribution. The simplest way would be to create a lib_managed folder
in the final distribution so that the compute-classpath script searches in
exactly the same way whether or not it's a release.
A slightly nicer solution is to put the jars inside of `/lib` and have some
fancier check for the jar location in the compute-classpath script.
> Handle hive support correctly in ./make-distribution
> ----------------------------------------------------
>
> Key: SPARK-1681
> URL: https://issues.apache.org/jira/browse/SPARK-1681
> Project: Spark
> Issue Type: Bug
> Components: Build, SQL
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Priority: Blocker
> Fix For: 1.0.0
>
>
> When Hive support is enabled we should copy the datanucleus jars to the
> packaged distribution. The simplest way would be to create a lib_managed
> folder in the final distribution so that the compute-classpath script
> searches in exactly the same way whether or not it's a release.
> A slightly nicer solution is to put the jars inside of `/lib` and have some
> fancier check for the jar location in the compute-classpath script.
> We should also document how to run Spark SQL on YARN when hive support is
> enabled. In particular how to add the necessary jars to spark-submit.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
