Sergio Peña commented on HIVE-14029:

Sure. [~stakiar] Let me know if the below statements are correct, and feel free 
to correct me.

- Spark2 uses a fork of Hive 1.2 due to issues with Apache Hive. They called 
this project {{spark-hive}}. Spark only uses Hive 1.2 metastore/serde/udf jars 
form this forked project.
  They download this from 

- Spark2 assembly without hive will be built without any of the above 

- Hive2 itests will use Spark2 assembly to run Hive2 tests. This means Hive2 
might not test Spark2 correctly due to the lack of Hive 1.2 libraries in it.

> Update Spark version to 2.0.0
> -----------------------------
>                 Key: HIVE-14029
>                 URL: https://issues.apache.org/jira/browse/HIVE-14029
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Ferdinand Xu
>            Assignee: Ferdinand Xu
>         Attachments: HIVE-14029.1.patch, HIVE-14029.patch
> There are quite some new optimizations in Spark 2.0.0. We need to bump up 
> Spark to 2.0.0 to benefit those performance improvements.

This message was sent by Atlassian JIRA

Reply via email to