[
https://issues.apache.org/jira/browse/SPARK-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-10793:
---------------------------------
Labels: bulk-closed (was: )
> Make spark's use/subclassing of hive more maintainable
> ------------------------------------------------------
>
> Key: SPARK-10793
> URL: https://issues.apache.org/jira/browse/SPARK-10793
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.5.0
> Reporter: Steve Loughran
> Priority: Major
> Labels: bulk-closed
>
> The latest spark/hive integration round has closed the gap with Hive
> versions, but the integration is still pretty complex
> # SparkSQL has deep hooks into the parser
> # hivethriftserver uses "aggressive reflection" to inject spark classes into
> the Hive base classes.
> # there's a separate org.sparkproject.hive JAR to isolate Kryo versions while
> avoiding the hive uberjar with all its dependencies getting into the spark
> uberjar.
> We can improve this with some assistance from the other projects, even though
> no guarantees of stability of things like the parser and thrift server APIs
> are likely in the near future
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
