---------- Forwarded message ---------- From: Sadhan Sood <[email protected]> Date: Sat, Oct 11, 2014 at 10:26 AM Subject: Re: how to find the sources for spark-project To: Stephen Boesch <[email protected]>
Thanks, I still didn't find it - is it under some particular branch ? More specifically, I am looking to modify the file: ParquetHiveSerDe.java which is under this namespace: org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java and is being linked through this jar: <dependency> <groupId>org.spark-project.hive</groupId> <artifactId>hive-exec</artifactId> <version>0.12.0</version> </dependency> It seems these are modified versions of the same jar in org.apache.hive: <dependency> <groupId>org.apache.hive</groupId> <artifactId>hive-exec</artifactId> <version>0.13.1</version> </dependency> It'd be great if I can find the sources of this jar so I can modify it locally and rebuild jar. Not sure if I can rebuild spark with hive-exec artifact in org.apache.hive without breaking it. On Fri, Oct 10, 2014 at 7:28 PM, Stephen Boesch <[email protected]> wrote: > Git clone the spark project https://github.com/apache/spark.git > the hive related sources are under sql/hive/src/main/scala > > 2014-10-10 16:24 GMT-07:00 sadhan <[email protected]>: > > We have our own customization on top of parquet serde that we've been using >> for hive. In order to make it work with spark-sql, we need to be able to >> re-build spark with this. It'll be much easier to rebuild spark with this >> patch once I can find the sources for org.spark-project.hive. Not sure >> where >> to find it ? This seems like the place where we need to put our patch. >> >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/how-to-find-the-sources-for-spark-project-tp16187.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> >> >
