Re: Use Apache ORC in Apache Spark 2.3

-private@ list for future replies. This is not a PMC conversation. On Fri, Aug 11, 2017 at 3:17 AM Andrew Ash wrote: > @Reynold no I don't use the HiveCatalog -- I'm using a custom > implementation of ExternalCatalog instead. > > On Thu, Aug 10, 2017 at 3:34 PM, Dong Joon

Re: Use Apache ORC in Apache Spark 2.3

..@databricks.com> > *Date: *Thursday, August 10, 2017 at 3:23 PM > *To: *Andrew Ash <and...@andrewash.com> > *Cc: *Dong Joon Hyun <dh...@hortonworks.com>, "dev@spark.apache.org" < > dev@spark.apache.org>, Apache Spark PMC <priv...@spark.apache.org>

Re: Use Apache ORC in Apache Spark 2.3

com> Date: Thursday, August 10, 2017 at 3:23 PM To: Andrew Ash <and...@andrewash.com> Cc: Dong Joon Hyun <dh...@hortonworks.com>, "dev@spark.apache.org" <dev@spark.apache.org>, Apache Spark PMC <priv...@spark.apache.org> Subject: Re: Use Apache ORC in Apac

Re: Use Apache ORC in Apache Spark 2.3

Do you not use the catalog? On Thu, Aug 10, 2017 at 3:22 PM, Andrew Ash wrote: > I would support moving ORC from sql/hive -> sql/core because it brings me > one step closer to eliminating Hive from my Spark distribution by removing > -Phive at build time. > > On Thu, Aug

Re: Use Apache ORC in Apache Spark 2.3

I would support moving ORC from sql/hive -> sql/core because it brings me one step closer to eliminating Hive from my Spark distribution by removing -Phive at build time. On Thu, Aug 10, 2017 at 9:48 AM, Dong Joon Hyun wrote: > Thank you again for coming and reviewing

Re: Use Apache ORC in Apache Spark 2.3

Thank you again for coming and reviewing this PR. So far, we discussed the followings. 1. `Why are we adding this to core? Why not just the hive module?` (@rxin) - `sql/core` module gives more benefit than `sql/hive`. - Apache ORC library (`no-hive` version) is a general and resonably

Re: Use Apache ORC in Apache Spark 2.3

Thank you so much, Owen! Bests, Dongjoon. From: Owen O'Malley <owen.omal...@gmail.com> Date: Friday, August 4, 2017 at 9:59 AM To: Dong Joon Hyun <dh...@hortonworks.com> Cc: "dev@spark.apache.org" <dev@spark.apache.org>, Apache Spark PMC <priv...@spark.apache.o

Re: Use Apache ORC in Apache Spark 2.3

The ORC community is really eager to get this work integrated in to Spark so that Spark users can have fast access to their ORC data. Let us know if we can help the integration. Thanks, Owen On Fri, Aug 4, 2017 at 8:05 AM, Dong Joon Hyun wrote: > Hi, All. > > > >