Thanks for the heads-up Dongjoon. I just noticed that thread this morning and was planning on responding. I'll do that today.
rb On Thu, Dec 15, 2016 at 9:18 AM, Dongjoon Hyun <[email protected]> wrote: > Hi, All. > > I made a PR to upgrade Parquet to 1.9.0 for Apache Spark 2.2 on Late March. > > - https://github.com/apache/spark/pull/16281 > > Currently, there occurs some important options about that. Here is the > summary. > > 1. Forking Parquet 1.8.X and maintaining like Spark Hive. > 2. Wait and see for Parquet 1.9.x adoption in the other community. > 3. Make stronger integration tests including both feature and performance > tests > > I think we had better inform all of you on dev mailing list because it has > an option forking. > If you have any opinion, please reply here or on the PR. > > BTW, the default decision is always number 2 because we will use Apache > Parquet 1.8.1 for a while. > > Bests, > Dongjoon. > > --------------------------------------------------------------------- > To unsubscribe e-mail: [email protected] > > -- Ryan Blue Software Engineer Netflix
