Hi all, Thanks for the comments/suggestions and discussions about the details of moving Variant to Parquet <https://docs.google.com/document/d/1guEzBQjzOEEZvvibeZjNraKmZHWtxQR95O_DvtZU0xw/edit?usp=sharing> .
We have general alignment for the next steps for the plan. - We will open a PR for the spec documents to the parquet-format repo - The spec will include the disclaimer that this is still "WIP" or "experimental", and we can iterate on the spec in parquet-format - Eventually, after the necessary changes, we can vote in Parquet to remove the "WIP" disclaimers - The location and release process of the Java implementation of the binary encoding is not fully decided yet, so we will continue to work towards that effort. Thanks, Gene On Mon, Sep 9, 2024 at 9:32 PM Gene Pang <gene.p...@gmail.com> wrote: > Hi all, > > The Spark community has agreed > <https://lists.apache.org/thread/pkybo148j6qyn2wsjnmyrhqs3crn9b89> to > move the Variant specification and implementation to the Parquet project. > > However, there are several details we need to figure out with the move to > Parquet. I have started a document with some of the topics and details we > need to finalize. > > > https://docs.google.com/document/d/1guEzBQjzOEEZvvibeZjNraKmZHWtxQR95O_DvtZU0xw/edit?usp=sharing > > Please take a look at the document and leave comments, questions and > feedback to help reach a conclusion. > > Thanks, > Gene >
