Re: Should we default to write parquet format version 2.0? (not data page version 2.0)

[Joris Van den Bossche]

On Tue, 15 Dec 2020 at 17:50, Antoine Pitrou <anto...@python.org> wrote:

>
> Le 15/12/2020 à 17:46, Joris Van den Bossche a écrit :
> >
> > No, I actually mean 2.2. (I don't think a 1.2 version exists, at least
> > according to the git tags)
> > You can compare the thrift file for version 2.1 (
> >
> https://github.com/apache/parquet-format/blob/parquet-format-2.1.0/src/thrift/parquet.thrift
> )
> > vs 2.2 (
> >
> https://github.com/apache/parquet-format/blob/apache-parquet-format-2.2.0/src/thrift/parquet.thrift
> ),
> > in which a set of ConvertedTypes where added.
>
> I don't understand.  In which version did logical types appear then?
>

LogicalTypes were added in format version 2.4 (
https://github.com/apache/parquet-format/pull/51), around 3 years ago.


>
> (frankly, Parquet features are a mess to navigate)
>
> Regards
>
> Antoine.
>