Re: Parquet versions

2016-10-18 Thread Padma Penumarthy
I have similar question and interested in finding out more about DataPageHeaderV2. Do we know which query engines can create parquet files with DataPageHeaderV2 (either by default or through an option) ? Which query engines support reading them and which do not ? Thanks, Padma > On Oct 18,

Parquet versions

2016-10-18 Thread Zivkovic, Vladimir
Hi, We start using Parquet file format in one of our projects for efficient storing of data to S3 and later querying of data in RedShift. How do we make sure we use the latest version of Parquet and how to know what version is being supported by different query engines? (e.g. Presto, RedShift