Confirmed, closing this . Thanks everyone for valuable information. Sent from my iPhone
> On Apr 25, 2024, at 9:55 AM, Prem Sahoo <prem.re...@gmail.com> wrote: > > > Hello Spark , > After discussing with the Parquet and Pyarrow community . We can use the > below config so that Spark can write Parquet V2 files. > > "hadoopConfiguration.set(“parquet.writer.version”, “v2”)" while creating > Parquet then those are V2 parquet. > > Could you please confirm ?
