Hello Team, I am working on different products such as Spark and Dremio. Dremio is able to write and read Parquet V2 and due this upgrade it is working faster than Parquet V1 files.
In case of spark it is still defaulting to Parquet V1 and when I checked with Spark community they told me Parquet community isn't recommending Parquet V2. "Prem, as I said earlier, v2 is not a finalized spec so you should not use it. That's why it is not the default. You can get Spark to write v2 files, but it isn't recommended by the Parquet community." please advise.