Jira issue for this: https://issues.apache.org/jira/browse/ARROW-17100
On Sun, Jul 17, 2022 at 8:54 PM Wes McKinney <wesmck...@gmail.com> wrote: > > This patch caused Parquet files written with 2.0.0 to be unreadable in > 3.0.0 onward > > https://github.com/apache/arrow/commit/ef0feb2c9c959681d8a105cbadc1ae6580789e69 > > This was reported on June 14 on dev@ and I git-bisected to the root cause: > > https://lists.apache.org/thread/wtbqozdhj2hwn6f0sps2j70lr07grk06 > > From the look of https://issues.apache.org/jira/browse/ARROW-10353, > we're going to have to use the Parquet footer metadata to insert a > backward compatibility affordance so that files written prior to 3.0.0 > are still readable. > > I have a very busy couple of weeks up ahead so I wanted to raise the > issue to see if someone would like to help. > > Thanks > Wes