[
https://issues.apache.org/jira/browse/ARROW-5915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wes McKinney updated ARROW-5915:
--------------------------------
Fix Version/s: (was: 0.16.0)
> [C++] [Python] Set up testing for backwards compatibility of the parquet
> reader
> -------------------------------------------------------------------------------
>
> Key: ARROW-5915
> URL: https://issues.apache.org/jira/browse/ARROW-5915
> Project: Apache Arrow
> Issue Type: Test
> Components: C++, Python
> Reporter: Joris Van den Bossche
> Priority: Major
> Labels: parquet
>
> Given the recent parquet compat problems, we should have better testing for
> this.
> For easy testing of backwards compatibility, we could add some files (with
> different types) written with older versions, and ensure they are read
> correctly with the current version.
> Similarly as what Kartothek is doing:
> https://github.com/JDASoftwareGroup/kartothek/tree/master/reference-data/arrow-compat
> An easy way would be to do that in pyarrow and add them to
> /pyarrow/tests/data/parquet (we already have some files from 0.7 there).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
