pitrou commented on a change in pull request #11031:
URL: https://github.com/apache/arrow/pull/11031#discussion_r699251444
##########
File path: python/pyarrow/parquet.py
##########
@@ -492,16 +492,18 @@ def _sanitize_table(table, new_schema, flavor):
return table
-_parquet_writer_arg_docs = """version : {"1.0", "2.0"}, default "1.0"
+_parquet_writer_arg_docs = """version : {"1.0", "2.4", "2.6"}, default "1.0"
Determine which Parquet logical types are available for use, whether the
reduced set from the Parquet 1.x.x format or the expanded logical types
- added in format version 2.0.0 and after. Note that files written with
- version='2.0' may not be readable in all Parquet implementations, so
- version='1.0' is likely the choice that maximizes file compatibility. Some
- features, such as lossless storage of nanosecond timestamps as INT64
- physical storage, are only available with version='2.0'. The Parquet 2.0.0
- format version also introduced a new serialized data page format; this can
- be enabled separately using the data_page_version option.
+ added in later format versions.
+ Files written with version='2.4' or '2.6' may not be readable in all
+ Parquet implementations, so version='1.0' is likely the choice that
+ maximizes file compatibility.
+ Logical types and UINT32 are only available with version '2.4'.
Review comment:
Hmm, thanks. This is a mess.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
