[
https://issues.apache.org/jira/browse/ARROW-13240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17655568#comment-17655568
]
Micah Kornfield commented on ARROW-13240:
-----------------------------------------
https://issues.apache.org/jira/browse/ARROW-11634?jql=project%20in%20(PARQUET%2C%20ARROW)%20AND%20text%20~%20%22dictionary%20statistics%22
is the issue I was referring to so it looks like in Version 6.0, last update
the JIRA was sept 2021 so a little bit after this bug report.
> [C++][Parquet] Page statistics not written in v2?
> -------------------------------------------------
>
> Key: ARROW-13240
> URL: https://issues.apache.org/jira/browse/ARROW-13240
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Jorge Leitão
> Priority: Major
>
> While working in integration tests of parquet2 against pyarrow, I noticed
> that page statistics are only written by pyarrow when using version 1.
> I do not have an easy way to reproduce this within pyarrow as I am not sure
> how to access individual pages from a column chunk, but it is something that
> I observe when trying to integrate.
> The row group stats are still written, this only affects page statistics.
> pyarrow call:
> ```
> pa.parquet.write_table(
> t,
> path,
> version="2.0",
> data_page_version="2.0",
> write_statistics=True,
> )
> ```
> changing version to "1.0" does not impact this behavior, suggesting that the
> specific option causing this behavior is the data_page_version="2.0".
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
