[
https://issues.apache.org/jira/browse/ARROW-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17605793#comment-17605793
]
Weston Pace commented on ARROW-17719:
-------------------------------------
Although, I suppose I am thinking of the alternative being to set the default
to "all files". Perhaps a default of something like {{min(num_files, 32)}}
would be reasonable.
> [Python] Improve error message when all values in a column are null in a
> parquet partition
> ------------------------------------------------------------------------------------------
>
> Key: ARROW-17719
> URL: https://issues.apache.org/jira/browse/ARROW-17719
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Affects Versions: 9.0.0
> Reporter: Philipp Moritz
> Priority: Minor
> Fix For: 10.0.0
>
>
> There is a good bug report about this in
> [https://stackoverflow.com/a/70568419/10891801] and it still seems to be a
> problem.
> Basically the error message is pretty bad if all values in a given column of
> a parquet partition are null. We should either handle this case better or
> give a better error message.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
