GitHub user ikrommyd added a comment to the discussion: Iterating over parquet dataset in batches
Ah....looking at the source code, I found this: https://github.com/apache/arrow/blob/7623887f0aaef84c3f1fc209fd3f054feeeba753/python/pyarrow/parquet/core.py#L134. It's not in the documentation but looks "public" enough as it is accessible like `pyarrow.parquet.filters_to_expression` GitHub link: https://github.com/apache/arrow/discussions/47988#discussioncomment-14808041 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
