kalyanamdewri opened a new pull request, #55581: URL: https://github.com/apache/arrow/pull/55581
Summary: - Correct the default Dataset scan batch size to 131,072 rows and distinguish it from the Parquet writer's default row group size. - Add a runnable example showing that a larger scan batch size does not combine Parquet row groups. Validation: - `python -m pytest --doctest-glob='*.rst' docs/source/python/dataset.rst -q` — 1 passed with PyArrow 26.0.1 - `git diff --check` — passed Was AI used for this PR? AI assisted with the documentation patch and draft description. I reviewed the diff and ran the checks locally. GitHub Issue: #40576 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
