AlenkaF commented on PR #50419: URL: https://github.com/apache/arrow/pull/50419#issuecomment-4924574025
I have used Claude for suggesting the split of pyarrow parquet page and to look through the code and the git log history for any features/changes that might be missing from the docs. From what was suggested I continued with the work on my own. I have split the changes in different commits so the change will be easier to review (due to the docs split, the change is bigger than it really is). [commit 1](https://github.com/apache/arrow/pull/50419/changes/774f0a95014c4a0dc1b1f46ccb178c9d3665bd82): restructure of the content, no content changes @thisisnic, do you mind having a look? [commit 2](https://github.com/apache/arrow/pull/50419/changes/0baa52b0c3e3c9a423a2a5761c833f9faabd4279): add content about filtering and ability to write bloom filters @mapleFU, do you mind having a look? [commit 3](https://github.com/apache/arrow/pull/50419/changes/5542e8415c1dc86c685ce0be15570941f264e908): add section on iter_batches @raulcd, do you mind having a look? [commit 4](https://github.com/apache/arrow/pull/50419/changes/8da1e4ecc5ac6586a4978447914b622250325458): add section on binary/list_type option on read, reading extension types @pitrou @paleolimbot, do you mind having a look? [commit 5](https://github.com/apache/arrow/pull/50419/changes/d0f4c4a0e8cf3d8793f887b1b0be43657e5bc58f): datasets note on single file partitions not being included [commit 6](https://github.com/apache/arrow/pull/50419/changes/32c29e02a78d1e56a5145fe4e2e56eeaffdccab9): update parquet writer's parameter list @raulcd, do you mind having a look? [commit 7](https://github.com/apache/arrow/pull/50419/changes/f38e1cad230fa834f125153a9bb264275c552298): update encryption section adding info on key rotation and direct encryption @adamreeve, do you mind having a look? Rendered docs are available here: https://s3.amazonaws.com/arrow-data/pr_docs/50419/python/parquet/index.html -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
