JingsongLi commented on PR #10304: URL: https://github.com/apache/paimon/pull/10304#issuecomment-5935174500
Reviewed at `18e40983bdc6116362e63a87d63b7db3c4ce4dd2`. The standalone change preserves current behavior: it replaces internal path tuples with frozen dataclasses and updates the existing extraction/editing paths. It does not change the Parquet column selection, reader projection or IO performed today. The useful user-facing outcome in #10302 is shredded-Variant projection pruning, and that reader integration is not included here. I ran the Variant path, set, value and PyArrow row-group suites: 238 tests and 51 subtests passed. Flake8 and Python 3.6 syntax validation also passed; I found no actionable correctness regression in the conversion. Closing this standalone preparatory refactor because it has no current end-to-end behavior or IO improvement. Please include it with the projection-pruning implementation and a reader-level test showing that unused shredded columns are actually skipped. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
