XiaoHongbo-Hope opened a new pull request, #8848: URL: https://github.com/apache/paimon/pull/8848
### Purpose PyArrow can raise `Nested data conversions not implemented for chunked array outputs` when a projected VARIANT child is decoded into multiple chunks, including within one row group. Read projected Parquet VARIANT columns with bounded `ParquetFile.iter_batches()` calls while preserving projection, predicates, filter-only columns, and row-group pruning. ### Tests - Synthetic single-row-group reproducer failed before the fix and passes after it. - Relevant Python tests: 119 passed. - PyArrow 6 compatibility: 6 passed, 1 skipped. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
