peterxcli commented on issue #4295: URL: https://github.com/apache/datafusion-comet/issues/4295#issuecomment-5874199342
Status update (2026-09-29): #5868 merged on September 25 and completed ordinary Parquet top-level whole-value Variant projection (#5546). The native scan supports canonical and shredded input with `spark.sql.variant.allowReadingShredded=true` and `spark.sql.variant.pushVariantIntoScan=false`. This scan umbrella should remain open for Iceberg whole-value projection, including field identity, schema evolution, and legal primitive-key equality deletes. #5519 tracks Spark's pushed whole-value scan request; #5435 tracks nested Variant columns; #3983 retains shredded subfield pruning and predicate pushdown. Native expression and transport support remain separate issues in #5438. #5438 and #5477 have been refreshed against current main. #5978 is the next whole-value performance priority; #5741/#5932 remains an independent Parquet annotation-validation correctness follow-up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
