timothyw553 opened a new pull request, #16913: URL: https://github.com/apache/iceberg/pull/16913
## Summary Fix ColumnVectorWithFilter child-vector handling after row filtering: - wrap row-addressed child vectors for struct, Spark calendar interval, and Spark variant types - return raw child vectors for array/map element storage so element indexes are not remapped as row indexes - add regression coverage for Spark 3.5, 4.0, and 4.1 ## Red/green evidence The first commit only adds tests. On that commit, the targeted tests fail with UnsupportedOperationException from ColumnVectorWithFilter.getChild for interval/array/map, and for variant on Spark 4.0/4.1. After the fix commit, these commands pass: - ./gradlew --no-daemon -DsparkVersions=3.5 :iceberg-spark:iceberg-spark-3.5_2.12:test --tests org.apache.iceberg.spark.data.vectorized.TestColumnVectorWithFilter - ./gradlew --no-daemon -DsparkVersions=4.0 -DscalaVersion=2.13 :iceberg-spark:iceberg-spark-4.0_2.13:test --tests org.apache.iceberg.spark.data.vectorized.TestColumnVectorWithFilter - ./gradlew --no-daemon :iceberg-spark:iceberg-spark-4.1_2.13:test --tests org.apache.iceberg.spark.data.vectorized.TestColumnVectorWithFilter - ./gradlew --no-daemon spotlessCheck -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
