aquwikimedia opened a new pull request, #18931: URL: https://github.com/apache/iceberg/pull/18931
Backport of #11731 to 1.6.x, as done for 1.7.x. Since Spark 3.5.4 (SPARK-50235, SPARK-50463), ColumnarToRow calls closeIfFreeable() after each batch. IcebergArrowColumnVector reuses its Arrow vectors and must not be closed there. Without the override, rows after the first batch of each data file are read from released buffers. Only spark-hive35 is bumped: the other versions of the original change are not in 1.6.x. (cherry picked from commit 5a4e4e20c0813cc6ff84f4407dca9a2cea14f8a1) Bug: T441704 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
