samarthjain opened a new issue #646: Shade Arrow to decouple Iceberg from the Arrow version used by Spark URL: https://github.com/apache/incubator-iceberg/issues/646 Spark 2.4.4 uses Arrow 0.10.1. However, there are a few configuration options available in later releases of Arrow (0.14+) that significantly help improve performance. In general, it would be good for Iceberg to use it's own Arrow version so that we can update it faster as opposed to relying on Spark.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
