raulcd opened a new issue, #36332: URL: https://github.com/apache/arrow/issues/36332
### Describe the bug, including details regarding any error messages, version, and platform. It does seem that: https://github.com/apache/arrow/pull/36211 Updated from `PoolThreadCache` to `PoolArenasCache` this has made our nightly integration tests with Spark previous and current development versions to fail. * [test-conda-python-3.10-spark-master](https://github.com/ursacomputing/crossbow/actions/runs/5384439355/jobs/9772369764) * [test-conda-python-3.8-spark-v3.1.2](https://github.com/ursacomputing/crossbow/actions/runs/5384437151/jobs/9772364881) * [test-conda-python-3.9-spark-v3.2.0](https://github.com/ursacomputing/crossbow/actions/runs/5384440806/jobs/9772373132) The error: ``` 02:07:30.759 WARN org.apache.spark.scheduler.TaskSetManager: Lost task 0.0 in stage 24.0 (TID 30) (ab33723e6432 executor driver): java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocatorL$InnerAllocator.threadCache()Lio/netty/buffer/PoolArenasCache; ``` Spark hasn't yet updated to 4.1.94.Final. I am unsure on how do we fix this but does this mean we break backwards compatibility with previous Spark versions? ### Component(s) Continuous Integration, Java -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
