yew1eb opened a new issue, #1606: URL: https://github.com/apache/auron/issues/1606
**Describe the bug** `NullPointerException` occurs in `ArrowFFIExporter` constructor during native plan execution. possibly due to multiple conflicting Apache Arrow library versions. **To Reproduce** 1. Enable Auron(commit: https://github.com/apache/auron/commit/153919283ef4a3ded80852564c14694544c51f7e) in Spark(3.3.1). 2. Run a query with broadcast join/exchange. 3. Task fails with NPE in `ArrowFFIExporter.scala:47`. **Expected behavior** Task succeeds without `NullPointerException` **Screenshots** NA **Additional context** Error Log: ``` 25/11/05 15:11:27 ERROR Executor: Exception in task 0.2 in stage 1.0 (TID 11) java.lang.NullPointerException at org.apache.spark.sql.execution.auron.arrowio.ArrowFFIExporter.<init>(ArrowFFIExporter.scala:47) at org.apache.spark.sql.execution.auron.plan.ConvertToNativeBase.$anonfun$doExecuteNative$1(ConvertToNativeBase.scala:78) at org.apache.spark.sql.auron.NativePlanWrapper.plan(NativeRDD.scala:96) at org.apache.spark.sql.auron.NativeRDD.nativePlan(NativeRDD.scala:56) at org.apache.spark.sql.execution.auron.plan.NativeBroadcastExchangeBase$$anon$5.compute(NativeBroadcastExchangeBase.scala:223) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:365) at org.apache.spark.rdd.RDD.iterator(RDD.scala:329) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:136) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:545) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1504) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:548) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
