yew1eb opened a new issue, #1630:
URL: https://github.com/apache/auron/issues/1630
**Describe the bug**
<!--
A clear and concise description of what the bug is.
-->
**To Reproduce**
<!--
Steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error
-->
**Expected behavior**
<!--
A clear and concise description of what you expected to happen.
-->
**Screenshots**
<!--
If applicable, add screenshots to help explain your problem.
-->
**Additional context**
<!--
Add any other context about the problem here.
-->
use spark version 3.3, and executor memory configurations:
```
"spark.executor.memory": "12g",
"spark.executor.memoryOverhead": "1g",
"spark.memory.offHeap.enabled": "false"
```
errors logs:
```
25/11/16 16:04:54 WARN [Executor task launch worker for task 152.0 in stage
6.0 (TID 7081)] AuronCallNativeWrapper: Start executing native plan
25/11/16 16:04:54 WARN [Executor task launch worker for task 151.0 in stage
6.0 (TID 7080)] AuronCallNativeWrapper: Start executing native plan
25/11/16 16:04:54 WARN [Executor task launch worker for task 150.0 in stage
6.0 (TID 7079)] AuronCallNativeWrapper: Start executing native plan
25/11/16 16:04:54 WARN [Executor task launch worker for task 149.0 in stage
6.0 (TID 7078)] AuronCallNativeWrapper: Start executing native plan
------ initializing auron native environment ------
initializing logging with level: info
2025-11-16 16:04:54.815 (+0.000s) [INFO] [auron::exec:70] (stage: 0,
partition: 0, tid: 0) - initializing JNI bridge
2025-11-16 16:04:54.815 (+0.000s) [INFO] [auron_jni_bridge::jni_bridge:469]
(stage: 0, partition: 0, tid: 0) - Initializing JavaClasses...
2025-11-16 16:04:54.835 (+0.020s) [INFO] [auron_jni_bridge::jni_bridge:525]
(stage: 0, partition: 0, tid: 0) - Initializing JavaClasses finished
2025-11-16 16:04:54.835 (+0.020s) [INFO] [auron::exec:74] (stage: 0,
partition: 0, tid: 0) - initializing datafusion session
2025-11-16 16:04:54.837 (+0.023s) [INFO] [auron_memmgr:48] (stage: 0,
partition: 0, tid: 0) - mem manager initialized with total memory: 614.4 MiB
thread '<unnamed>' panicked at
/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.48.0/src/runtime/scheduler/multi_thread/worker.rs:457:13:
OS can't spawn worker thread: Resource temporarily unavailable (os error 11)
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread '<unnamed>' panicked at
/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.48.0/src/runtime/scheduler/multi_thread/worker.rs:457:13:
OS can't spawn worker thread: Resource temporarily unavailable (os error 11)
thread '<unnamed>' panicked at
/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.48.0/src/runtime/scheduler/multi_thread/worker.rs:457:13:
OS can't spawn worker thread: Resource temporarily unavailable (os error 11)
thread '<unnamed>' panicked at
/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.48.0/src/runtime/scheduler/multi_thread/worker.rs:457:13:
OS can't spawn worker thread: Resource temporarily unavailable (os error 11)
25/11/16 16:04:54 ERROR [Executor task launch worker for task 152.0 in stage
6.0 (TID 7081)] Executor: Exception in task 152.0 in stage 6.0 (TID 7081)
java.lang.RuntimeException: OS can't spawn worker thread: Resource
temporarily unavailable (os error 11)
at org.apache.auron.jni.JniBridge.callNative(Native Method)
~[auron-spark-3.3_2.12-pre-linux-x86_64-7.0.0-20251111-fixed.jar:7.0.0-SNAPSHOT]
at
org.apache.auron.jni.AuronCallNativeWrapper.<init>(AuronCallNativeWrapper.java:94)
~[auron-spark-3.3_2.12-pre-linux-x86_64-7.0.0-20251111-fixed.jar:7.0.0-SNAPSHOT]
at
org.apache.spark.sql.auron.NativeHelper$.executeNativePlan(NativeHelper.scala:109)
~[auron-spark-3.3_2.12-pre-linux-x86_64-7.0.0-20251111-fixed.jar:7.0.0-SNAPSHOT]
at
org.apache.spark.sql.execution.auron.shuffle.AuronShuffleWriterBase.nativeShuffleWrite(AuronShuffleWriterBase.scala:67)
~[auron-spark-3.3_2.12-pre-linux-x86_64-7.0.0-20251111-fixed.jar:7.0.0-SNAPSHOT]
at
org.apache.spark.sql.execution.auron.plan.NativeShuffleExchangeExec$$anon$1.write(NativeShuffleExchangeExec.scala:156)
~[auron-spark-3.3_2.12-pre-linux-x86_64-7.0.0-20251111-fixed.jar:7.0.0-SNAPSHOT]
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
~[spark-core_2.12-3.3.1-dw1.2.40.jar:3.3.1-dw1.2.40]
at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
~[spark-core_2.12-3.3.1-dw1.2.40.jar:3.3.1-dw1.2.40]
at org.apache.spark.scheduler.Task.run(Task.scala:136)
~[spark-core_2.12-3.3.1-dw1.2.40.jar:3.3.1-dw1.2.40]
at
org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:545)
~[spark-core_2.12-3.3.1-dw1.2.40.jar:3.3.1-dw1.2.40]
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1504)
~[spark-core_2.12-3.3.1-dw1.2.40.jar:3.3.1-dw1.2.40]
at
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:548)
~[spark-core_2.12-3.3.1-dw1.2.40.jar:3.3.1-dw1.2.40]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[?:1.8.0_372]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
~[?:1.8.0_372]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_372]
25/11/16 16:04:54 ERROR [Executor task launch worker for task 151.0 in stage
6.0 (TID 7080)] Executor: Exception in task 151.0 in stage 6.0 (TID 7080)
java.lang.RuntimeException: OS can't spawn worker thread: Resource
temporarily unavailable (os error 11)
```
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
