FelixYBW commented on issue #6556:
URL:
https://github.com/apache/incubator-gluten/issues/6556#issuecomment-2472287848
new case:
```
W20241113 03:12:10.289521 145289 Operator.cpp:711] Can't reclaim from memory
pool op.1.0.0.OrderBy which is under non-reclaimable section, memory usage:
11.21GB, reservation: 11.21GB
24/11/13 03:12:10 ERROR [Executor task launch worker for task 5029.0 in
stage 2.0 (TID 137545)] listener.ManagedReservationListener: Error reserving
memory from target
org.apache.gluten.memory.memtarget.ThrowOnOomMemoryTarget$OutOfMemoryException:
Not enough spark off-heap execution memory. Acquired: 8.0 MiB, granted: 4.0
MiB. Try tweaking config option spark.memory.offHeap.size to get larger space
to run this application (if spark.gluten.memory.dynamic.offHeap.sizing.enabled
is not enabled).
Current config settings:
spark.gluten.memory.offHeap.size.in.bytes=11.2 GiB
spark.gluten.memory.task.offHeap.size.in.bytes=11.2 GiB
spark.gluten.memory.conservative.task.offHeap.size.in.bytes=5.6 GiB
spark.memory.offHeap.enabled=true
spark.gluten.memory.dynamic.offHeap.sizing.enabled=false
Memory consumer stats:
Task.137545: Current used
bytes: 11.2 GiB, peak bytes: N/A
\- Gluten.Tree.60: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
\- root.60: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
+- NativePlanEvaluator-60.0: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
| \- single: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
| +- root: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
| | +- task.Gluten_Stage_2_TID_137545_VTID_60: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
| | | +- node.1: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
| | | | \- op.1.0.0.OrderBy: Current used
bytes: 11.2 GiB, peak bytes: 11.2 GiB
| | | +- node.2: Current used
bytes: 96.0 KiB, peak bytes: 1024.0 KiB
| | | | \- op.2.0.0.Window: Current used
bytes: 96.0 KiB, peak bytes: 96.0 KiB
| | | +- node.0: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| | | | \- op.0.0.0.ValueStream: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| | | \- node.3: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| | | \- op.3.0.0.FilterProject: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| | \- default_leaf: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| \- gluten::MemoryAllocator: Current used
bytes: 0.0 B, peak bytes: 0.0 B
+- ArrowContextInstance.4: Current used
bytes: 8.0 MiB, peak bytes: 8.0 MiB
+- IndicatorVectorBase#init.60.OverAcquire.0: Current used
bytes: 0.0 B, peak bytes: 0.0 B
+- IteratorMetrics.60.OverAcquire.0: Current used
bytes: 0.0 B, peak bytes: 0.0 B
+- ShuffleReader.2.OverAcquire.0: Current used
bytes: 0.0 B, peak bytes: 4.8 MiB
+- NativePlanEvaluator-60.0.OverAcquire.0: Current used
bytes: 0.0 B, peak bytes: 3.0 GiB
+- IteratorMetrics.60: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| \- single: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| +- root: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| | \- default_leaf: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| \- gluten::MemoryAllocator: Current used
bytes: 0.0 B, peak bytes: 0.0 B
+- IndicatorVectorBase#init.60: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| \- single: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| +- gluten::MemoryAllocator: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| \- root: Current used
bytes: 0.0 B, peak bytes: 0.0 B
| \- default_leaf: Current used
bytes: 0.0 B, peak bytes: 0.0 B
\- ShuffleReader.2: Current used
bytes: 0.0 B, peak bytes: 16.0 MiB
\- single: Current used
bytes: 0.0 B, peak bytes: 16.0 MiB
+- root: Current used
bytes: 0.0 B, peak bytes: 1024.0 KiB
| \- default_leaf: Current used
bytes: 0.0 B, peak bytes: 579.8 KiB
\- gluten::MemoryAllocator: Current used
bytes: 0.0 B, peak bytes: 401.2 KiB
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
