andygrove commented on issue #2452:
URL:
https://github.com/apache/datafusion-comet/issues/2452#issuecomment-3358622332
```
org.apache.comet.CometNativeException: Additional allocation failed for
ExternalSorterMerge[9] with top memory consumers (across reservations) as:
ExternalSorter[9]#1170(can spill: true) consumed 250.2 MB, peak 266.0 MB,
ExternalSorterMerge[9]#1169(can spill: false) consumed 5.0 MB, peak 10.0
MB,
ExternalSorterMerge[9]#1171(can spill: false) consumed 866.9 KB, peak 10.0
MB,
SMJStream[9]#1172(can spill: false) consumed 0.0 B, peak 0.0 B,
GroupedHashAggregateStream[9] ()#1173(can spill: true) consumed 0.0 B,
peak 0.0 B,
GroupedHashAggregateStream[9] ()#1174(can spill: true) consumed 0.0 B,
peak 0.0 B.
Error: Task 1008 failed to acquire 327680 bytes, only got 536. Reserved:
268466040
backtrace: 0:
<comet::execution::memory_pools::unified_pool::CometUnifiedMemoryPool as
datafusion_execution::memory_pool::MemoryPool>::try_grow
1: <datafusion_execution::memory_pool::pool::TrackConsumersPool<I> as
datafusion_execution::memory_pool::MemoryPool>::try_grow
2: datafusion_execution::memory_pool::MemoryReservation::try_grow
3: datafusion_physical_plan::sorts::builder::BatchBuilder::push_batch
4:
datafusion_physical_plan::sorts::merge::SortPreservingMergeStream<C>::maybe_poll_stream
5: <datafusion_physical_plan::sorts::merge::SortPreservingMergeStream<C>
as futures_core::stream::Stream>::poll_next
6:
datafusion_physical_plan::sorts::sort::ExternalSorter::sort_and_spill_in_mem_batches::{{closure}}
7: <datafusion_physical_plan::stream::RecordBatchStreamAdapter<S> as
futures_core::stream::Stream>::poll_next
8: <comet::execution::operators::copy::CopyStream as
futures_core::stream::Stream>::poll_next
9:
<datafusion_physical_plan::joins::sort_merge_join::stream::SortMergeJoinStream
as futures_core::stream::Stream>::poll_next
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
