andygrove commented on issue #2452: URL: https://github.com/apache/datafusion-comet/issues/2452#issuecomment-3367039203
The last chart was incorrect. <img width="1800" height="900" alt="Image" src="https://github.com/user-attachments/assets/fc942115-8d17-4b5f-8533-507501450d46"; /> Here is where we run into issues: ``` 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(698208) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(786432) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(717888) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(786432) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(738432) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(786432) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(786432) returning Ok 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(465216) returning Ok 25/10/03 13:52:23 WARN CometTaskMemoryManager: Task 1713 requested 786432 bytes but only received 0 bytes. Current allocation is 279744952 and the total memory consumption is 279744952 bytes. 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].try_grow(786432) returning Err 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorterMerge[137]].shrink(10485760) 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].shrink(786432) 25/10/03 13:52:23 WARN CometTaskMemoryManager: Task 1713 requested 65536 bytes but only received 0 bytes. Current allocation is 268472760 and the total memory consumption is 268472760 bytes. 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorterMerge[137]].try_grow(65536) returning Err 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].shrink(685248) 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].shrink(481344) 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].shrink(420480) 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].shrink(786432) 25/10/03 13:52:23 INFO core/src/execution/memory_pools/logging_pool.rs: [Task 1713] MemoryPool[ExternalSorter[137]].shrink(786432) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
