Kontinuation commented on PR #1511: URL: https://github.com/apache/datafusion-comet/pull/1511#issuecomment-2758055879
> I saw that too on my MacBook Pro M3 Max 15.3.2 but with different sizes, maybe it's related to L1/2/3 cache? I guess it is a kernel issue. 4 seconds is way too long for copying 4~8MB data even if every memory access is an L3 cache miss. BTW, the longest time I've observed for this realloc is 13 seconds. The kernel could be doing page remapping for large reallocations, and this page remapping could be blocked by lock contention and spent extraordinary long time. I tried to capture kernel stack traces but failed to resolve symbols for the addresses so I'm still not sure what happened. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
