zhztheplayer opened a new pull request, #7463: URL: https://github.com/apache/incubator-gluten/pull/7463
It's observed in CI `Q67/Q95 OOM` test that large global spill pool usage is causing overhead memory OOM. The PR tries to tweak on default config option to fix the issue. The OOM message was like: ``` "allocateNonContiguous failed with 2 pages from Memory Pool[__sys_spilling__ LEAF root[__sys_root__] parent[__sys_root__] MALLOC no-usage-track thread-safe]<unlimited max capacity unlimited capacity used 0B available 0B reservation [used 0B, reserved 0B, min 0B] counters [allocs 149202, frees 121609, reserves 0, releases 0, collisions 0])> Exceeded memory allocator limit when allocating 2 new pages, the memory allocator capacity is 1.35GB" ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
