jiangjiangtian opened a new pull request, #13063: URL: https://github.com/apache/gluten/pull/13063
Closes https://github.com/apache/gluten/issues/13062. The fetch starts at `posFetch_`, so clamp the fetch length against `size_ - posFetch_` instead of `size_ - pos_`. This keeps `posFetch_` either page-aligned or exactly at `size_` (after which no further fetch is needed), so every `madvise()` call receives a page-aligned address and no advised range overruns the mapping. Besides, after this PR the prefetching will work in all cases, there is a perfermance gain in merging spills of shuffle data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
