kuwylsr commented on PR #11882: URL: https://github.com/apache/gluten/pull/11882#issuecomment-5275701327
@zhztheplayer Hi zhztheplayer, I’d like to consult you on an issue regarding memory pool leaks in async I/O during Velox scan prefetching. I came across this community PR: https://github.com/apache/gluten/pull/11882. It appears that at the Gluten framework level, the PR already ensures async I/O threads are waited on (via reference counting and timeout) until they finish execution and are properly destructed. However, in our current implementation, we are still blocking indefinitely on loads that remain in the loadingstate. Given the framework-level support introduced in this PR, is it still necessary to block indefinitely here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
