kevinwilfong opened a new pull request, #13495: URL: https://github.com/apache/gluten/pull/13495
## What changes are proposed in this pull request? Today in VeloxIteratorApi the iterator for earlier stages is marked interruptible but the final stage's iterator is not. This has caused problems when the final Tasks take a long time to finish. For example, when Task speculation is enabled, and the TaskReaper is enabled with a timeout, if we attempt to kill a Task in the final stage when another attempt has succeeded, it will run until completion, if this takes longer than the timeout the Executor JVM exits affecting other Tasks running in the same Executor. ## How was this patch tested? Ran an example query that demonstrated the issue with TaskReaper and speculation and verified the Tasks were promptly terminated when another attempt succeeded. Added a unit test as well. ## Was this patch authored or co-authored using generative AI tooling? Generated-by: GPT-6.1 Sol -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
