alamb opened a new issue, #6513: URL: https://github.com/apache/arrow-datafusion/issues/6513
TDLR is that ensuring that launched tasks are properly cleaned up (and `panic`s are propagated back to the main tasks) is tricky. Tokio has a [tokio::task::JoinSet](https://docs.rs/tokio/latest/tokio/task/struct.JoinSet.html) which handles the cleanup part and https://github.com/apache/arrow-datafusion/pull/6507 demonstrates how to use JoinSet to propagate panics. We should ideally also fix `datafusion/core/src/physical_plan/repartition/mod.rs` to propagate panics and remove `AbortOnDrop` and`AbortOnDropMany` with JoinSet _Originally posted by @crepererum in https://github.com/apache/arrow-datafusion/issues/6449#issuecomment-1568326616_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
