tgravescs commented on pull request #35085: URL: https://github.com/apache/spark/pull/35085#issuecomment-1026904382
it would be nice to update description to say when we remove them. Is there a config to disable this functionality, didn't see one? I think the removeBlocks was added in 3.0 so probably fairly safe for compatibility but it might be nice to have it behind a feature flag just in case someone has weird shuffle service or there is just issues with the feature (unless we are really confident in it). open to thoughts on this.. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
