dongjoon-hyun opened a new pull request #32784:
URL: https://github.com/apache/spark/pull/32784


   ### What changes were proposed in this pull request?
   
   This PR aims to change `DiskBlockManager` like the following to allow 
`ShuffleDataIO` to decide the behavior of shuffle file deletion.
   ```scala
   - private[spark] class DiskBlockManager(conf: SparkConf, deleteFilesOnStop: 
Boolean)
   +private[spark] class DiskBlockManager(conf: SparkConf, var 
deleteFilesOnStop: Boolean)
   ```
   
   ### Why are the changes needed?
   
   To implement enhanced shuffle data management feature via `ShuffleDataIO` 
like https://github.com/apache/spark/pull/32730 .
   
   ### Does this PR introduce _any_ user-facing change?
   
   No. This is a private class.
   
   ### How was this patch tested?
   
   N/A


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to