Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19458
Instead of filtering out temp blocks, why not adding parsing rule for
`TempLocalBlockId` and `TempShuffleBlockId`? That could also solve the problem.
Since `DiskBlockManager#getAllFiles` doesn't filter out temp shuffle/local
files, is it better to keep the same behavior for
`DiskBlockManager#getAllBlocks`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
