kbuci opened a new issue, #17957: URL: https://github.com/apache/hudi/issues/17957
### Task Description **What needs to be done:** If the user specified filesystem view type as SPILLABLE_DISK, then HUDI should override this to instead use MEMORY. **Why this task is needed:** It is not safe to use filesystem view type as SPILLABLE_DISK, since when spark serializes/deserializes the `SpillableMapBasedFileSystemView` it will not "copy over" data that was stored in files. This cause cause correctness issues, like clean to not targeting all replaced file groups. I need to check still if this is still an issue if embedded timeline server is enabled. ### Task Type Code improvement/refactoring ### Related Issues **Parent feature issue:** (if applicable ) **Related issues:** NOTE: Use `Relationships` button to add parent/blocking issues after issue is created. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
