TheR1sing3un commented on issue #17816: URL: https://github.com/apache/hudi/issues/17816#issuecomment-3786323033
> Do you know why the FileSystem here is closed? Perhaps, let's whitelist certain exceptions that we can allow, e.g. If file is already deleted, i.e. FileNotFound, we do not rethrow it, ignore the exception. The possibility of throwing an exception here is diverse. Network issue? Memory issue? Everything is possible. However, in any case, only the `FileNotFoundException` is allowed. I think all other exceptions need to be thrown out and rely on the task retry mechanism of the execution engine like Spark to be re-executed several times. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
