ferenc-csaky commented on PR #16927: URL: https://github.com/apache/flink/pull/16927#issuecomment-1386739768
> @thebalu Thanks for reaching out. I didn't get this PR merged because the community has no capacity to review it, especially since this PR is hard to test. I would revisit it and make a new PR if possible. > > Note that this PR is not a complete solution, because it may take hours for HDFS to recover from node failures sometimes. In that case, it would block Flink for a long time, so we had to give up truncating these files and perform a manual truncation after HDFS's recovery. @link3280 we can help with the testing/review and some push to get this merged, so if you are willing to finish this work, lets collaborate. :) Do you have anything in mind already regarding the missing parts? I think it would make sense to introduce a timeout property for the blocking wait. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
