aljoscha commented on issue #7519: FLINK-11378 - Allow writing to Hadoop compatible Filesystems via Hado… URL: https://github.com/apache/flink/pull/7519#issuecomment-455155075 @martijnvdgrift Can you confirm that GCS is not eventually consistent? This check was introduced because some file systems that are implemented as a HCFS are eventually consistent (such as S3). This will lead to problems because the `HadoopRecoverableWriter` assumes non-eventual consistency. I would like to not remove this check completely but instead introduce a whitelist of filesystems that we know work correctly with this writer. What do you think?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
