Chesnay Schepler created FLINK-24226:
----------------------------------------
Summary: Improve error message when trying Presto S3 FS with
recoverable writer
Key: FLINK-24226
URL: https://issues.apache.org/jira/browse/FLINK-24226
Project: Flink
Issue Type: Technical Debt
Components: FileSystems
Reporter: Chesnay Schepler
Fix For: 1.15.0
When you use the Presto S3 FileSystem with recoverable writers you get this
exception:
{code}
java.lang.UnsupportedOperationException: This s3 file system implementation
does not support recoverable writers.
at
org.apache.flink.fs.s3.common.FlinkS3FileSystem.createRecoverableWriter(FlinkS3FileSystem.java:136)
at
org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134)
at
org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69)
at
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$RowFormatBuilder.createBuckets(StreamingFileSink.java:260)
at
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.initializeState(StreamingFileSink.java:396)
{code}
While this is technically _correct_ it's not really helpful to a user. It does
not propose a course of action (e.g., "Use the Hadoop S3 FileSystem instead"),
which is particularly important because this limitation isn't documented.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
