[
https://issues.apache.org/jira/browse/FLINK-30635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729311#comment-17729311
]
luoyuxia commented on FLINK-30635:
----------------------------------
After some debugging, I think the finnal reason for my case is that I use the
shaded hadoop.
The hadoop libs do exist in FLINK_HOME/lib, if not specified `fs.file.impl`,
it'll try to load the filesytem using SPI. The class name to be discovered is
`org.apache.hadoop.fs.LocalFileSystem` as as specified in
META-INF/services/org.apache.hadoop.fs.FileSystem.
But the class has been relocated to
`org.apache.flink.fs.shaded.hadoop3.org.apache.hadoop.fs.LocalFileSystem`, so
it can't find the class `org.apache.hadoop.fs.LocalFileSystem`.
> Fail to recover for row-format when writing to OSS using FileSystemTable
> connector
> ----------------------------------------------------------------------------------
>
> Key: FLINK-30635
> URL: https://issues.apache.org/jira/browse/FLINK-30635
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, FileSystems
> Reporter: luoyuxia
> Priority: Major
> Attachments: image-2023-01-11-17-42-15-964.png
>
>
> When recover for row-format file such as csv/json, it will try to copy oss to
> local which depends on LocalFileSystem, but the LocalFileSystem can't be
> loaded by the classloader if the related LocalFileSystem haven't been
> included in FLINK_HOME/lib.
> !image-2023-01-11-17-42-15-964.png|width=790,height=246!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
