[
https://issues.apache.org/jira/browse/FLINK-30635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729305#comment-17729305
]
luoyuxia edited comment on FLINK-30635 at 6/5/23 12:30 PM:
-----------------------------------------------------------
[~masteryhx] Thanks for advice. I think set fs.file.impl explicitly may well
solve my problem. But IIUC, we have no way to set fs.file.impl with Flink since
it's a hadoop conf and our flink config can't recognize it and then set it to
hadoop conf.
I think our `OSSFileSystemFactory` should provide a way to set congurations to
hadoop conf not only the congurations with prefiex `fs.oss.`
was (Author: luoyuxia):
[~masteryhx] Thanks for advice. I think set fs.file.impl explicitly may well
solve my problem. But IIUC, we have no way to set fs.file.impl with Flink since
it's a hadoop conf and our flink config can't recognize it and then set it to
hadoop conf.
> Fail to recover for row-format when writing to OSS using FileSystemTable
> connector
> ----------------------------------------------------------------------------------
>
> Key: FLINK-30635
> URL: https://issues.apache.org/jira/browse/FLINK-30635
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, FileSystems
> Reporter: luoyuxia
> Priority: Major
> Attachments: image-2023-01-11-17-42-15-964.png
>
>
> When recover for row-format file such as csv/json, it will try to copy oss to
> local which depends on LocalFileSystem, but the LocalFileSystem can't be
> loaded by the classloader if the related LocalFileSystem haven't been
> included in FLINK_HOME/lib.
> !image-2023-01-11-17-42-15-964.png|width=790,height=246!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
