[
https://issues.apache.org/jira/browse/FLINK-17359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aljoscha Krettek closed FLINK-17359.
------------------------------------
Fix Version/s: 1.10.2
1.11.0
Resolution: Fixed
release-1.10: 5f5a80c0e86c50568a4fbb0526b464faff5c87fb
master: 2452321f23e0fd86c37b5ac063fea107f43a81b4
[~liyu] I added this to the release-1.10 branch, so if you cut a new RC for
1.10.1 this might be included because it's a good fix.
> Entropy key is not resolved if flink-s3-fs-hadoop is added as a plugin
> ----------------------------------------------------------------------
>
> Key: FLINK-17359
> URL: https://issues.apache.org/jira/browse/FLINK-17359
> Project: Flink
> Issue Type: Bug
> Components: FileSystems
> Reporter: Prem Santosh
> Assignee: Prem Santosh
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.11.0, 1.10.2
>
>
> Using flink 1.10
> I added the flink-s3-fs-hadoop jar in plugins dir but I am seeing the
> checkpoints paths like
> {{s3://my_app/__ENTROPY__/app_name-staging/flink/checkpoints/e10f47968ae74934bd833108d2272419/chk-3071}}
> which means the entropy injection key is not being resolved. After some
> debugging I found that in the
> [EntropyInjector|https://github.com/apache/flink/blob/release-1.10.0/flink-core/src/main/java/org/apache/flink/core/fs/EntropyInjector.java#L97]
> we check if the given fileSystem is of type {{SafetyNetWrapperFileSystem}}
> and if so we check if the delegate is of type {{EntropyInjectingFileSystem}}
> but don't check for {{[ClassLoaderFixingFileSystem
> |https://github.com/apache/flink/blob/release-1.10.0/flink-core/src/main/java/org/apache/flink/core/fs/PluginFileSystemFactory.java#L65]}}
> which would be the type if S3 file system dependencies are added as a plugin.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
